research
∙
02/28/2022
DropIT: Dropping Intermediate Tensors for Memory-Efficient DNN Training
A standard hardware bottleneck when training deep neural networks is GPU...
share
research
∙
06/11/2020
STL-SGD: Speeding Up Local SGD with Stagewise Communication Period
Distributed parallel stochastic gradient descent algorithms are workhors...
research
∙
12/30/2019
Variance Reduced Local SGD with Lower Communication Complexity
To accelerate the training of machine learning models, distributed stoch...
research
∙
06/28/2019