research
∙
02/17/2022
Designing Effective Sparse Expert Models
Scale has opened new frontiers in natural language processing – but at a...
share
research
∙
11/07/2020
Exploring the limits of Concurrency in ML Training on Google TPUs
Recent results in language understanding using neural networks have requ...
research
∙
11/06/2020
Highly Available Data Parallel ML training on Mesh Networks
Data parallel ML models can take several days or weeks to train on sever...
research
∙
10/30/2020
Training EfficientNets at Supercomputer Scale: 83 Accuracy in One Hour
EfficientNets are a family of state-of-the-art image classification mode...
research
∙
09/21/2019
Scale MLPerf-0.6 models on Google TPU-v3 Pods
The recent submission of Google TPU-v3 Pods to the industry wide MLPerf ...
research
∙
11/16/2018
Image Classification at Supercomputer Scale
Deep learning is extremely computationally intensive, and hardware vendo...
research
∙
11/02/2017
Efficient Training of Convolutional Neural Nets on Large Distributed Systems
Deep Neural Networks (DNNs) have achieved im- pressive accuracy in many ...
research
∙
08/07/2017