research
∙
04/05/2022
PaLM: Scaling Language Modeling with Pathways
Large language models have been shown to achieve remarkable performance ...
share
research
∙
03/31/2022
Scaling Up Models and Data with and
Recent neural network-based language models have benefited greatly from ...
research
∙
03/23/2022
Pathways: Asynchronous Distributed Dataflow for ML
We present the design of a new large scale orchestration layer for accel...
research
∙
03/01/2019
Model-Based Reinforcement Learning for Atari
Model-free reinforcement learning (RL) can be used to learn effective po...
research
∙
11/05/2018
Mesh-TensorFlow: Deep Learning for Supercomputers
Batch-splitting (data-parallelism) is the dominant distributed Deep Neur...
research
∙
03/16/2018
Tensor2Tensor for Neural Machine Translation
Tensor2Tensor is a library for deep learning models that is well-suited ...
research
∙
01/30/2018