research
∙
04/13/2023
Shall We Pretrain Autoregressive Language Models with Retrieval? A Comprehensive Study
Large decoder-only language models (LMs) can be largely improved in term...
share
research
∙
05/10/2022
Reducing Activation Recomputation in Large Transformer Models
Training large transformer models is one of the most important computati...
research
∙
06/27/2012
