research
∙
07/07/2021
Evaluating Large Language Models Trained on Code
We introduce Codex, a GPT language model fine-tuned on publicly availabl...
share
research
∙
09/30/2020
Rethinking Attention with Performers
We introduce Performers, Transformer architectures which can estimate re...
research
∙
05/21/2019
Sample Efficient Text Summarization Using a Single Pre-Trained Transformer
Language model (LM) pre-training has resulted in impressive performance ...
research
∙
07/10/2018
Universal Transformers
Self-attentive feed-forward sequence models have been shown to achieve i...
research
∙
02/15/2018
Image Transformer
Image generation has been successfully cast as an autoregressive sequenc...
research
∙
01/30/2018
Generating Wikipedia by Summarizing Long Sequences
We show that generating English Wikipedia articles can be approached as ...
research
∙
06/12/2017
Attention Is All You Need
The dominant sequence transduction models are based on complex recurrent...
research
∙
10/27/2016
