Anirudh Ravula | DeepAI

Chat Image Generator Video Music Voice Chat Photo Editor

Featured Co-authors

Manzil Zaheer
12 publications
Qifan Wang
6 publications
Guru Guruganesh
4 publications
Joshua Ainslie
4 publications
Chris Alberti
3 publications
Amr Ahmed
3 publications
Li Yang
3 publications
Santiago Ontañón
2 publications
Avinava Dubey
2 publications
Ruining He
2 publications
Philip Pham
2 publications

research

∙ 12/21/2020

RealFormer: Transformer Likes Residual Attention

Transformer is the backbone of modern NLP models. In this paper, we prop...

74 Ruining He, et al. ∙

research

∙ 07/28/2020

Big Bird: Transformers for Longer Sequences

Transformers-based models, such as BERT, have been one of the most succe...

73 Manzil Zaheer, et al. ∙

Success!

An error occurred