research
∙
02/03/2023
Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers
We propose a new class of linear Transformers called FourierLearner-Tran...
share
research
∙
11/25/2021
PolyViT: Co-training Vision Transformers on Images, Videos and Audio
Can we train a single transformer model capable of processing multiple m...
research
∙
09/30/2020
Rethinking Attention with Performers
We introduce Performers, Transformer architectures which can estimate re...
research
∙
04/18/2020
