research
∙
02/03/2023
Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers
We propose a new class of linear Transformers called FourierLearner-Tran...
share
research
∙
01/15/2023
DSVT: Dynamic Sparse Voxel Transformer with Rotated Sets
Designing an efficient yet deployment-friendly 3D backbone to handle spa...
research
∙
10/09/2022
Online Training Through Time for Spiking Neural Networks
Spiking neural networks (SNNs) are promising brain-inspired energy-effic...
research
∙
10/04/2022
One Transformer Can Understand Both 2D 3D Molecular Data
Unlike vision and language data which usually has a unique format, molec...
research
∙
05/31/2021
Adversarial Training with Rectified Rejection
Adversarial training (AT) is one of the most effective strategies for pr...
research
∙
03/09/2021
Wav2vec-C: A Self-supervised Model for Speech Representation Learning
Wav2vec-C introduces a novel representation learning technique combining...
research
∙
09/07/2020
GraphNorm: A Principled Approach to Accelerating Graph Neural Network Training
Normalization plays an important role in the optimization of deep neural...
research
∙
06/28/2020
Rethinking the Positional Encoding in Language Pre-training
How to explicitly encode positional information into neural networks is ...
research
∙
11/05/2018
