research
∙
02/07/2023
What Matters In The Structured Pruning of Generative Language Models?
Auto-regressive large language models such as GPT-3 require enormous com...
share
research
∙
05/12/2022
The Mechanism of Prediction Head in Non-contrastive Self-supervised Learning
Recently the surprising discovery of the Bootstrap Your Own Latent (BYOL...
research
∙
06/21/2021
Improving Multi-Modal Learning with Uni-Modal Teachers
Learning multi-modal representations is an essential step towards real-w...
research
∙
05/31/2021
Toward Understanding the Feature Learning Process of Self-supervised Contrastive Learning
How can neural networks trained by contrastive learning extract features...
research
∙
02/17/2020