research
∙
04/15/2022
Just Fine-tune Twice: Selective Differential Privacy for Large Language Models
With the increasing adoption of NLP models in real-world products, it be...
share
research
∙
02/15/2022
Quantifying Memorization Across Neural Language Models
Large language models (LMs) have been shown to memorize parts of their t...
research
∙
07/27/2021
Pointer Value Retrieval: A new benchmark for understanding the limits of neural network generalization
The successes of deep learning critically rely on the ability of neural ...
research
∙
07/14/2021
Deduplicating Training Data Makes Language Models Better
We find that existing language modeling datasets contain many near-dupli...
research
∙
02/08/2020
Exploring the Memorization-Generalization Continuum in Deep Learning
Human learners appreciate that some facts demand memorization whereas ot...
research
∙
02/14/2019
Transfusion: Understanding Transfer Learning with Applications to Medical Imaging
With the increasingly varied applications of deep learning, transfer lea...
research
∙
02/13/2019
Identity Crisis: Memorization and Generalization under Extreme Overparameterization
We study the interplay between memorization and generalization of overpa...
research
∙
02/06/2019
Are All Layers Created Equal?
Understanding learning and generalization of deep architectures has been...
research
∙
04/18/2018
