research
∙
10/30/2022
A Solvable Model of Neural Scaling Laws
Large language models with a huge number of parameters, when trained on ...
share
research
∙
06/18/2021
The Principles of Deep Learning Theory
This book develops an effective theory approach to understanding deep ne...
research
∙
04/10/2021
SGD Implicitly Regularizes Generalization Error
We derive a simple and model-independent formula for the change in the g...
research
∙
03/31/2021
Why is AI hard and Physics simple?
We discuss why AI is hard and why physics is simple. We discuss how phys...
research
∙
02/16/2021
Topological Obstructions to Autoencoding
Autoencoders have been proposed as a powerful tool for model-independent...
research
∙
08/07/2019
Robust Learning with Jacobian Regularization
Design of reliable systems must guarantee stability against input pertur...
research
∙
12/12/2018