research
∙
04/04/2023
Effective Theory of Transformers at Initialization
We perform an effective-theory analysis of forward-backward signal propa...
share
research
∙
10/10/2022
Meta-Principled Family of Hyperparameter Scaling Strategies
In this note, we first derive a one-parameter family of hyperparameter s...
research
∙
06/18/2021
The Principles of Deep Learning Theory
This book develops an effective theory approach to understanding deep ne...
research
∙
09/30/2019
Non-Gaussian processes and neural networks at finite widths
Gaussian processes are ubiquitous in nature and engineering. A case in p...
research
∙
08/07/2019
Robust Learning with Jacobian Regularization
Design of reliable systems must guarantee stability against input pertur...
research
∙
09/28/2018