research
∙
07/24/2023
An Isometric Stochastic Optimizer
The Adam optimizer is the standard choice in deep learning applications....
share
research
∙
10/28/2020
Scaling Laws for Autoregressive Generative Modeling
We identify empirical scaling laws for the cross-entropy loss in four do...
research
∙
06/02/2019
An Empirical Study on Hyperparameters and their Interdependence for RL Generalization
Recent results in Reinforcement Learning (RL) have shown that agents wit...
research
∙
02/06/2019