research
∙
05/23/2021
GOALS: Gradient-Only Approximations for Line Searches Towards Robust and Consistent Training of Deep Neural Networks
Mini-batch sub-sampling (MBSS) is favored in deep neural network trainin...
research
∙
06/29/2020
Gradient-only line searches to automatically determine learning rates for a variety of stochastic training algorithms
Gradient-only and probabilistic line searches have recently reintroduced...
research
∙
01/15/2020
Resolving learning rates adaptively by locating Stochastic Non-Negative Associated Gradient Projection Points using line searches
Learning rates in stochastic neural network training are currently deter...
research
∙
03/22/2019
Gradient-only line searches: An Alternative to Probabilistic Line Searches
Step sizes in neural network training are largely determined using prede...
research
∙
03/20/2019