research
∙
01/02/2023
On Bilevel Optimization without Lower-level Strong Convexity
Theoretical properties of bilevel problems are well studied when the low...
share
research
∙
04/03/2022
Understanding the unstable convergence of gradient descent
Most existing analyses of (stochastic) gradient descent rely on the cond...
research
∙
02/13/2022
Minimax in Geodesic Metric Spaces: Sion's Theorem and Algorithms
Determining whether saddle points exist or are approximable for nonconve...
research
∙
06/08/2020
Stochastic Optimization with Non-stationary Noise
We investigate stochastic optimization problems under relaxed assumption...
research
∙
02/10/2020
On Complexity of Finding Stationary Points of Nonsmooth Nonconvex Functions
We provide the first non-asymptotic analysis for finding stationary poin...
research
∙
05/28/2019
Analysis of Gradient Clipping and Adaptive Scaling with a Relaxed Smoothness Condition
We provide a theoretical explanation for the fast convergence of gradien...
research
∙
05/25/2019
Quantifying Exposure Bias for Neural Language Generation
The exposure bias problem refers to the training-inference discrepancy c...
research
∙
12/13/2018
