Quantitative Central Limit Theorems for Discrete Stochastic Processes

02/03/2019
by   Xiang Cheng, et al.
0

In this paper, we establish a generalization of the classical Central Limit Theorem for a family of stochastic processes that includes stochastic gradient descent and related gradient-based algorithms. Under certain regularity assumptions, we show that the iterates of these stochastic processes converge to an invariant distribution at a rate of O1/√(k) where k is the number of steps; this rate is provably tight.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset