Performance of Empirical Risk Minimization for Linear Regression with Dependent Data

04/25/2021
by   Christian Brownlees, et al.
0

This paper establishes bounds on the performance of empirical risk minimization for large-dimensional linear regression. We generalize existing results by allowing the data to be dependent and heavy-tailed. The analysis covers both the cases of identically and heterogeneously distributed observations. Our analysis is nonparametric in the sense that the relationship between the regressand and the regressors is assumed to be unknown. The main results of this paper indicate that the empirical risk minimizer achieves the optimal performance (up to a logarithmic factor) in a dependent data setting.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset