Mean Dimension of Ridge Functions

07/01/2019
by   Christopher R. Hoyt, et al.
0

We consider the mean dimension of some ridge functions of spherical Gaussian random vectors of dimension d. If the ridge function is Lipschitz continuous, then the mean dimension remains bounded as d→∞. If instead, the ridge function is discontinuous, then the mean dimension depends on a measure of the ridge function's sparsity, and absent sparsity the mean dimension can grow proportionally to √(d). Preintegrating a ridge function yields a new, potentially much smoother ridge function. We include an example where, if one of the ridge coefficients is bounded away from zero as d→∞, then preintegration can reduce the mean dimension from O(√(d)) to O(1).

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/01/2018

Dimension Reduction via Gaussian Ridge Functions

Ridge functions have recently emerged as a powerful set of ideas for sub...
research
05/30/2020

Ridge Regularizaton: an Essential Concept in Data Science

Ridge or more formally ℓ_2 regularization shows up in many areas of stat...
research
07/09/2021

Linear/Ridge expansions: Enhancing linear approximations by ridge functions

We consider approximations formed by the sum of a linear combination of ...
research
02/19/2023

Mean dimension of radial basis functions

We show that generalized multiquadric radial basis functions (RBFs) on ℝ...
research
04/10/2018

Universal features of mountain ridge patterns on Earth

We study structure of the mountain ridge systems based on the empirical ...
research
02/09/2017

Minimax Lower Bounds for Ridge Combinations Including Neural Nets

Estimation of functions of d variables is considered using ridge combi...

Please sign up or login with your details

Forgot password? Click here to reset