An Adaptively Resized Parametric Bootstrap for Inference in High-dimensional Generalized Linear Models

08/18/2022
by   Qian Zhao, et al.
0

Accurate statistical inference in logistic regression models remains a critical challenge when the ratio between the number of parameters and sample size is not negligible. This is because approximations based on either classical asymptotic theory or bootstrap calculations are grossly off the mark. This paper introduces a resized bootstrap method to infer model parameters in arbitrary dimensions. As in the parametric bootstrap, we resample observations from a distribution, which depends on an estimated regression coefficient sequence. The novelty is that this estimate is actually far from the maximum likelihood estimate (MLE). This estimate is informed by recent theory studying properties of the MLE in high dimensions, and is obtained by appropriately shrinking the MLE towards the origin. We demonstrate that the resized bootstrap method yields valid confidence intervals in both simulated and real data examples. Our methods extend to other high-dimensional generalized linear models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/28/2023

Statistical Inference in High-Dimensional Generalized Linear Models with Asymmetric Link Functions

We have developed a statistical inference method applicable to a broad r...
research
10/30/2020

Parametric bootstrap inference for stratified models with high-dimensional nuisance specifications

Inference about a scalar parameter of interest typically relies on the a...
research
07/13/2023

Scalable Resampling in Massive Generalized Linear Models via Subsampled Residual Bootstrap

Residual bootstrap is a classical method for statistical inference in re...
research
09/17/2020

Ridge Regression Revisited: Debiasing, Thresholding and Bootstrap

In high dimensional setting, the facts that the classical ridge regressi...
research
01/25/2020

The Asymptotic Distribution of the MLE in High-dimensional Logistic Models: Arbitrary Covariance

We study the distribution of the maximum likelihood estimate (MLE) in hi...
research
11/03/2020

Graph Enhanced High Dimensional Kernel Regression

In this paper, the flexibility, versatility and predictive power of kern...
research
08/02/2016

Can we trust the bootstrap in high-dimension?

We consider the performance of the bootstrap in high-dimensions for the ...

Please sign up or login with your details

Forgot password? Click here to reset