Automatic Debiased Machine Learning for Covariate Shifts

07/10/2023
by   Michael Newey, et al.
0

In this paper we address the problem of bias in machine learning of parameters following covariate shifts. Covariate shift occurs when the distribution of input features change between the training and deployment stages. Regularization and model selection associated with machine learning biases many parameter estimates. In this paper, we propose an automatic debiased machine learning approach to correct for this bias under covariate shifts. The proposed approach leverages state-of-the-art techniques in debiased machine learning to debias estimators of policy and causal parameters when covariate shift is present. The debiasing is automatic in only relying on the parameter of interest and not requiring the form of the form of the bias. We show that our estimator is asymptotically normal as the sample size grows. Finally, we evaluate the method using a simulation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/16/2021

Covariate Shift in High-Dimensional Random Feature Regression

A significant obstacle in the development of robust machine learning mod...
research
08/28/2023

Ad-Rec: Advanced Feature Interactions to Address Covariate-Shifts in Recommendation Networks

Recommendation models are vital in delivering personalized user experien...
research
12/05/2022

Blessings and Curses of Covariate Shifts: Adversarial Learning Dynamics, Directional Convergence, and Equilibria

Covariate distribution shifts and adversarial perturbations present robu...
research
02/18/2023

Clustered Covariate Regression

High covariate dimensionality is an increasingly occurrent phenomenon in...
research
04/19/2023

An Offline Metric for the Debiasedness of Click Models

A well-known problem when learning from user clicks are inherent biases ...
research
02/16/2022

Bias in Automated Image Colorization: Metrics and Error Types

We measure the color shifts present in colorized images from the ADE20K ...
research
06/17/2021

PAC Prediction Sets Under Covariate Shift

An important challenge facing modern machine learning is how to rigorous...

Please sign up or login with your details

Forgot password? Click here to reset