Spectral Representation Learning for Conditional Moment Models

by   Ziyu Wang, et al.

Many problems in causal inference and economics can be formulated in the framework of conditional moment models, which characterize the target function through a collection of conditional moment restrictions. For nonparametric conditional moment models, efficient estimation has always relied on preimposed conditions on various measures of ill-posedness of the hypothesis space, which are hard to validate when flexible models are used. In this work, we address this issue by proposing a procedure that automatically learns representations with controlled measures of ill-posedness. Our method approximates a linear representation defined by the spectral decomposition of a conditional expectation operator, which can be used for kernelized estimators and is known to facilitate minimax optimal estimation in certain settings. We show this representation can be efficiently estimated from data, and establish L2 consistency for the resulting estimator. We evaluate the proposed method on proximal causal inference tasks, exhibiting promising performance on high-dimensional, semi-synthetic data.


page 1

page 2

page 3

page 4


Learning Causal Relationships from Conditional Moment Conditions by Importance Weighting

We consider learning causal relationships under conditional moment condi...

Functional Generalized Empirical Likelihood Estimation for Conditional Moment Restrictions

Important problems in causal inference, economics, and, more generally, ...

Minimax Kernel Machine Learning for a Class of Doubly Robust Functionals

A moment function is called doubly robust if it is comprised of two nuis...

Estimation Beyond Data Reweighting: Kernel Method of Moments

Moment restrictions and their conditional counterparts emerge in many ar...

Moment-Matching Graph-Networks for Causal Inference

In this note we explore a fully unsupervised deep-learning framework for...

Debiased Inference on Identified Linear Functionals of Underidentified Nuisances via Penalized Minimax Estimation

We study generic inference on identified linear functionals of nonunique...

Minimax Estimation of Conditional Moment Models

We develop an approach for estimating models described via conditional m...

Please sign up or login with your details

Forgot password? Click here to reset