What does it mean for data to be `observed' or `missing'?

11/09/2018
by   John C. Galati, et al.
0

In statistical modelling of incomplete data, missingness is encoded as a relation between datasets Y and response patterns R. We identify two different meanings of `observed' and `missing' implicit in this framework, only one of which is consistent with the definition formally encoded in (Y, R). Notation that has been used in the literature for more than three decades fails to distinguish between these two concepts, rendering the notations `f(y_obs,y_mis)' and `f(y_mis | y_obs)' conceptually contradictory. Additionally, the same notation `f(y_mis | y_obs)' is used to refer to two densities with different domains. These densities can be considered to be equivalent mathematically, but conceptually they are not interchangeable as distributions because of their differing relationships to (Y, R). Only one of these distributions is consistent with (Y, R) and standard conventions for interpretation of mathematical notation leads to the wrong choice conceptually for ignorable multiple imputation. We introduce formal definitions and notational improvements to treat these and other ambiguities, and we demonstrate their use through several example derivations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/13/2023

Imputation of missing data using multivariate Gaussian Linear Cluster-Weighted Modeling

Missing data arises when certain values are not recorded or observed for...
research
11/25/2018

What is meant by 'P(R|Yobs)'?

Missing at Random (MAR) is a central concept in incomplete data methods,...
research
08/27/2022

Graphical and numerical diagnostic tools to assess multiple imputation models by posterior predictive checking

Missing data are often dealt with multiple imputation. A crucial part of...
research
03/15/2020

Unified Multi-Domain Learning and Data Imputation using Adversarial Autoencoder

We present a novel framework that can combine multi-domain learning (MDL...
research
06/28/2022

No imputation without representation

By filling in missing values in datasets, imputation allows these datase...
research
03/28/2023

Uncovering the Missing Pattern: Unified Framework Towards Trajectory Imputation and Prediction

Trajectory prediction is a crucial undertaking in understanding entity m...
research
11/13/2018

What is really needed to justify ignoring the response mechanism for modelling purposes?

With incomplete data, the standard argument for when the response mechan...

Please sign up or login with your details

Forgot password? Click here to reset