Statistical Inference for Data Integration

09/25/2021
by   Xi Yang, et al.
0

In the age of big data, data integration is a critical step especially in the understanding of how diverse data types work together and work separately. Among the data integration methods, the Angle-Based Joint and Individual Variation Explained (AJIVE) is particularly attractive because it not only studies joint behavior but also individual behavior. Typically scores indicate relationships between data objects. The drivers of those relationships are determined by the loadings. A fundamental question is which loadings are statistically significant. A useful approach for assessing this is the jackstraw method. In this paper, we develop jackstraw for the loadings of the AJIVE data analysis. This provides statistical inference about the drivers in both joint and individual feature spaces.

READ FULL TEXT

page 3

page 5

research
03/26/2020

Data Integration by combining big data and survey sample data for finite population inference

The statistical challenges in using big data for making valid statistica...
research
07/07/2017

InferSpark: Statistical Inference at Scale

The Apache Spark stack has enabled fast large-scale data processing. Des...
research
09/09/2015

Statistical Inference, Learning and Models in Big Data

The need for new methods to deal with big data is a common theme in most...
research
02/22/2021

Divide-and-conquer methods for big data analysis

In the context of big data analysis, the divide-and-conquer methodology ...
research
04/07/2017

Angle-Based Joint and Individual Variation Explained

Integrative analysis of disparate data blocks measured on a common set o...
research
12/01/2019

Joint and individual analysis of breast cancer histologic images and genomic covariates

A key challenge in modern data analysis is understanding connections bet...
research
05/30/2015

Learning quantitative sequence-function relationships from massively parallel experiments

A fundamental aspect of biological information processing is the ubiquit...

Please sign up or login with your details

Forgot password? Click here to reset