Covariate-Adjusted Tensor Classification in High-Dimensions

by   Yuqing Pan, et al.

In contemporary scientific research, it is of great interest to predict a categorical response based on a high-dimensional tensor (i.e. multi-dimensional array) and additional covariates. This mixture of different types of data leads to challenges in statistical analysis. Motivated by applications in science and engineering, we propose a comprehensive and interpretable discriminant analysis model, called CATCH model (in short for Covariate-Adjusted Tensor Classification in High-dimensions), which efficiently integrates the covariates and the tensor to predict the categorical outcome. The CATCH model jointly models the relationships among the covariates, the tensor predictor, and the categorical response. More importantly, it preserves and utilizes the structures of the data for maximum interpretability and optimal prediction. To tackle the new computational and statistical challenges arising from the intimidating tensor dimensions, we propose a penalized approach to select a subset of tensor predictor entries that has direct discriminative effect after adjusting for covariates. We further develop an efficient algorithm that takes advantage of the tensor structure. Theoretical results confirm that our method achieves variable selection consistency and optimal classification error, even when the tensor dimension is much larger than the sample size. The superior performance of our method over existing methods is demonstrated in extensive simulated and real data examples.


page 1

page 2

page 3

page 4


Partially Observed Dynamic Tensor Response Regression

In modern data science, dynamic tensor data is prevailing in numerous ap...

Generalized tensor regression with covariates on multiple modes

We consider the problem of tensor-response regression given covariates o...

A Doubly-Enhanced EM Algorithm for Model-Based Tensor Clustering

Modern scientific studies often collect data sets in the forms of tensor...

Sequential Linear Discriminant Analysis in High Dimensions Using Individual Discriminant Functions

High dimensional classification has been highlighted for last two decade...

Conditional probability tensor decompositions for multivariate categorical response regression

In many modern regression applications, the response consists of multipl...

Broadcasted Nonparametric Tensor Regression

We propose a novel broadcasting idea to model the nonlinearity in tensor...

CoVeR: Learning Covariate-Specific Vector Representations with Tensor Decompositions

Word embedding is a useful approach to capture co-occurrence structures ...

Please sign up or login with your details

Forgot password? Click here to reset