Active Feature Acquisition with Supervised Matrix Completion

by   Sheng-Jun Huang, et al.

Feature missing is a serious problem in many applications, which may lead to low quality of training data and further significantly degrade the learning performance. While feature acquisition usually involves special devices or complex process, it is expensive to acquire all feature values for the whole dataset. On the other hand, features may be correlated with each other, and some values may be recovered from the others. It is thus important to decide which features are most informative for recovering the other features as well as improving the learning performance. In this paper, we try to train an effective classification model with least acquisition cost by jointly performing active feature querying and supervised matrix completion. When completing the feature matrix, a novel target function is proposed to simultaneously minimize the reconstruction error on observed entries and the supervised loss on training data. When querying the feature value, the most uncertain entry is actively selected based on the variance of previous iterations. In addition, a bi-objective optimization method is presented for cost-aware active selection when features bear different acquisition costs. The effectiveness of the proposed approach is well validated by both theoretical analysis and experimental study.


page 1

page 2

page 3

page 4


Why Pay More When You Can Pay Less: A Joint Learning Framework for Active Feature Acquisition and Classification

We consider the problem of active feature acquisition, where we sequenti...

Matrix Completion with Heterogonous Cost

Matrix completion problem has been studied extensively under the conditi...

Value of Information Lattice: Exploiting Probabilistic Independence for Effective Feature Subset Acquisition

We address the cost-sensitive feature acquisition problem, where misclas...

Fast Classification with Sequential Feature Selection in Test Phase

This paper introduces a novel approach to active feature acquisition for...

Deep Learning Approach for Matrix Completion Using Manifold Learning

Matrix completion has received vast amount of attention and research due...

Online Graph Completion: Multivariate Signal Recovery in Computer Vision

The adoption of "human-in-the-loop" paradigms in computer vision and mac...

Acquisition Conditioned Oracle for Nongreedy Active Feature Acquisition

We develop novel methodology for active feature acquisition (AFA), the s...

Please sign up or login with your details

Forgot password? Click here to reset