Optimal Clustering with Missing Values

02/26/2019
by   Shahin Boluki, et al.
0

Missing values frequently arise in modern biomedical studies due to various reasons, including missing tests or complex profiling technologies for different omics measurements. Missing values can complicate the application of clustering algorithms, whose goals are to group points based on some similarity criterion. A common practice for dealing with missing values in the context of clustering is to first impute the missing values, and then apply the clustering algorithm on the completed data. We consider missing values in the context of optimal clustering, which finds an optimal clustering operator with reference to an underlying random labeled point process (RLPP). We show how the missing-value problem fits neatly into the overall framework of optimal clustering by incorporating the missing value mechanism into the random labeled point process and then marginalizing out the missing-value process. In particular, we demonstrate the proposed framework for the Gaussian model with arbitrary covariance structures. Comprehensive experimental studies on both synthetic and real-world RNA-seq data show the superior performance of the proposed optimal clustering with missing values when compared to various clustering approaches. Optimal clustering with missing values obviates the need for imputation-based pre-processing of the data, while at the same time possessing smaller clustering errors.

READ FULL TEXT
research
12/20/2021

Model-based Clustering with Missing Not At Random Data

In recent decades, technological advances have made it possible to colle...
research
03/30/2021

Model-based clustering of partial records

Partially recorded data are frequently encountered in many applications ...
research
01/05/2007

Missing values : processing with the Kohonen algorithm

The processing of data which contain missing values is a complicated and...
research
09/06/2017

Clustering of Data with Missing Entries using Non-convex Fusion Penalties

The presence of missing entries in data often creates challenges for pat...
research
08/29/2022

A Missing Value Filling Model Based on Feature Fusion Enhanced Autoencoder

With the advent of the big data era, the data quality problem is becomin...
research
06/19/2020

Bayesian Optimization with Missing Inputs

Bayesian optimization (BO) is an efficient method for optimizing expensi...
research
02/03/2020

Linear predictor on linearly-generated data with missing values: non consistency and solutions

We consider building predictors when the data have missing values. We st...

Please sign up or login with your details

Forgot password? Click here to reset