Deep Clustering with Measure Propagation

by   Minhua Chen, et al.

Deep models have improved state-of-the-art for both supervised and unsupervised learning. For example, deep embedded clustering (DEC) has greatly improved the unsupervised clustering performance, by using stacked autoencoders for representation learning. However, one weakness of deep modeling is that the local neighborhood structure in the original space is not necessarily preserved in the latent space. To preserve local geometry, various methods have been proposed in the supervised and semi-supervised learning literature (e.g., spectral clustering and label propagation) using graph Laplacian regularization. In this paper, we combine the strength of deep representation learning with measure propagation (MP), a KL-divergence based graph regularization method originally used in the semi-supervised scenario. The main assumption of MP is that if two data points are close in the original space, they are likely to belong to the same class, measured by KL-divergence of class membership distribution. By taking the same assumption in the unsupervised learning scenario, we propose our Deep Embedded Clustering Aided by Measure Propagation (DECAMP) model. We evaluate DECAMP on short text clustering tasks. On three public datasets, DECAMP performs competitively with other state-of-the-art baselines, including baselines using additional data to generate word embeddings used in the clustering process. As an example, on the Stackoverflow dataset, DECAMP achieved a clustering accuracy of 79 about 5 that DECAMP is a very effective method for unsupervised learning.


page 1

page 2

page 3

page 4


Graph Laplacian for Semi-Supervised Learning

Semi-supervised learning is highly useful in common scenarios where labe...

Privileged Information for Data Clustering

Many machine learning algorithms assume that all input samples are indep...

Local Label Propagation for Large-Scale Semi-Supervised Learning

A significant issue in training deep neural networks to solve supervised...

Semi-Supervised Learning via Compact Latent Space Clustering

We present a novel cost function for semi-supervised learning of neural ...

Semi-Supervised Learning by Disentangling and Self-Ensembling Over Stochastic Latent Space

The success of deep learning in medical imaging is mostly achieved at th...

Deep Variational Clustering Framework for Self-labeling of Large-scale Medical Images

We propose a Deep Variational Clustering (DVC) framework for unsupervise...

Regroupement sémantique de définitions en espagnol

This article focuses on the description and evaluation of a new unsuperv...

Please sign up or login with your details

Forgot password? Click here to reset