Disentangling Learning Representations with Density Estimation

02/08/2023
by   Eric Yeats, et al.
0

Disentangled learning representations have promising utility in many applications, but they currently suffer from serious reliability issues. We present Gaussian Channel Autoencoder (GCAE), a method which achieves reliable disentanglement via flexible density estimation of the latent space. GCAE avoids the curse of dimensionality of density estimation by disentangling subsets of its latent space with the Dual Total Correlation (DTC) metric, thereby representing its high-dimensional latent joint distribution as a collection of many low-dimensional conditional distributions. In our experiments, GCAE achieves highly competitive and reliable disentanglement scores compared with state-of-the-art baselines.

READ FULL TEXT
research
12/16/2022

Controllable Text Generation via Probability Density Estimation in the Latent Space

Previous work on controllable text generation has explored the idea of c...
research
06/20/2022

Meta-learning for Out-of-Distribution Detection via Density Estimation in Latent Space

Many neural network-based out-of-distribution (OoD) detection methods ha...
research
01/06/2019

Understanding the (un)interpretability of natural image distributions using generative models

Probability density estimation is a classical and well studied problem, ...
research
01/01/2023

Deep Correlation-Aware Kernelized Autoencoders for Anomaly Detection in Cybersecurity

Unsupervised learning-based anomaly detection in latent space has gained...
research
12/04/2019

Sub-linear RACE Sketches for Approximate Kernel Density Estimation on Streaming Data

Kernel density estimation is a simple and effective method that lies at ...
research
02/08/2021

Arbitrary Conditional Distributions with Energy

Modeling distributions of covariates, or density estimation, is a core c...
research
05/08/2023

DEnsity: Open-domain Dialogue Evaluation Metric using Density Estimation

Despite the recent advances in open-domain dialogue systems, building a ...

Please sign up or login with your details

Forgot password? Click here to reset