GeomCA: Geometric Evaluation of Data Representations

05/26/2021
by   Petra Poklukar, et al.
0

Evaluating the quality of learned representations without relying on a downstream task remains one of the challenges in representation learning. In this work, we present Geometric Component Analysis (GeomCA) algorithm that evaluates representation spaces based on their geometric and topological properties. GeomCA can be applied to representations of any dimension, independently of the model that generated them. We demonstrate its applicability by analyzing representations obtained from a variety of scenarios, such as contrastive learning models, generative models and supervised learning models.

READ FULL TEXT

page 1

page 9

research
02/14/2022

Delaunay Component Analysis for Evaluation of Data Representations

Advanced representation learning techniques require reliable and general...
research
03/07/2017

On the Limits of Learning Representations with Label-Based Supervision

Advances in neural network based classifiers have transformed automatic ...
research
07/07/2023

VariGrad: A Novel Feature Vector Architecture for Geometric Deep Learning on Unregistered Data

We present a novel geometric deep learning layer that leverages the vari...
research
02/15/2023

Topological Neural Discrete Representation Learning à la Kohonen

Unsupervised learning of discrete representations from continuous ones i...
research
09/18/2022

The Geometry of Self-supervised Learning Models and its Impact on Transfer Learning

Self-supervised learning (SSL) has emerged as a desirable paradigm in co...
research
01/04/2023

Learning Decorrelated Representations Efficiently Using Fast Fourier Transform

Barlow Twins and VICReg are self-supervised representation learning mode...
research
09/18/2021

Interest-oriented Universal User Representation via Contrastive Learning

User representation is essential for providing high-quality commercial s...

Please sign up or login with your details

Forgot password? Click here to reset