Topology Distance: A Topology-Based Approach For Evaluating Generative Adversarial Networks

by   Danijela Horak, et al.

Automatic evaluation of the goodness of Generative Adversarial Networks (GANs) has been a challenge for the field of machine learning. In this work, we propose a distance complementary to existing measures: Topology Distance (TD), the main idea behind which is to compare the geometric and topological features of the latent manifold of real data with those of generated data. More specifically, we build Vietoris-Rips complex on image features, and define TD based on the differences in persistent-homology groups of the two manifolds. We compare TD with the most commonly used and relevant measures in the field, including Inception Score (IS), Frechet Inception Distance (FID), Kernel Inception Distance (KID) and Geometry Score (GS), in a range of experiments on various datasets. We demonstrate the unique advantage and superiority of our proposed approach over the aforementioned metrics. A combination of our empirical results and the theoretical argument we propose in favour of TD, strongly supports the claim that TD is a powerful candidate metric that researchers can employ when aiming to automatically evaluate the goodness of GANs' learning.


Measures to Evaluate Generative Adversarial Networks Based on Direct Analysis of Generated Images

The Generative Adversarial Network (GAN) is a state-of-the-art technique...

Effect of Input Noise Dimension in GANs

Generative Adversarial Networks (GANs) are by far the most successful ge...

TREND: Truncated Generalized Normal Density Estimation of Inception Embeddings for Accurate GAN Evaluation

Evaluating image generation models such as generative adversarial networ...

On the Evaluation of Generative Adversarial Networks By Discriminative Models

Generative Adversarial Networks (GANs) can accurately model complex mult...

Is Generator Conditioning Causally Related to GAN Performance?

Recent work (Pennington et al, 2017) suggests that controlling the entir...

Using Generative Models for Pediatric wbMRI

Early detection of cancer is key to a good prognosis and requires freque...

GANTL: Towards Practical and Real-Time Topology Optimization with Conditional GANs and Transfer Learning

Many machine learning methods have been recently developed to circumvent...

Please sign up or login with your details

Forgot password? Click here to reset