Generative Modeling with Flow-Guided Density Ratio Learning

by   Alvin Heng, et al.

We present Flow-Guided Density Ratio Learning (FDRL), a simple and scalable approach to generative modeling which builds on the stale (time-independent) approximation of the gradient flow of entropy-regularized f-divergences introduced in DGflow. In DGflow, the intractable time-dependent density ratio is approximated by a stale estimator given by a GAN discriminator. This is sufficient in the case of sample refinement, where the source and target distributions of the flow are close to each other. However, this assumption is invalid for generation and a naive application of the stale estimator fails due to the large chasm between the two distributions. FDRL proposes to train a density ratio estimator such that it learns from progressively improving samples during the training process. We show that this simple method alleviates the density chasm problem, allowing FDRL to generate images of dimensions as high as 128×128, as well as outperform existing gradient flow baselines on quantitative benchmarks. We also show the flexibility of FDRL with two use cases. First, unconditional FDRL can be easily composed with external classifiers to perform class-conditional generation. Second, FDRL can be directly applied to unpaired image-to-image translation with no modifications needed to the framework. Code is publicly available at


page 6

page 12

page 14

page 15

page 16

page 17

page 18

page 19


Composable Unpaired Image to Image Translation

There has been remarkable recent work in unpaired image-to-image transla...

AttentionGAN: Unpaired Image-to-Image Translation using Attention-Guided Generative Adversarial Networks

State-of-the-art methods in the unpaired image-to-image translation are ...

Fine-Tuning StyleGAN2 For Cartoon Face Generation

Recent studies have shown remarkable success in the unsupervised image t...

Reusing Discriminators for Encoding Towards Unsupervised Image-to-Image Translation

Unsupervised image-to-image translation is a central task in computer vi...

Squeeze flow of micro-droplets: convolutional neural network with trainable and tunable refinement

We propose a platform based on neural networks to solve the image-to-ima...

Efficient Multimodal Sampling via Tempered Distribution Flow

Sampling from high-dimensional distributions is a fundamental problem in...

The Power of Log-Sum-Exp: Sequential Density Ratio Matrix Estimation for Speed-Accuracy Optimization

We propose a model for multiclass classification of time series to make ...

Please sign up or login with your details

Forgot password? Click here to reset