DeepAI AI Chat
Log In Sign Up

Guiding GANs: How to control non-conditional pre-trained GANs for conditional image generation

by   Manel Mateos, et al.

Generative Adversarial Networks (GANs) are an arrange of two neural networks – the generator and the discriminator – that are jointly trained to generate artificial data, such as images, from random inputs. The quality of these generated images has recently reached such levels that can often lead both machines and humans into mistaking fake for real examples. However, the process performed by the generator of the GAN has some limitations when we want to condition the network to generate images from subcategories of a specific class. Some recent approaches tackle this conditional generation by introducing extra information prior to the training process, such as image semantic segmentation or textual descriptions. While successful, these techniques still require defining beforehand the desired subcategories and collecting large labeled image datasets representing them to train the GAN from scratch. In this paper we present a novel and alternative method for guiding generic non-conditional GANs to behave as conditional GANs. Instead of re-training the GAN, our approach adds into the mix an encoder network to generate the high-dimensional random input vectors that are fed to the generator network of a non-conditional GAN to make it generate images from a specific subcategory. In our experiments, when compared to training a conditional GAN from scratch, our guided GAN is able to generate artificial images of perceived quality comparable to that of non-conditional GANs after training the encoder on just a few hundreds of images, which substantially accelerates the process and enables adding new subcategories seamlessly.


page 9

page 11

page 13


Conditional Image Generation with One-Vs-All Classifier

This paper explores conditional image generation with a One-Vs-All class...

Host-Pathongen Co-evolution Inspired Algorithm Enables Robust GAN Training

Generative adversarial networks (GANs) are pairs of artificial neural ne...

Generative Adversarial Network based on Resnet for Conditional Image Restoration

The GANs promote an adversarive game to approximate complex and jointed ...

Self-labeled Conditional GANs

This paper introduces a novel and fully unsupervised framework for condi...

Inducing Optimal Attribute Representations for Conditional GANs

Conditional GANs are widely used in translating an image from one catego...

COCO-GAN: Generation by Parts via Conditional Coordinating

Humans can only interact with part of the surrounding environment due to...

Don't Be So Dense: Sparse-to-Sparse GAN Training Without Sacrificing Performance

Generative adversarial networks (GANs) have received an upsurging intere...