Generative Adversarial Networks with Decoder-Encoder Output Noise

by   Guoqiang Zhong, et al.

In recent years, research on image generation methods has been developing fast. The auto-encoding variational Bayes method (VAEs) was proposed in 2013, which uses variational inference to learn a latent space from the image database and then generates images using the decoder. The generative adversarial networks (GANs) came out as a promising framework, which uses adversarial training to improve the generative ability of the generator. However, the generated pictures by GANs are generally blurry. The deep convolutional generative adversarial networks (DCGANs) were then proposed to leverage the quality of generated images. Since the input noise vectors are randomly sampled from a Gaussian distribution, the generator has to map from a whole normal distribution to the images. This makes DCGANs unable to reflect the inherent structure of the training data. In this paper, we propose a novel deep model, called generative adversarial networks with decoder-encoder output noise (DE-GANs), which takes advantage of both the adversarial training and the variational Bayesain inference to improve the performance of image generation. DE-GANs use a pre-trained decoder-encoder architecture to map the random Gaussian noise vectors to informative ones and pass them to the generator of the adversarial networks. Since the decoder-encoder architecture is trained by the same images as the generators, the output vectors could carry the intrinsic distribution information of the original images. Moreover, the loss function of DE-GANs is different from GANs and DCGANs. A hidden-space loss function is added to the adversarial loss function to enhance the robustness of the model. Extensive empirical results show that DE-GANs can accelerate the convergence of the adversarial training process and improve the quality of the generated images.


page 4

page 7

page 9

page 10


Noise Robust Generative Adversarial Networks

Generative adversarial networks (GANs) are neural networks that learn da...

An Acceleration Framework for High Resolution Image Synthesis

Synthesis of high resolution images using Generative Adversarial Network...

MAGAN: Margin Adaptation for Generative Adversarial Networks

We propose the Margin Adaptation for Generative Adversarial Networks (MA...

Sparse Generative Adversarial Network

We propose a new approach to Generative Adversarial Networks (GANs) to a...

SimVAE: Simulator-Assisted Training forInterpretable Generative Models

This paper presents a simulator-assisted training method (SimVAE) for va...

Improved Image Generation via Sparse Modeling

The interest of the deep learning community in image synthesis has grown...

Ambient Hidden Space of Generative Adversarial Networks

Generative adversarial models are powerful tools to model structure in c...

Please sign up or login with your details

Forgot password? Click here to reset