SGAN: An Alternative Training of Generative Adversarial Networks

by   Tatjana Chavdarova, et al.

The Generative Adversarial Networks (GANs) have demonstrated impressive performance for data synthesis, and are now used in a wide range of computer vision tasks. In spite of this success, they gained a reputation for being difficult to train, what results in a time-consuming and human-involved development process to use them. We consider an alternative training process, named SGAN, in which several adversarial "local" pairs of networks are trained independently so that a "global" supervising pair of networks can be trained against them. The goal is to train the global pair with the corresponding ensemble opponent for improved performances in terms of mode coverage. This approach aims at increasing the chances that learning will not stop for the global pair, preventing both to be trapped in an unsatisfactory local minimum, or to face oscillations often observed in practice. To guarantee the latter, the global pair never affects the local ones. The rules of SGAN training are thus as follows: the global generator and discriminator are trained using the local discriminators and generators, respectively, whereas the local networks are trained with their fixed local opponent. Experimental results on both toy and real-world problems demonstrate that this approach outperforms standard training in terms of better mitigating mode collapse, stability while converging and that it surprisingly, increases the convergence speed as well.


page 7

page 14

page 15


Host-Pathongen Co-evolution Inspired Algorithm Enables Robust GAN Training

Generative adversarial networks (GANs) are pairs of artificial neural ne...

Stochastic Deconvolutional Neural Network Ensemble Training on Generative Pseudo-Adversarial Networks

The training of Generative Adversarial Networks is a difficult task main...

Latent Dirichlet Allocation in Generative Adversarial Networks

Mode collapse is one of the key challenges in the training of Generative...

Training Generative Adversarial Networks with Weights

The impressive success of Generative Adversarial Networks (GANs) is ofte...

A New Distributed Method for Training Generative Adversarial Networks

Generative adversarial networks (GANs) are emerging machine learning mod...

GANs-NQM: A Generative Adversarial Networks based No Reference Quality Assessment Metric for RGB-D Synthesized Views

In this paper, we proposed a no-reference (NR) quality metric for RGB pl...

Towards Real World HDRTV Reconstruction: A Data Synthesis-based Approach

Existing deep learning based HDRTV reconstruction methods assume one kin...

Please sign up or login with your details

Forgot password? Click here to reset