IntersectGAN: Learning Domain Intersection for Generating Images with Multiple Attributes

09/21/2019
by   Zehui Yao, et al.
14

Generative adversarial networks (GANs) have demonstrated great success in generating various visual content. However, images generated by existing GANs are often of attributes (e.g., smiling expression) learned from one image domain. As a result, generating images of multiple attributes requires many real samples possessing multiple attributes which are very resource expensive to be collected. In this paper, we propose a novel GAN, namely IntersectGAN, to learn multiple attributes from different image domains through an intersecting architecture. For example, given two image domains X1 and X2 with certain attributes, the intersection of X1 and X2 is a new domain where images possess the attributes from both X1 and X2 domains. The proposed IntersectGAN consists of two discriminators D1 and D2 to distinguish between generated and real samples of different domains, and three generators where the intersection generator is trained against both discriminators. And an overall adversarial loss function is defined over three generators. As a result, our proposed IntersectGAN can be trained on multiple domains of which each presents one specific attribute, and eventually eliminates the need of real sample images simultaneously possessing multiple attributes. By using the CelebFaces Attributes dataset, our proposed IntersectGAN is able to produce high-quality face images possessing multiple attributes (e.g., a face with black hair and a smiling expression). Both qualitative and quantitative evaluations are conducted to compare our proposed IntersectGAN with other baseline methods. Besides, several different applications of IntersectGAN have been explored with promising results.

READ FULL TEXT

page 2

page 4

page 5

page 7

page 8

research
12/03/2020

Attributes Aware Face Generation with Generative Adversarial Networks

Recent studies have shown remarkable success in face image generations. ...
research
07/03/2018

Resembled Generative Adversarial Networks: Two Domains with Similar Attributes

We propose a novel algorithm, namely Resembled Generative Adversarial Ne...
research
11/15/2019

Human Annotations Improve GAN Performances

Generative Adversarial Networks (GANs) have shown great success in many ...
research
11/19/2018

Bayesian CycleGAN via Marginalizing Latent Sampling

Recent techniques built on Generative Adversarial Networks (GANs) like C...
research
10/10/2019

Visual Understanding of Multiple Attributes Learning Model of X-Ray Scattering Images

This extended abstract presents a visualization system, which is designe...
research
07/20/2020

Detection, Attribution and Localization of GAN Generated Images

Recent advances in Generative Adversarial Networks (GANs) have led to th...
research
07/25/2015

The Digital Synaptic Neural Substrate: A New Approach to Computational Creativity

We introduce a new artificial intelligence (AI) approach called, the 'Di...

Please sign up or login with your details

Forgot password? Click here to reset