Fine-grained Semantic Constraint in Image Synthesis

01/12/2021
by   Pengyang Li, et al.
7

In this paper, we propose a multi-stage and high-resolution model for image synthesis that uses fine-grained attributes and masks as input. With a fine-grained attribute, the proposed model can detailedly constrain the features of the generated image through rich and fine-grained semantic information in the attribute. With mask as prior, the model in this paper is constrained so that the generated images conform to visual senses, which will reduce the unexpected diversity of samples generated from the generative adversarial network. This paper also proposes a scheme to improve the discriminator of the generative adversarial network by simultaneously discriminating the total image and sub-regions of the image. In addition, we propose a method for optimizing the labeled attribute in datasets, which reduces the manual labeling noise. Extensive quantitative results show that our image synthesis model generates more realistic images.

READ FULL TEXT

page 2

page 3

page 4

page 5

page 6

research
09/24/2021

Fine-Grained Image Generation from Bangla Text Description using Attentional Generative Adversarial Network

Generating fine-grained, realistic images from text has many application...
research
09/19/2023

Latent Space Energy-based Model for Fine-grained Open Set Recognition

Fine-grained open-set recognition (FineOSR) aims to recognize images bel...
research
01/08/2019

Thinking Outside the Pool: Active Training Image Creation for Relative Attributes

Current wisdom suggests more labeled image data is always better, and ob...
research
10/02/2020

MGD-GAN: Text-to-Pedestrian generation through Multi-Grained Discrimination

In this paper, we investigate the problem of text-to-pedestrian synthesi...
research
01/13/2019

RNN-based Generative Model for Fine-Grained Sketching

Deep generative models have shown great promise when it comes to synthes...
research
06/12/2021

A One-Shot Texture-Perceiving Generative Adversarial Network for Unsupervised Surface Inspection

Visual surface inspection is a challenging task owing to the highly dive...
research
04/01/2020

Synthesis and Edition of Ultrasound Images via Sketch Guided Progressive Growing GANs

Ultrasound (US) is widely accepted in clinic for anatomical structure in...

Please sign up or login with your details

Forgot password? Click here to reset