Diverse Single Image Generation with Controllable Global Structure through Self-Attention

02/09/2021
by   Sutharsan Mahendren, et al.
0

Image generation from a single image using generative adversarial networks is quite interesting due to the realism of generated images. However, recent approaches need improvement for such realistic and diverse image generation, when the global context of the image is important such as in face, animal, and architectural image generation. This is mainly due to the use of fewer convolutional layers for mainly capturing the patch statistics and, thereby, not being able to capture global statistics very well. We solve this problem by using attention blocks at selected scales and feeding a random Gaussian blurred image to the discriminator for training. Our results are visually better than the state-of-the-art particularly in generating images that require global context. The diversity of our image generation, measured using the average standard deviation of pixels, is also better.

READ FULL TEXT

page 3

page 4

research
05/15/2019

Dilated Spatial Generative Adversarial Networks for Ergodic Image Generation

Generative models have recently received renewed attention as a result o...
research
09/15/2023

Increasing diversity of omni-directional images generated from single image using cGAN based on MLPMixer

This paper proposes a novel approach to generating omni-directional imag...
research
03/25/2020

Improved Techniques for Training Single-Image GANs

Recently there has been an interest in the potential of learning generat...
research
11/24/2018

Keep Drawing It: Iterative language-based image generation and editing

Conditional text-to-image generation approaches commonly focus on genera...
research
06/16/2016

Conditional Image Generation with PixelCNN Decoders

This work explores conditional image generation with a new image density...
research
08/23/2023

CoC-GAN: Employing Context Cluster for Unveiling a New Pathway in Image Generation

Image generation tasks are traditionally undertaken using Convolutional ...
research
08/06/2020

GL-GAN: Adaptive Global and Local Bilevel Optimization model of Image Generation

Although Generative Adversarial Networks have shown remarkable performan...

Please sign up or login with your details

Forgot password? Click here to reset