SketchyGAN: Towards Diverse and Realistic Sketch to Image Synthesis

01/09/2018
by   Wengling Chen, et al.
0

Synthesizing realistic images from human drawn sketches is a challenging problem in computer graphics and vision. Existing approaches either need exact edge maps, or require a database to retrieve images from. In this work, we propose a novel Generative Adversarial Network (GAN) approach that synthesizes realistic looking images from 50 categories including motorcycles, horses and couches. We demonstrate a data augmentation technique for sketches which is fully automatic, and we show that the augmented data is helpful to our task. We introduce a new building block suit for both the generator and discriminator which improves the information flow and utilizes input images at multiple scales. Compared to state-of-the-art image translation methods, our approach generates more realistic images and achieves significantly higher Inception Scores.

READ FULL TEXT

page 12

page 13

page 14

page 15

page 16

page 17

page 18

page 19

research
07/06/2022

Text to Image Synthesis using Stacked Conditional Variational Autoencoders and Conditional Generative Adversarial Networks

Synthesizing a realistic image from textual description is a major chall...
research
04/06/2022

Simple and Effective Synthesis of Indoor 3D Scenes

We study the problem of synthesizing immersive 3D indoor scenes from one...
research
07/02/2019

Generative Guiding Block: Synthesizing Realistic Looking Variants Capable of Even Large Change Demands

Realistic image synthesis is to generate an image that is perceptually i...
research
03/14/2019

MSG-GAN: Multi-Scale Gradients GAN for more stable and synchronized multi-scale image synthesis

Generative Adversarial Network (GAN) which is widely used for Image synt...
research
07/31/2020

Blending Generative Adversarial Image Synthesis with Rendering for Computer Graphics

Conventional computer graphics pipelines require detailed 3D models, mes...
research
07/24/2020

Machine-learned Regularization and Polygonization of Building Segmentation Masks

We propose a machine learning based approach for automatic regularizatio...
research
02/23/2022

Synthesizing Photorealistic Images with Deep Generative Learning

The goal of this thesis is to present my research contributions towards ...

Please sign up or login with your details

Forgot password? Click here to reset