Enjoy Your Editing: Controllable GANs for Image Editing via Latent Space Navigation

02/01/2021
by   Peiye Zhuang, et al.
10

Controllable semantic image editing enables a user to change entire image attributes with few clicks, e.g., gradually making a summer scene look like it was taken in winter. Classic approaches for this task use a Generative Adversarial Net (GAN) to learn a latent space and suitable latent-space transformations. However, current approaches often suffer from attribute edits that are entangled, global image identity changes, and diminished photo-realism. To address these concerns, we learn multiple attribute transformations simultaneously, we integrate attribute regression into the training of transformation functions, apply a content loss and an adversarial loss that encourage the maintenance of image identity and photo-realism. We propose quantitative evaluation strategies for measuring controllable editing performance, unlike prior work which primarily focuses on qualitative evaluation. Our model permits better control for both single- and multiple-attribute editing, while also preserving image identity and realism during transformation. We provide empirical results for both real and synthetic images, highlighting that our model achieves state-of-the-art performance for targeted image manipulation.

READ FULL TEXT

page 2

page 5

page 7

page 8

page 13

page 14

research
06/22/2021

A Latent Transformer for Disentangled and Identity-Preserving Face Editing

High quality facial image editing is a challenging problem in the movie ...
research
03/31/2022

TransEditor: Transformer-Based Dual-Space GAN for Highly Controllable Facial Editing

Recent advances like StyleGAN have promoted the growth of controllable f...
research
11/09/2018

Changing the Image Memorability: From Basic Photo Editing to GANs

Memorability is considered to be an important characteristic of visual c...
research
12/02/2022

LatentSwap3D: Semantic Edits on 3D Image GANs

Recent 3D-aware GANs rely on volumetric rendering techniques to disentan...
research
08/24/2022

3D-FM GAN: Towards 3D-Controllable Face Manipulation

3D-controllable portrait synthesis has significantly advanced, thanks to...
research
03/25/2022

3D GAN Inversion for Controllable Portrait Image Animation

Millions of images of human faces are captured every single day; but the...
research
11/21/2022

Exploring the Effectiveness of Mask-Guided Feature Modulation as a Mechanism for Localized Style Editing of Real Images

The success of Deep Generative Models at high-resolution image generatio...

Please sign up or login with your details

Forgot password? Click here to reset