AE-StyleGAN: Improved Training of Style-Based Auto-Encoders

10/17/2021
by   Ligong Han, et al.
15

StyleGANs have shown impressive results on data generation and manipulation in recent years, thanks to its disentangled style latent space. A lot of efforts have been made in inverting a pretrained generator, where an encoder is trained ad hoc after the generator is trained in a two-stage fashion. In this paper, we focus on style-based generators asking a scientific question: Does forcing such a generator to reconstruct real data lead to more disentangled latent space and make the inversion process from image to latent space easy? We describe a new methodology to train a style-based autoencoder where the encoder and generator are optimized end-to-end. We show that our proposed model consistently outperforms baselines in terms of image inversion and generation quality. Supplementary, code, and pretrained models are available on the project website.

READ FULL TEXT

page 4

page 5

page 7

page 8

research
02/04/2022

Feature-Style Encoder for Style-Based GAN Inversion

We propose a novel architecture for GAN inversion, which we call Feature...
research
07/03/2020

Collaborative Learning for Faster StyleGAN Embedding

The latent code of the recent popular model StyleGAN has learned disenta...
research
01/12/2023

Domain Expansion of Image Generators

Can one inject new concepts into an already trained generative model, wh...
research
06/13/2023

AniFaceDrawing: Anime Portrait Exploration during Your Sketching

In this paper, we focus on how artificial intelligence (AI) can be used ...
research
08/31/2023

StyleInV: A Temporal Style Modulated Inversion Network for Unconditional Video Generation

Unconditional video generation is a challenging task that involves synth...
research
07/30/2023

StylePrompter: All Styles Need Is Attention

GAN inversion aims at inverting given images into corresponding latent c...
research
11/02/2021

StyleGAN of All Trades: Image Manipulation with Only Pretrained StyleGAN

Recently, StyleGAN has enabled various image manipulation and editing ta...

Please sign up or login with your details

Forgot password? Click here to reset