HumanGAN: A Generative Model of Humans Images

03/11/2021
by   Kripasindhu Sarkar, et al.
41

Generative adversarial networks achieve great performance in photorealistic image synthesis in various domains, including human images. However, they usually employ latent vectors that encode the sampled outputs globally. This does not allow convenient control of semantically-relevant individual parts of the image, and is not able to draw samples that only differ in partial aspects, such as clothing style. We address these limitations and present a generative model for images of dressed humans offering control over pose, local body part appearance and garment style. This is the first method to solve various aspects of human image generation such as global appearance sampling, pose transfer, parts and garment transfer, and parts sampling jointly in a unified framework. As our model encodes part-based latent appearance vectors in a normalized pose-independent space and warps them to different poses, it preserves body and clothing appearance under varying posture. Experiments show that our flexible and general generative method outperforms task-specific baselines for pose-conditioned image generation, pose transfer and part sampling in terms of realism and output resolution.

READ FULL TEXT

page 5

page 12

page 13

page 14

page 16

page 17

page 18

page 19

research
02/22/2021

Style and Pose Control for Image Synthesis of Humans from a Single Monocular View

Photo-realistic re-rendering of a human from a single image with explici...
research
04/12/2018

A Variational U-Net for Conditional Appearance and Shape Generation

Deep generative models have demonstrated great performance in image synt...
research
01/08/2019

Unpaired Pose Guided Human Image Generation

This paper studies the task of full generative modelling of realistic im...
research
10/10/2022

SCAM! Transferring humans between images with Semantic Cross Attention Modulation

A large body of recent work targets semantically conditioned image gener...
research
05/06/2022

LatentKeypointGAN: Controlling Images via Latent Keypoints – Extended Abstract

Generative adversarial networks (GANs) can now generate photo-realistic ...
research
11/26/2019

MixNMatch: Multifactor Disentanglement and Encoding for Conditional Image Generation

We present MixNMatch, a conditional generative model that learns to dise...
research
06/08/2020

Reposing Humans by Warping 3D Features

We address the problem of reposing an image of a human into any desired ...

Please sign up or login with your details

Forgot password? Click here to reset