Dense Intrinsic Appearance Flow for Human Pose Transfer

by   Yining Li, et al.

We present a novel approach for the task of human pose transfer, which aims at synthesizing a new image of a person from an input image of that person and a target pose. We address the issues of limited correspondences identified between keypoints only and invisible pixels due to self-occlusion. Unlike existing methods, we propose to estimate dense and intrinsic 3D appearance flow to better guide the transfer of pixels between poses. In particular, we wish to generate the 3D flow from just the reference and target poses. Training a network for this purpose is non-trivial, especially when the annotations for 3D appearance flow are scarce by nature. We address this problem through a flow synthesis stage. This is achieved by fitting a 3D model to the given pose pair and project them back to the 2D plane to compute the dense appearance flow for training. The synthesized ground-truths are then used to train a feedforward network for efficient mapping from the input and target skeleton poses to the 3D appearance flow. With the appearance flow, we perform feature warping on the input image and generate a photorealistic image of the target pose. Extensive results on DeepFashion and Market-1501 datasets demonstrate the effectiveness of our approach over existing methods. Our code is available at


page 2

page 6

page 7

page 13

page 14

page 15

page 16

page 17


Towards Multi-pose Guided Virtual Try-on Network

Virtual try-on system under arbitrary human poses has huge application p...

FDA-GAN: Flow-based Dual Attention GAN for Human Pose Transfer

Human pose transfer aims at transferring the appearance of the source pe...

HairFIT: Pose-Invariant Hairstyle Transfer via Flow-based Hair Alignment and Semantic-Region-Aware Inpainting

Hairstyle transfer is the task of modifying a source hairstyle to a targ...

Unsupervised Pose Flow Learning for Pose Guided Synthesis

Pose guided synthesis aims to generate a new image in an arbitrary targe...

Human Pose Transfer with Disentangled Feature Consistency

Deep generative models have made great progress in synthesizing images w...

Unsupervised Person Image Synthesis in Arbitrary Poses

We present a novel approach for synthesizing photo-realistic images of p...

VirtualPose: Learning Generalizable 3D Human Pose Models from Virtual Data

While monocular 3D pose estimation seems to have achieved very accurate ...

Please sign up or login with your details

Forgot password? Click here to reset