3D-Aided Data Augmentation for Robust Face Understanding

by   Yifan Xing, et al.

Data augmentation has been highly effective in narrowing the data gap and reducing the cost for human annotation, especially for tasks where ground truth labels are difficult and expensive to acquire. In face recognition, large pose and illumination variation of face images has been a key factor for performance degradation. However, human annotation for the various face understanding tasks including face landmark localization, face attributes classification and face recognition under these challenging scenarios are highly costly to acquire. Therefore, it would be desirable to perform data augmentation for these cases. But simple 2D data augmentation techniques on the image domain are not able to satisfy the requirement of these challenging cases. As such, 3D face modeling, in particular, single image 3D face modeling, stands a feasible solution for these challenging conditions beyond 2D based data augmentation. To this end, we propose a method that produces realistic 3D augmented images from multiple viewpoints with different illumination conditions through 3D face modeling, each associated with geometrically accurate face landmarks, attributes and identity information. Experiments demonstrate that the proposed 3D data augmentation method significantly improves the performance and robustness of various face understanding tasks while achieving state-of-arts on multiple benchmarks.


page 1

page 3

page 5

page 10

page 11

page 12


DotFAN: A Domain-transferred Face Augmentation Network for Pose and Illumination Invariant Face Recognition

The performance of a convolutional neural network (CNN) based face recog...

SASMU: boost the performance of generalized recognition model using synthetic face dataset

Nowadays, deploying a robust face recognition product becomes easy with ...

Analyzing the Impact of Shape Context on the Face Recognition Performance of Deep Networks

In this article, we analyze how changing the underlying 3D shape of the ...

Learning to mask: Towards generalized face forgery detection

Generalizability to unseen forgery types is crucial for face forgery det...

RADA: Robust Adversarial Data Augmentation for Camera Localization in Challenging Weather

Camera localization is a fundamental and crucial problem for many roboti...

Controllable Data Augmentation Through Deep Relighting

At the heart of the success of deep learning is the quality of the data....

SSDL: Self-Supervised Domain Learning for Improved Face Recognition

Face recognition in unconstrained environments is challenging due to var...

Please sign up or login with your details

Forgot password? Click here to reset