3D Face Parsing via Surface Parameterization and 2D Semantic Segmentation Network

by   Wenyuan Sun, et al.

Face parsing assigns pixel-wise semantic labels as the face representation for computers, which is the fundamental part of many advanced face technologies. Compared with 2D face parsing, 3D face parsing shows more potential to achieve better performance and further application, but it is still challenging due to 3D mesh data computation. Recent works introduced different methods for 3D surface segmentation, while the performance is still limited. In this paper, we propose a method based on the "3D-2D-3D" strategy to accomplish 3D face parsing. The topological disk-like 2D face image containing spatial and textural information is transformed from the sampled 3D face data through the face parameterization algorithm, and a specific 2D network called CPFNet is proposed to achieve the semantic segmentation of the 2D parameterized face data with multi-scale technologies and feature aggregation. The 2D semantic result is then inversely re-mapped to 3D face data, which finally achieves the 3D face parsing. Experimental results show that both CPFNet and the "3D-2D-3D" strategy accomplish high-quality 3D face parsing and outperform state-of-the-art 2D networks as well as 3D methods in both qualitative and quantitative comparisons.


page 2

page 4

page 5

page 6

page 8

page 10

page 12


Quality-Aware Network for Face Parsing

This is a very short technical report, which introduces the solution of ...

Learning Structure via Consensus for Face Segmentation and Parsing

Face segmentation is the task of densely labeling pixels on the face acc...

Progressive Semantic-Aware Style Transformation for Blind Face Restoration

Face restoration is important in face image processing, and has been wid...

C-DLinkNet: considering multi-level semantic features for human parsing

Human parsing is an essential branch of semantic segmentation, which is ...

Parameter Efficient Local Implicit Image Function Network for Face Segmentation

Face parsing is defined as the per-pixel labeling of images containing h...

Face Parsing via Recurrent Propagation

Face parsing is an important problem in computer vision that finds numer...

End-to-End Face Parsing via Interlinked Convolutional Neural Networks

Face parsing is an important computer vision task that requires accurate...

Please sign up or login with your details

Forgot password? Click here to reset