Robust and Precise Facial Landmark Detection by Self-Calibrated Pose Attention Network

by   Jun Wan, et al.

Current fully-supervised facial landmark detection methods have progressed rapidly and achieved remarkable performance. However, they still suffer when coping with faces under large poses and heavy occlusions for inaccurate facial shape constraints and insufficient labeled training samples. In this paper, we propose a semi-supervised framework, i.e., a Self-Calibrated Pose Attention Network (SCPAN) to achieve more robust and precise facial landmark detection in challenging scenarios. To be specific, a Boundary-Aware Landmark Intensity (BALI) field is proposed to model more effective facial shape constraints by fusing boundary and landmark intensity field information. Moreover, a Self-Calibrated Pose Attention (SCPA) model is designed to provide a self-learned objective function that enforces intermediate supervision without label information by introducing a self-calibrated mechanism and a pose attention mask. We show that by integrating the BALI fields and SCPA model into a novel self-calibrated pose attention network, more facial prior knowledge can be learned and the detection accuracy and robustness of our method for faces with large poses and heavy occlusions have been improved. The experimental results obtained for challenging benchmark datasets demonstrate that our approach outperforms state-of-the-art methods in the literature.


page 1

page 3

page 4

page 10

page 11


Think about boundary: Fusing multi-level boundary information for landmark heatmap regression

Although current face alignment algorithms have obtained pretty good per...

Precise Facial Landmark Detection by Reference Heatmap Transformer

Most facial landmark detection methods predict landmarks by mapping the ...

Robust Facial Landmark Detection by Multi-order Multi-constraint Deep Networks

Recently, heatmap regression has been widely explored in facial landmark...

Robust Face Alignment by Multi-order High-precision Hourglass Network

Heatmap regression (HR) has become one of the mainstream approaches for ...

Real-time landmark detection for precise endoscopic submucosal dissection via shape-aware relation network

We propose a novel shape-aware relation network for accurate and real-ti...

Limitations and Biases in Facial Landmark Detection -- An Empirical Study on Older Adults with Dementia

Accurate facial expression analysis is an essential step in various clin...

Landmark Guidance Independent Spatio-channel Attention and Complementary Context Information based Facial Expression Recognition

A recent trend to recognize facial expressions in the real-world scenari...

Please sign up or login with your details

Forgot password? Click here to reset