FaceTopoNet: Facial Expression Recognition using Face Topology Learning

by   Mojtaba Kolahdouzi, et al.

Prior work has shown that the order in which different components of the face are learned using a sequential learner can play an important role in the performance of facial expression recognition systems. We propose FaceTopoNet, an end-to-end deep model for facial expression recognition, which is capable of learning an effective tree topology of the face. Our model then traverses the learned tree to generate a sequence, which is then used to form an embedding to feed a sequential learner. The devised model adopts one stream for learning structure and one stream for learning texture. The structure stream focuses on the positions of the facial landmarks, while the main focus of the texture stream is on the patches around the landmarks to learn textural information. We then fuse the outputs of the two streams by utilizing an effective attention-based fusion strategy. We perform extensive experiments on four large-scale in-the-wild facial expression datasets - namely AffectNet, FER2013, ExpW, and RAF-DB - and one lab-controlled dataset (CK+) to evaluate our approach. FaceTopoNet achieves state-of-the-art performance on three of the five datasets and obtains competitive results on the other two datasets. We also perform rigorous ablation and sensitivity experiments to evaluate the impact of different components and parameters in our model. Lastly, we perform robustness experiments and demonstrate that FaceTopoNet is more robust against occlusions in comparison to other leading methods in the area.


page 1

page 5

page 6

page 9

page 10

page 11

page 12


Face Trees for Expression Recognition

We propose an end-to-end architecture for facial expression recognition....

Facial Expression Recognition in the Wild using Rich Deep Features

Facial Expression Recognition is an active area of research in computer ...

Deep-Emotion: Facial Expression Recognition Using Attentional Convolutional Network

Facial expression recognition has been an active research area over the ...

Robust Facial Expression Recognition with Convolutional Visual Transformers

Facial Expression Recognition (FER) in the wild is extremely challenging...

A Systematic Evaluation of Domain Adaptation in Facial Expression Recognition

Facial Expression Recognition is a commercially important application, b...

AFNet-M: Adaptive Fusion Network with Masks for 2D+3D Facial Expression Recognition

2D+3D facial expression recognition (FER) can effectively cope with illu...

Tree-gated Deep Regressor Ensemble For Face Alignment In The Wild

Face alignment consists in aligning a shape model on a face in an image....

Please sign up or login with your details

Forgot password? Click here to reset