Beyond Disentangled Representations: An Attentive Angular Distillation Approach to Large-scale Lightweight Age-Invariant Face Recognition

by   Thanh-Dat Truong, et al.

Disentangled representations have been commonly adopted to Age-invariant Face Recognition (AiFR) tasks. However, these methods have reached some limitations with (1) the requirement of large-scale face recognition (FR) training data with age labels, which is limited in practice; (2) heavy deep network architecture for high performance; and (3) their evaluations are usually taken place on age-related face databases while neglecting the standard large-scale FR databases to guarantee its robustness. This work presents a novel Attentive Angular Distillation (AAD) approach to Large-scale Lightweight AiFR that overcomes these limitations. Given two high-performance heavy networks as teachers with different specialized knowledge, AAD introduces a learning paradigm to efficiently distill the age-invariant attentive and angular knowledge from those teachers to a lightweight student network making it more powerful with higher FR accuracy and robust against age factor. Consequently, AAD approach is able to take the advantages of both FR datasets with and without age labels to train an AiFR model. Far apart from prior distillation methods mainly focusing on accuracy and compression ratios in closed-set problems, our AAD aims to solve the open-set problem, i.e. large-scale face recognition. Evaluations on LFW, IJB-B and IJB-C Janus, AgeDB and MegaFace-FGNet with one million distractors have demonstrated the efficiency of the proposed approach. This work also presents a new longitudinal face aging (LogiFace) database for further studies in age-related facial problems in future.


page 1

page 3

page 4

page 6

page 7


ShrinkTeaNet: Million-scale Lightweight Face Recognition via Shrinking Teacher-Student Networks

Large-scale face recognition in-the-wild has been recently achieved matu...

Look Across Elapse: Disentangled Representation Learning and Photorealistic Cross-Age Face Synthesis for Age-Invariant Face Recognition

Despite the remarkable progress in face recognition related technologies...

Analyzing the effectiveness of image augmentations for face recognition from limited data

This work presents an analysis of the efficiency of image augmentations ...

VarGFaceNet: An Efficient Variable Group Convolutional Neural Network for Lightweight Face Recognition

To improve the discriminative and generalization ability of lightweight ...

Face Recognition via Centralized Coordinate Learning

Owe to the rapid development of deep neural network (DNN) techniques and...

The MegaFace Benchmark: 1 Million Faces for Recognition at Scale

Recent face recognition experiments on a major benchmark LFW show stunni...

Preliminary Studies on a Large Face Database

We perform preliminary studies on a large longitudinal face database MOR...

Please sign up or login with your details

Forgot password? Click here to reset