What happens in Face during a facial expression? Using data mining techniques to analyze facial expression motion vectors

09/12/2021
by   Mohamad Roshanzamir, et al.
1

One of the most common problems encountered in human-computer interaction is automatic facial expression recognition. Although it is easy for human observer to recognize facial expressions, automatic recognition remains difficult for machines. One of the methods that machines can recognize facial expression is analyzing the changes in face during facial expression presentation. In this paper, optical flow algorithm was used to extract deformation or motion vectors created in the face because of facial expressions. Then, these extracted motion vectors are used to be analyzed. Their positions and directions were exploited for automatic facial expression recognition using different data mining techniques. It means that by employing motion vector features used as our data, facial expressions were recognized. Some of the most state-of-the-art classification algorithms such as C5.0, CRT, QUEST, CHAID, Deep Learning (DL), SVM and Discriminant algorithms were used to classify the extracted motion vectors. Using 10-fold cross validation, their performances were calculated. To compare their performance more precisely, the test was repeated 50 times. Meanwhile, the deformation of face was also analyzed in this research. For example, what exactly happened in each part of face when a person showed fear? Experimental results on Extended Cohen-Kanade (CK+) facial expression dataset demonstrated that the best methods were DL, SVM and C5.0, with the accuracy of 95.3

READ FULL TEXT

page 1

page 3

page 4

page 7

page 9

research
10/23/2020

The Analysis of Facial Feature Deformation using Optical Flow Algorithm

Facial features deformed according to the intended facial expression. Sp...
research
05/10/2013

Human Mood Detection For Human Computer Interaction

In this paper we propose an easiest approach for facial expression recog...
research
03/05/2015

Video-Based Facial Expression Recognition Using Local Directional Binary Pattern

Automatic facial expression analysis is a challenging issue and influenc...
research
05/23/2016

Spontaneous vs. Posed smiles - can we tell the difference?

Smile is an irrefutable expression that shows the physical state of the ...
research
04/15/2016

Recognition of facial expressions based on salient geometric features and support vector machines

Facial expressions convey nonverbal cues which play an important role in...
research
10/09/2021

Comparing Facial Expression Recognition in Humans and Machines: Using CAM, GradCAM, and Extremal Perturbation

Facial expression recognition (FER) is a topic attracting significant re...
research
04/25/2019

Optical Flow Techniques for Facial Expression Analysis: Performance Evaluation and Improvements

Optical flow techniques are becoming increasingly performant and robust ...

Please sign up or login with your details

Forgot password? Click here to reset