A Supervised Learning Approach for Robust Health Monitoring using Face Videos

by   Mayank Gupta, et al.

Monitoring of cardiovascular activity is highly desired and can enable novel applications in diagnosing potential cardiovascular diseases and maintaining an individual's well-being. Currently, such vital signs are measured using intrusive contact devices such as an electrocardiogram (ECG), chest straps, and pulse oximeters that require the patient or the health provider to manually implement. Non-contact, device-free human sensing methods can eliminate the need for specialized heart and blood pressure monitoring equipment. Non-contact methods can have additional advantages since they are scalable with any environment where video can be captured, can be used for continuous measurements, and can be used on patients with varying levels of dexterity and independence, from people with physical impairments to infants (e.g., baby camera). In this paper, we used a non-contact method that only requires face videos recorded using commercially-available webcams. These videos were exploited to predict the health attributes like pulse rate and variance in pulse rate. The proposed approach used facial recognition to detect the face in each frame of the video using facial landmarks, followed by supervised learning using deep neural networks to train the machine learning model. The videos captured subjects performing different physical activities that result in varying cardiovascular responses. The proposed method did not require training data from every individual and thus the prediction can be obtained for the new individuals for which there is no prior data; critical in approach generalization. The approach was also evaluated on a dataset of people with different ethnicity. The proposed approach had less than a 4.6% error in predicting the pulse rate.


page 3

page 6


Non-contact Atrial Fibrillation Detection from Face Videos by Learning Systolic Peaks

Objective: We propose a non-contact approach for atrial fibrillation (AF...

Generating corneal panoramic images from contact specular microscope images

The contact specular microscope has a wider angle of view than that of t...

Infant Contact-less Non-Nutritive Sucking Pattern Quantification via Facial Gesture Analysis

Non-nutritive sucking (NNS) is defined as the sucking action that occurs...

Real Time Video based Heart and Respiration Rate Monitoring

In recent years, research about monitoring vital signs by smartphones gr...

MOMBAT: Heart Rate Monitoring from Face Video using Pulse Modeling and Bayesian Tracking

A non-invasive yet inexpensive method for heart rate (HR) monitoring is ...

Robust Modelling of Reflectance Pulse Oximetry for SpO_2 Estimation

Continuous monitoring of blood oxygen saturation levels is vital for pat...

Please sign up or login with your details

Forgot password? Click here to reset