MOMBAT: Heart Rate Monitoring from Face Video using Pulse Modeling and Bayesian Tracking

by   Puneet Gupta, et al.

A non-invasive yet inexpensive method for heart rate (HR) monitoring is of great importance in many real-world applications including healthcare, psychology understanding, affective computing and biometrics. Face videos are currently utilized for such HR monitoring, but unfortunately this can lead to errors due to the noise introduced by facial expressions, out-of-plane movements, camera parameters (like focus change) and environmental factors. We alleviate these issues by proposing a novel face video based HR monitoring method MOMBAT, that is, MOnitoring using Modeling and BAyesian Tracking. We utilize out-of-plane face movements to define a novel quality estimation mechanism. Subsequently, we introduce a Fourier basis based modeling to reconstruct the cardiovascular pulse signal at the locations containing the poor quality, that is, the locations affected by out-of-plane face movements. Furthermore, we design a Bayesian decision theory based HR tracking mechanism to rectify the spurious HR estimates. Experimental results reveal that our proposed method, MOMBAT outperforms state-of-the-art HR monitoring methods and performs HR monitoring with an average absolute error of 1.329 beats per minute and the Pearson correlation between estimated and actual heart rate is 0.9746. Moreover, it demonstrates that HR monitoring is significantly


page 1

page 2

page 3

page 4


Real Time Video based Heart and Respiration Rate Monitoring

In recent years, research about monitoring vital signs by smartphones gr...

Full-Body Cardiovascular Sensing with Remote Photoplethysmography

Remote photoplethysmography (rPPG) allows for noncontact monitoring of b...

Quality-based Pulse Estimation from NIR Face Video with Application to Driver Monitoring

In this paper we develop a robust for heart rate (HR) estimation method ...

Machine learning models and facial regions videos for estimating heart rate: a review on Patents, Datasets and Literature

Estimating heart rate is important for monitoring users in various situa...

A Supervised Learning Approach for Robust Health Monitoring using Face Videos

Monitoring of cardiovascular activity is highly desired and can enable n...

LFPS-Net: a lightweight fast pulse simulation network for BVP estimation

Heart rate estimation based on remote photoplethysmography plays an impo...

Robust and Energy-efficient PPG-based Heart-Rate Monitoring

A wrist-worn PPG sensor coupled with a lightweight algorithm can run on ...

Please sign up or login with your details

Forgot password? Click here to reset