OREBA: A Dataset for Objectively Recognizing Eating Behaviour and Associated Intake

by   Philipp V. Rouast, et al.

Automatic detection of intake gestures is a key element of automatic dietary monitoring. Several types of sensors, including inertial measurement units (IMU) and video cameras, have been used for this purpose. The common machine learning approaches make use of the labeled sensor data to automatically learn how to make detections. One characteristic, especially for deep learning models, is the need for large datasets. To meet this need, we collected the Objectively Recognizing Eating Behavior and Associated Intake (OREBA) dataset. The OREBA dataset aims to provide a comprehensive multi-sensor recording of communal intake occasions for researchers interested in intake gesture detection. Two scenarios are included, with 100 participants for a discrete dish and 102 participants for a shared dish, totalling 9069 intake gestures. Available sensor data consists of synchronized frontal video and IMU with accelerometer and gyroscope for both hands. We report the details of data collection and annotation, as well as details of sensor processing. The results of studies on IMU and video data involving deep learning models are reported to provide a baseline for future research. Specifically, the best baseline models achieve performances of F_1 = 0.853 for the discrete dish using video and F_1 = 0.852 for the shared dish using inertial data.


page 1

page 2

page 3

page 4

page 5

page 6

page 7


Learning deep representations for video-based intake gesture detection

Automatic detection of individual intake gestures during eating occasion...

Single-stage intake gesture detection using CTC loss and extended prefix beam search

Accurate detection of individual intake gestures is a key step towards a...

WaveGlove: Transformer-based hand gesture recognition using multiple inertial sensors

Hand Gesture Recognition (HGR) based on inertial data has grown consider...

Recognition of Smoking Gesture Using Smart Watch Technology

Diseases resulting from prolonged smoking are the most common preventabl...

TrainSim: A Railway Simulation Framework for LiDAR and Camera Dataset Generation

The railway industry is searching for new ways to automate a number of c...

MedSensor: Medication Adherence Monitoring Using Neural Networks on Smartwatch Accelerometer Sensor Data

Poor medication adherence presents serious economic and health problems ...

Proximity-Based Active Learning on Streaming Data: A Personalized Eating Moment Recognition

Detecting when eating occurs is an essential step toward automatic dieta...

Please sign up or login with your details

Forgot password? Click here to reset