On-line Human Gait Stability Prediction using LSTMs for the fusion of Deep-based Pose Estimation and LRF-based Augmented Gait State Estimation in an Intelligent Robotic Rollato

by   Georgia Chalvatzaki, et al.

In this work we present a novel Long Short Term Memory (LSTM) based on-line human gait stability prediction framework for the elderly users of an intelligent robotic rollator, using only non-wearable sensors, fusing multimodal RGB-D and Laser Range Finder (LRF) data. A deep learning (DL) based approach is used for the upper body pose estimation. The detected pose is used for estimating the Center of Mass (CoM) of the body using Unscented Kalman Filter (UKF). An Augmented Gait State Estimation framework exploits the LRF data to estimate the legs' positions and the respective gait phase. These estimates are the inputs of an encoder-decoder sequence to sequence model which predicts the gait stability state as Safe or Fall Risk walking. It is validated with data from real patients, by exploring different network architectures, hyperparameter settings and by comparing the proposed method with other baselines. The presented LSTM-based human gait stability predictor is shown to provide robust predictions of the human stability state, and thus has the potential to be integrated into a general user-adaptive control architecture as a fall-risk alarm.


page 1

page 3


A Piecewise Monotonic Gait Phase Estimation Model for Controlling a Powered Transfemoral Prosthesis in Various Locomotion Modes

Gait phase-based control is a trending research topic for walking-aid ro...

Skeleton-based Gait Index Estimation with LSTMs

In this paper, we propose a method that estimates a gait index for a seq...

Incorporating Transformer and LSTM to Kalman Filter with EM algorithm for state estimation

Kalman Filter requires the true parameters of the model and solves optim...

Bidirectional GaitNet: A Bidirectional Prediction Model of Human Gait and Anatomical Conditions

We present a novel generative model, called Bidirectional GaitNet, that ...

Human Health Indicator Prediction from Gait Video

Body Mass Index (BMI), age, height and weight are important indicators o...

Learning a Control Policy for Fall Prevention on an Assistive Walking Device

Fall prevention is one of the most important components in senior care. ...

Ball-and-socket joint pose estimation using magnetic field

Roboy 3.0 is an open-source tendon-driven humanoid robot that mimics the...

Please sign up or login with your details

Forgot password? Click here to reset