Learning Temporal 3D Human Pose Estimation with Pseudo-Labels

10/14/2021
by   Arij Bouazizi, et al.
6

We present a simple, yet effective, approach for self-supervised 3D human pose estimation. Unlike the prior work, we explore the temporal information next to the multi-view self-supervision. During training, we rely on triangulating 2D body pose estimates of a multiple-view camera system. A temporal convolutional neural network is trained with the generated 3D ground-truth and the geometric multi-view consistency loss, imposing geometrical constraints on the predicted 3D body skeleton. During inference, our model receives a sequence of 2D body pose estimates from a single-view to predict the 3D body pose for each of them. An extensive evaluation shows that our method achieves state-of-the-art performance in the Human3.6M and MPI-INF-3DHP benchmarks. Our code and models are publicly available at <https://github.com/vru2020/TM_HPE/>.

READ FULL TEXT

page 1

page 7

research
08/17/2021

Self-Supervised 3D Human Pose Estimation with Multiple-View Geometry

We present a self-supervised learning algorithm for 3D human pose estima...
research
09/09/2023

Probabilistic Triangulation for Uncalibrated Multi-View 3D Human Pose Estimation

3D human pose estimation has been a long-standing challenge in computer ...
research
10/11/2022

ACRNet: Attention Cube Regression Network for Multi-view Real-time 3D Human Pose Estimation in Telemedicine

Human pose estimation (HPE) for 3D skeleton reconstruction in telemedici...
research
11/30/2022

FuRPE: Learning Full-body Reconstruction from Part Experts

Full-body reconstruction is a fundamental but challenging task. Owing to...
research
08/22/2022

PoseBERT: A Generic Transformer Module for Temporal 3D Human Modeling

Training state-of-the-art models for human pose estimation in videos req...
research
12/27/2021

Active Learning with Pseudo-Labels for Multi-View 3D Pose Estimation

Pose estimation of the human body/hand is a fundamental problem in compu...
research
03/21/2023

Human Pose as Compositional Tokens

Human pose is typically represented by a coordinate vector of body joint...

Please sign up or login with your details

Forgot password? Click here to reset