HandFoldingNet: A 3D Hand Pose Estimation Network Using Multiscale-Feature Guided Folding of a 2D Hand Skeleton

08/12/2021
by   Wencan Cheng, et al.
0

With increasing applications of 3D hand pose estimation in various human-computer interaction applications, convolution neural networks (CNNs) based estimation models have been actively explored. However, the existing models require complex architectures or redundant computational resources to trade with the acceptable accuracy. To tackle this limitation, this paper proposes HandFoldingNet, an accurate and efficient hand pose estimator that regresses the hand joint locations from the normalized 3D hand point cloud input. The proposed model utilizes a folding-based decoder that folds a given 2D hand skeleton into the corresponding joint coordinates. For higher estimation accuracy, folding is guided by multi-scale features, which include both global and joint-wise local features. Experimental results show that the proposed model outperforms the existing methods on three hand pose benchmark datasets with the lowest model parameter requirement. Code is available at https://github.com/cwc1260/HandFold.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/23/2021

Skeleton-aware multi-scale heatmap regression for 2D hand pose estimation

Existing RGB-based 2D hand pose estimation methods learn the joint locat...
research
12/17/2020

Exploiting Learnable Joint Groups for Hand Pose Estimation

In this paper, we propose to estimate 3D hand pose by recovering the 3D ...
research
06/14/2022

TriHorn-Net: A Model for Accurate Depth-Based 3D Hand Pose Estimation

3D hand pose estimation methods have made significant progress recently....
research
07/17/2020

HDNet: Human Depth Estimation for Multi-Person Camera-Space Localization

Current works on multi-person 3D pose estimation mainly focus on the est...
research
05/27/2021

Pose2Drone: A Skeleton-Pose-based Framework for Human-Drone Interaction

Drones have become a common tool, which is utilized in many tasks such a...
research
08/28/2017

DeepPrior++: Improving Fast and Accurate 3D Hand Pose Estimation

DeepPrior is a simple approach based on Deep Learning that predicts the ...
research
08/27/2023

Reconstructing Interacting Hands with Interaction Prior from Monocular Images

Reconstructing interacting hands from monocular images is indispensable ...

Please sign up or login with your details

Forgot password? Click here to reset