Learning Nonparametric Human Mesh Reconstruction from a Single Image without Ground Truth Meshes

02/28/2020
by   Kevin Lin, et al.
0

Nonparametric approaches have shown promising results on reconstructing 3D human mesh from a single monocular image. Unlike previous approaches that use a parametric human model like skinned multi-person linear model (SMPL), and attempt to regress the model parameters, nonparametric approaches relax the heavy reliance on the parametric space. However, existing nonparametric methods require ground truth meshes as their regression target for each vertex, and obtaining ground truth mesh labels is very expensive. In this paper, we propose a novel approach to learn human mesh reconstruction without any ground truth meshes. This is made possible by introducing two new terms into the loss function of a graph convolutional neural network (Graph CNN). The first term is the Laplacian prior that acts as a regularizer on the reconstructed mesh. The second term is the part segmentation loss that forces the projected region of the reconstructed mesh to match the part segmentation. Experimental results on multiple public datasets show that without using 3D ground truth meshes, the proposed approach outperforms the previous state-of-the-art approaches that require ground truth meshes for training.

READ FULL TEXT

page 1

page 6

page 8

page 9

page 10

research
03/05/2021

An Effective Loss Function for Generating 3D Models from Single 2D Image without Rendering

Differentiable rendering is a very successful technique that applies to ...
research
05/08/2019

Convolutional Mesh Regression for Single-Image Human Shape Reconstruction

This paper addresses the problem of 3D human pose and shape estimation f...
research
09/01/2019

Deep Mesh Reconstruction from Single RGB Images via Topology Modification Networks

Reconstructing the 3D mesh of a general object from a single image is no...
research
12/18/2017

End-to-end Recovery of Human Shape and Pose

We describe Human Mesh Recovery (HMR), an end-to-end framework for recon...
research
03/30/2021

3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loop

Regression-based methods have recently shown promising results in recons...
research
06/21/2022

Domain Adaptive 3D Pose Augmentation for In-the-wild Human Mesh Recovery

The ability to perceive 3D human bodies from a single image has a multit...
research
03/20/2023

Learning to Generate 3D Representations of Building Roofs Using Single-View Aerial Imagery

We present a novel pipeline for learning the conditional distribution of...

Please sign up or login with your details

Forgot password? Click here to reset