research
∙
08/23/2023
CHORUS: Learning Canonicalized 3D Human-Object Spatial Relations from Unbounded Synthesized Images
We present a method for teaching machines to understand and model the un...
share
research
∙
05/23/2023
NCHO: Unsupervised Learning for Neural 3D Composition of Humans and Objects
Deep generative models have been recently extended to synthesizing 3D di...
research
∙
05/19/2023
Chupa: Carving 3D Clothed Humans from Skinned Shape Priors using 2D Diffusion Probabilistic Models
We propose a 3D generation pipeline that uses diffusion models to genera...
research
∙
01/09/2023
Locomotion-Action-Manipulation: Synthesizing Human-Scene Interactions in Complex 3D Environments
Synthesizing interaction-involved human motions has been challenging due...
research
∙
04/18/2022
Learning to Listen: Modeling Non-Deterministic Dyadic Facial Motion
We present a framework for modeling interactional communication in dyadi...
research
∙
12/23/2021
BANMo: Building Animatable 3D Neural Models from Many Casual Videos
Prior work for articulated 3D shape reconstruction often relies on speci...
research
∙
12/02/2021
Modeling human intention inference in continuous 3D domains by inverse planning and body kinematics
How to build AI that understands human intentions, and uses this knowled...
research
∙
08/19/2021
D3D-HOI: Dynamic 3D Human-Object Interactions from Videos
We introduce D3D-HOI: a dataset of monocular videos with ground truth an...
research
∙
08/13/2021
FrankMocap: A Monocular 3D Whole-Body Pose Estimation System via Regression and Integration
Most existing monocular 3D pose estimation approaches only focus on a si...
research
∙
11/02/2020
3D Multi-bodies: Fitting Sets of Plausible 3D Human Models to Ambiguous Image Data
We consider the problem of obtaining dense 3D reconstructions of humans ...
research
∙
08/19/2020
FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and Integration
Although the essential nuance of human motion is often conveyed as a com...
research
∙
07/30/2020
Perceiving 3D Human-Object Spatial Arrangements from a Single Image in the Wild
We present a method that infers spatial arrangements and shapes of human...
research
∙
07/23/2020
Body2Hands: Learning to Infer 3D Hands from Conversational Gesture Body Dynamics
We propose a novel learned deep prior of body motion for 3D hand shape s...
research
∙
04/07/2020
Exemplar Fine-Tuning for 3D Human Pose Fitting Towards In-the-Wild 3D Human Pose Estimation
We propose a method for building large collections of human poses with f...
research
∙
04/01/2020
PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitization
Recent advances in image-based 3D human shape estimation have been drive...
research
∙
09/30/2019
Single-Network Whole-Body Pose Estimation
We present the first single-network approach for 2D whole-body pose esti...
research
∙
06/10/2019
Towards Social Artificial Intelligence: Nonverbal Social Signal Prediction in A Triadic Interaction
We present a new research task and a dataset to understand human social ...
research
∙
04/22/2019
You2Me: Inferring Body Pose in Egocentric Video via First and Second Person Interactions
The body pose of a person wearing a camera is of great interest for appl...
research
∙
12/05/2018
Capture Dense: Markerless Motion Capture Meets Dense Pose Estimation
We present a method to combine markerless motion capture and dense pose ...
research
∙
12/04/2018
Monocular Total Capture: Posing Face, Body, and Hands in the Wild
We present the first method to capture the 3D total motion of a target p...
research
∙
04/18/2018
Structure from Recurrent Motion: From Rigidity to Recurrency
This paper proposes a new method for Non-Rigid Structure-from-Motion (NR...
research
∙
01/05/2018
Total Capture: A 3D Deformation Model for Tracking Faces, Hands, and Bodies
We present a unified deformation model for the markerless capture of mul...
research
∙
12/09/2016