research
∙
02/09/2023
RelightableHands: Efficient Neural Relighting of Articulated Hand Models
We present the first neural relighting approach for rendering high-fidel...
share
research
∙
07/22/2022
Multiface: A Dataset for Neural Face Rendering
Photorealistic avatars of human faces have come a long way in recent yea...
research
∙
07/20/2022
Drivable Volumetric Avatars using Texel-Aligned Features
Photorealistic telepresence requires both high-fidelity body modeling an...
research
∙
06/30/2022
Dressing Avatars: Deep Photorealistic Appearance for Physically Simulated Clothing
Despite recent progress in developing animatable full-body avatars, real...
research
∙
06/07/2022
Garment Avatars: Realistic Cloth Driving using Pattern Registration
Virtual telepresence is the future of online communication. Clothing is ...
research
∙
05/21/2021
Driving-Signal Aware Full-Body Avatars
We present a learning-based method for building driving-signal aware ful...
research
∙
04/16/2021
MeshTalk: 3D Face Animation from Speech using Cross-Modality Disentanglement
This paper presents a generic method for generating full facial 3D anima...
research
∙
04/09/2021
Pixel Codec Avatars
Telecommunication with photorealistic avatars in virtual or augmented re...
research
∙
03/29/2021
High-fidelity Face Tracking for AR/VR via Deep Lighting Adaptation
3D video avatars can empower virtual communications by providing compres...
research
∙
03/02/2021
Mixture of Volumetric Primitives for Efficient Neural Rendering
Real-time rendering and animation of humans is a core function in games,...
research
∙
01/25/2021
Supervision by Registration and Triangulation for Landmark Detection
We present Supervision by Registration and Triangulation (SRT), an unsup...
research
∙
08/11/2020
Audio- and Gaze-driven Facial Animation of Codec Avatars
Codec Avatars are a recent class of learned, photorealistic face models ...
research
∙
07/24/2020
Spatiotemporal Bundle Adjustment for Dynamic 3D Human Reconstruction in the Wild
Bundle adjustment jointly optimizes camera intrinsics and extrinsics and...
research
∙
06/08/2020
Fully Convolutional Mesh Autoencoder using Efficient Spatially Varying Kernels
Learning latent representations of registered meshes is useful for many ...
research
∙
05/27/2020
4D Visualization of Dynamic Events from Unconstrained Multi-View Videos
We present a data-driven approach for 4D space-time visualization of dyn...
research
∙
10/05/2019
To React or not to React: End-to-End Visual Pose Forecasting for Personalized Avatar during Dyadic Conversations
Non verbal behaviours such as gestures, facial expressions, body posture...
research
∙
09/30/2019
Single-Network Whole-Body Pose Estimation
We present the first single-network approach for 2D whole-body pose esti...
research
∙
06/18/2019
Neural Volumes: Learning Dynamic Renderable Volumes from Images
Modeling and rendering of dynamic scenes is challenging, as natural scen...
research
∙
06/11/2019
Shapes and Context: In-the-Wild Image Synthesis & Manipulation
We introduce a data-driven approach for interactively synthesizing in-th...
research
∙
06/10/2019
Towards Social Artificial Intelligence: Nonverbal Social Signal Prediction in A Triadic Interaction
We present a new research task and a dataset to understand human social ...
research
∙
04/22/2019
LBS Autoencoder: Self-supervised Fitting of Articulated Meshes to Point Clouds
We present LBS-AE; a self-supervised autoencoding algorithm for fitting ...
research
∙
12/18/2018
OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields
Realtime multi-person 2D pose estimation is a key component in enabling ...
research
∙
12/05/2018
Capture Dense: Markerless Motion Capture Meets Dense Pose Estimation
We present a method to combine markerless motion capture and dense pose ...
research
∙
12/04/2018
Monocular Total Capture: Posing Face, Body, and Hands in the Wild
We present the first method to capture the 3D total motion of a target p...
research
∙
11/29/2018
Efficient Online Multi-Person 2D Pose Tracking with Recurrent Spatio-Temporal Affinity Fields
We present an online approach to efficiently and simultaneously detect a...
research
∙
08/15/2018
Recycle-GAN: Unsupervised Video Retargeting
We introduce a data-driven approach for unsupervised video retargeting t...
research
∙
08/01/2018
Deep Appearance Models for Face Rendering
We introduce a deep appearance model for rendering the human face. Inspi...
research
∙
07/03/2018
Supervision-by-Registration: An Unsupervised Approach to Improve the Precision of Facial Landmark Detectors
In this paper, we present supervision-by-registration, an unsupervised a...
research
∙
05/22/2018
Automatic Adaptation of Person Association for Multiview Tracking in Group Activities
Reliable markerless motion tracking of multiple people participating in ...
research
∙
04/18/2018
Structure from Recurrent Motion: From Rigidity to Recurrency
This paper proposes a new method for Non-Rigid Structure-from-Motion (NR...
research
∙
01/05/2018
Total Capture: A 3D Deformation Model for Tracking Faces, Hands, and Bodies
We present a unified deformation model for the markerless capture of mul...
research
∙
08/17/2017
PixelNN: Example-based Image Synthesis
We present a simple nearest-neighbor (NN) approach that synthesizes high...
research
∙
12/09/2016
Panoptic Studio: A Massively Multiview System for Social Interaction Capture
We present an approach to capture the 3D motion of a group of people eng...
research
∙
11/24/2016
Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields
We present an approach to efficiently detect the 2D pose of multiple peo...
research
∙
03/26/2016
How useful is photo-realistic rendering for visual learning?
Data seems cheap to get, and in many ways it is, but the process of crea...
research
∙
01/30/2016
