Head3D: Complete 3D Head Generation via Tri-plane Feature Distillation

03/28/2023
by   Yuhao Cheng, et al.
0

Head generation with diverse identities is an important task in computer vision and computer graphics, widely used in multimedia applications. However, current full head generation methods require a large number of 3D scans or multi-view images to train the model, resulting in expensive data acquisition cost. To address this issue, we propose Head3D, a method to generate full 3D heads with limited multi-view images. Specifically, our approach first extracts facial priors represented by tri-planes learned in EG3D, a 3D-aware generative model, and then proposes feature distillation to deliver the 3D frontal faces into complete heads without compromising head integrity. To mitigate the domain gap between the face and head models, we present dual-discriminators to guide the frontal and back head generation, respectively. Our model achieves cost-efficient and diverse complete head generation with photo-realistic renderings and high-quality geometry representations. Extensive experiments demonstrate the effectiveness of our proposed Head3D, both qualitatively and quantitatively.

READ FULL TEXT

page 1

page 3

page 5

page 6

page 7

page 8

research
03/23/2023

PanoHead: Geometry-Aware 3D Full-Head Synthesis in 360^∘

Synthesis and reconstruction of 3D human head has gained increasing inte...
research
03/13/2022

Depth-Aware Generative Adversarial Network for Talking Head Video Generation

Talking head video generation aims to produce a synthetic human face vid...
research
07/10/2023

Articulated 3D Head Avatar Generation using Text-to-Image Diffusion Models

The ability to generate diverse 3D articulated head avatars is vital to ...
research
03/24/2023

NeuFace: Realistic 3D Neural Face Rendering from Multi-view Images

Realistic face rendering from multi-view images is beneficial to various...
research
05/22/2023

RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatars

Synthesizing high-fidelity head avatars is a central problem for compute...
research
06/12/2023

Instant Multi-View Head Capture through Learnable Registration

Existing methods for capturing datasets of 3D heads in dense semantic co...
research
03/09/2019

Combining 3D Morphable Models: A Large scale Face-and-Head Model

Three-dimensional Morphable Models (3DMMs) are powerful statistical tool...

Please sign up or login with your details

Forgot password? Click here to reset