Efficient 3D Articulated Human Generation with Layered Surface Volumes

by   Yinghao Xu, et al.

Access to high-quality and diverse 3D articulated digital human assets is crucial in various applications, ranging from virtual reality to social platforms. Generative approaches, such as 3D generative adversarial networks (GANs), are rapidly replacing laborious manual content creation tools. However, existing 3D GAN frameworks typically rely on scene representations that leverage either template meshes, which are fast but offer limited quality, or volumes, which offer high capacity but are slow to render, thereby limiting the 3D fidelity in GAN settings. In this work, we introduce layered surface volumes (LSVs) as a new 3D object representation for articulated digital humans. LSVs represent a human body using multiple textured mesh layers around a conventional template. These layers are rendered using alpha compositing with fast differentiable rasterization, and they can be interpreted as a volumetric representation that allocates its capacity to a manifold of finite thickness around the template. Unlike conventional single-layer templates that struggle with representing fine off-surface details like hair or accessories, our surface volumes naturally capture such details. LSVs can be articulated, and they exhibit exceptional efficiency in GAN settings, where a 2D generator learns to synthesize the RGBA textures for the individual layers. Trained on unstructured, single-view 2D image datasets, our LSV-GAN generates high-quality and view-consistent 3D articulated digital humans without the need for view-inconsistent 2D upsampling networks.


page 2

page 6

page 8

page 14

page 15


GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Images

As several industries are moving towards modeling massive 3D virtual wor...

Registering Explicit to Implicit: Towards High-Fidelity Garment mesh Reconstruction from Single Images

Fueled by the power of deep learning techniques and implicit shape learn...

Realistic Full-Body Anonymization with Surface-Guided GANs

Recent work on image anonymization has shown that generative adversarial...

Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatars

3D-aware generative adversarial networks (GANs) synthesize high-fidelity...

Feeding the zombies: Synthesizing brain volumes using a 3D progressive growing GAN

Deep learning requires large datasets for training (convolutional) netwo...

Generating 3D structures from a 2D slice with GAN-based dimensionality expansion

Generative adversarial networks (GANs) can be trained to generate 3D ima...

xCloth: Extracting Template-free Textured 3D Clothes from a Monocular Image

Existing approaches for 3D garment reconstruction either assume a predef...

Please sign up or login with your details

Forgot password? Click here to reset