Neural Shape Parsers for Constructive Solid Geometry

by   Gopal Sharma, et al.

Constructive Solid Geometry (CSG) is a geometric modeling technique that defines complex shapes by recursively applying boolean operations on primitives such as spheres and cylinders. We present CSGNe, a deep network architecture that takes as input a 2D or 3D shape and outputs a CSG program that models it. Parsing shapes into CSG programs is desirable as it yields a compact and interpretable generative model. However, the task is challenging since the space of primitives and their combinations can be prohibitively large. CSGNe uses a convolutional encoder and recurrent decoder based on deep networks to map shapes to modeling instructions in a feed-forward manner and is significantly faster than bottom-up approaches. We investigate two architectures for this task — a vanilla encoder (CNN) - decoder (RNN) and another architecture that augments the encoder with an explicit memory module based on the program execution stack. The stack augmentation improves the reconstruction quality of the generated shape and learning efficiency. Our approach is also more effective as a shape primitive detector compared to a state-of-the-art object detector. Finally, we demonstrate CSGNet can be trained on novel datasets without program annotations through policy gradient techniques.


page 1

page 8

page 9

page 10


CSGNet: Neural Shape Parser for Constructive Solid Geometry

We present a neural architecture that takes as input a 2D or 3D shape an...

UCSG-Net – Unsupervised Discovering of Constructive Solid Geometry Tree

Signed distance field (SDF) is a prominent implicit representation of 3D...

Learning to Infer and Execute 3D Shape Programs

Human perception of 3D shapes goes beyond reconstructing them as a set o...

Learning to Infer Shape Programs Using Latent Execution Self Training

Inferring programs which generate 2D and 3D shapes is important for reve...

Using Synthetic Data and Deep Networks to Recognize Primitive Shapes for Object Grasping

A segmentation-based architecture is proposed to decompose objects into ...

Adaptive O-CNN: A Patch-based Deep Representation of 3D Shapes

We present an Adaptive Octree-based Convolutional Neural Network (Adapti...

ShapeMOD: Macro Operation Discovery for 3D Shape Programs

A popular way to create detailed yet easily controllable 3D shapes is vi...

Please sign up or login with your details

Forgot password? Click here to reset