CGPart: A Part Segmentation Dataset Based on 3D Computer Graphics Models

by   Qing Liu, et al.

Part segmentations provide a rich and detailed part-level description of objects, but their annotation requires an enormous amount of work. In this paper, we introduce CGPart, a comprehensive part segmentation dataset that provides detailed annotations on 3D CAD models, synthetic images, and real test images. CGPart includes 21 3D CAD models covering 5 vehicle categories, each with detailed per-mesh part labeling. The average number of parts per category is 24, which is larger than any existing datasets for part segmentation on vehicle objects. By varying the rendering parameters, we make 168,000 synthetic images from these CAD models, each with automatically generated part segmentation ground-truth. We also annotate part segmentations on 200 real images for evaluation purposes. To illustrate the value of CGPart, we apply it to image part segmentation through unsupervised domain adaptation (UDA). We evaluate several baseline methods by adapting top-performing UDA algorithms from related tasks to part segmentation. Moreover, we introduce a new method called Geometric-Matching Guided domain adaptation (GMG), which leverages the spatial object structure to guide the knowledge transfer from the synthetic to the real images. Experimental results demonstrate the advantage of our new algorithm and reveal insights for future improvement. We will release our data and code.


page 1

page 6

page 7

page 9

page 10

page 11

page 12

page 15


Co-Training for Unsupervised Domain Adaptation of Semantic Segmentation Models

Semantic image segmentation is addressed by training deep models. Since ...

Automatically Annotating Indoor Images with CAD Models via RGB-D Scans

We present an automatic method for annotating images of indoor scenes wi...

Unsupervised Domain Adaptation from Synthetic to Real Images for Anchorless Object Detection

Synthetic images are one of the most promising solutions to avoid high c...

All about Structure: Adapting Structural Information across Domains for Boosting Semantic Segmentation

In this paper we tackle the problem of unsupervised domain adaptation fo...

Learning from Synthetic Animals

Despite great success in human parsing, progress for parsing other defor...

Synthetic to Real Adaptation with Generative Correlation Alignment Networks

Synthetic images rendered from 3D CAD models are useful for augmenting t...

Addressing the Sim2Real Gap in Robotic 3D Object Classification

Object classification with 3D data is an essential component of any scen...

Please sign up or login with your details

Forgot password? Click here to reset