Multi-view Incremental Segmentation of 3D Point Clouds for Mobile Robots

by   Jingdao Chen, et al.

Mobile robots need to create high-definition 3D maps of the environment for applications such as remote surveillance and infrastructure mapping. Accurate semantic processing of the acquired 3D point cloud is critical for allowing the robot to obtain a high-level understanding of the surrounding objects and perform context-aware decision making. Existing techniques for point cloud semantic segmentation are mostly applied on a single-frame or offline basis, with no way to integrate the segmentation results over time. This paper proposes an online method for mobile robots to incrementally build a semantically-rich 3D point cloud of the environment. The proposed deep neural network, MCPNet, is trained to predict class labels and object instance labels for each point in the scanned point cloud in an incremental fashion. A multi-view context pooling (MCP) operator is used to combine point features obtained from multiple viewpoints to improve the classification accuracy. The proposed architecture was trained and evaluated on ray-traced scans derived from the Stanford 3D Indoor Spaces dataset. Results show that the proposed approach led to 15 NMI compared to the next best online method, with only a 6 compared to the PointNet-based offline approach.


page 2

page 3

page 4

page 5

page 6


Multi-view PointNet for 3D Scene Understanding

Fusion of 2D images and 3D point clouds is important because information...

LRGNet: Learnable Region Growing for Class-Agnostic Point Cloud Segmentation

3D point cloud segmentation is an important function that helps robots u...

Find my mug: Efficient object search with a mobile robot using semantic segmentation

In this paper, we propose an efficient semantic segmentation framework f...

A Review of Panoptic Segmentation for Mobile Mapping Point Clouds

3D point cloud panoptic segmentation is the combined task to (i) assign ...

FEC: Fast Euclidean Clustering for Point Cloud Segmentation

Segmentation from point cloud data is essential in many applications suc...

From a Point Cloud to a Simulation Model: Bayesian Segmentation and Entropy based Uncertainty Estimation for 3D Modelling

The 3D modelling of indoor environments and the generation of process si...

End-to-end Unsupervised Learning of Long-Term 3D Stable objects

3D point cloud semantic classification is an important task in robotics ...

Please sign up or login with your details

Forgot password? Click here to reset