PointASNL: Robust Point Clouds Processing using Nonlocal Neural Networks with Adaptive Sampling

by   Xu Yan, et al.

Raw point clouds data inevitably contains outliers or noise through acquisition from 3D sensors or reconstruction algorithms. In this paper, we present a novel end-to-end network for robust point clouds processing, named PointASNL, which can deal with point clouds with noise effectively. The key component in our approach is the adaptive sampling (AS) module. It first re-weights the neighbors around the initial sampled points from farthest point sampling (FPS), and then adaptively adjusts the sampled points beyond the entire point cloud. Our AS module can not only benefit the feature learning of point clouds, but also ease the biased effect of outliers. To further capture the neighbor and long-range dependencies of the sampled point, we proposed a local-nonlocal (L-NL) module inspired by the nonlocal operation. Such L-NL module enables the learning process insensitive to noise. Extensive experiments verify the robustness and superiority of our approach in point clouds processing tasks regardless of synthesis data, indoor data, and outdoor data with or without noise. Specifically, PointASNL achieves state-of-the-art robust performance for classification and segmentation tasks on all datasets, and significantly outperforms previous methods on real-world outdoor SemanticKITTI dataset with considerate noise. Our code is released through https://github.com/yanx27/PointASNL.


page 7

page 14


POINTCLEANNET: Learning to Denoise and Remove Outliers from Dense Point Clouds

Point clouds obtained with 3D scanners or by image-based reconstruction ...

Distinctive 3D local deep descriptors

We present a simple but yet effective method for learning distinctive 3D...

Deep Algebraic Fitting for Multiple Circle Primitives Extraction from Raw Point Clouds

The shape of circle is one of fundamental geometric primitives of man-ma...

Deep Weighted Consensus: Dense correspondence confidence maps for 3D shape registration

We present a new paradigm for rigid alignment between point clouds based...

Monte Carlo Convolution for Learning on Non-Uniformly Sampled Point Clouds

We propose an efficient and effective method to learn convolutions for n...

Deep Convolution for Irregularly Sampled Temporal Point Clouds

We consider the problem of modeling the dynamics of continuous spatial-t...

Best Buddies Registration for Point Clouds

We propose new, and robust, loss functions for the point cloud registrat...

Please sign up or login with your details

Forgot password? Click here to reset