Graph-based Inpainting for 3D Dynamic Point Clouds

by   Zeqing Fu, et al.

With the development of depth sensors and 3D laser scanning techniques, 3D dynamic point clouds have attracted increasing attention as a format for the representation of 3D objects in motion, with applications in various fields such as 3D immersive tele-presence, navigation, animation, gaming and virtual reality. However, dynamic point clouds usually exhibit holes of missing data, mainly due to the fast motion, the limitation of acquisition techniques and complicated structure. Further, point clouds are defined on irregular non-Euclidean domain, which is challenging to address with conventional methods for regular data. Hence, leveraging on graph signal processing tools, we propose an efficient dynamic point cloud inpainting method, exploiting both the inter-frame coherence and the intra-frame self-similarity in 3D dynamic point clouds. Specifically, for each frame in a point cloud sequence, we first split it into cubes of fixed size as the processing unit, and treat cubes with holes inside as target cubes. Secondly, we take advantage of the intra-frame self-similarity in the target frame, by globally searching for the most similar cube to each target cube as the intra-source cube. Thirdly, we exploit the inter-frame coherence among every three consecutive frames, by searching the corresponding cubes in the previous and subsequent frames for each target cube as the inter-source cubes, which contains most nearest neighbors of the target cube in the relative location. Finally, we formulate dynamic point cloud inpainting as an optimization problem based on both intra- and inter-source cubes, which is regularized by the graph-signal smoothness prior. Experimental results show that the proposed approach outperforms three competing methods significantly, both in objective and subjective quality.


page 1

page 4

page 5

page 8


Local Frequency Interpretation and Non-Local Self-Similarity on Graph for Point Cloud Inpainting

As 3D scanning devices and depth sensors mature, point clouds have attra...

Predictive Generalized Graph Fourier Transform for Attribute Compression of Dynamic Point Clouds

As 3D scanning devices and depth sensors advance, dynamic point clouds h...

3D Dynamic Point Cloud Denoising via Spatio-temporal Graph Modeling

The prevalence of accessible depth sensing and 3D laser scanning techniq...

3D Dynamic Point Cloud Denoising via Spatial-Temporal Graph Learning

The prevalence of accessible depth sensing and 3D laser scanning techniq...

Hypergraph Spectral Analysis and Processing in 3D Point Cloud

Along with increasingly popular virtual reality applications, the three-...

Frame Mining: a Free Lunch for Learning Robotic Manipulation from 3D Point Clouds

We study how choices of input point cloud coordinate frames impact learn...

3D Point Cloud Enhancement using Graph-Modelled Multiview Depth Measurements

A 3D point cloud is often synthesized from depth measurements collected ...

Please sign up or login with your details

Forgot password? Click here to reset