3D Point Cloud Enhancement using Graph-Modelled Multiview Depth Measurements

by   Xue Zhang, et al.

A 3D point cloud is often synthesized from depth measurements collected by sensors at different viewpoints. The acquired measurements are typically both coarse in precision and corrupted by noise. To improve quality, previous works denoise a synthesized 3D point cloud a posteriori after projecting the imperfect depth data onto 3D space. Instead, we enhance depth measurements on the sensed images a priori, exploiting inherent 3D geometric correlation across views, before synthesizing a 3D point cloud from the improved measurements. By enhancing closer to the actual sensing process, we benefit from optimization targeting specifically the depth image formation model, before subsequent processing steps that can further obscure measurement errors. Mathematically, for each pixel row in a pair of rectified viewpoint depth images, we first construct a graph reflecting inter-pixel similarities via metric learning using data in previous enhanced rows. To optimize left and right viewpoint images simultaneously, we write a non-linear mapping function from left pixel row to the right based on 3D geometry relations. We formulate a MAP optimization problem, which, after suitable linear approximations, results in an unconstrained convex and differentiable objective, solvable using fast gradient method (FGM). Experimental results show that our method noticeably outperforms recent denoising algorithms that enhance after 3D point clouds are synthesized.


Graph-Based Depth Denoising Dequantization for Point Cloud Enhancement

A 3D point cloud is typically constructed from depth measurements acquir...

Variational Graph Methods for Efficient Point Cloud Sparsification

In recent years new application areas have emerged in which one aims to ...

Novel View Synthesis from Single Images via Point Cloud Transformation

In this paper the argument is made that for true novel view synthesis of...

3D Dynamic Point Cloud Denoising via Spatial-Temporal Graph Learning

The prevalence of accessible depth sensing and 3D laser scanning techniq...

Method for the generation of depth images for view-based shape retrieval of 3D CAD model from partial point cloud

A laser scanner can easily acquire the geometric data of physical enviro...

Graph-based Inpainting for 3D Dynamic Point Clouds

With the development of depth sensors and 3D laser scanning techniques, ...

Effectiveness of 3VQM in Capturing Depth Inconsistencies

The 3D video quality metric (3VQM) was proposed to evaluate the temporal...

Please sign up or login with your details

Forgot password? Click here to reset