Inferring Point Clouds from Single Monocular Images by Depth Intermediation

12/04/2018
by   Wei Zeng, et al.
0

In this paper, we propose a framework for generating 3D point cloud of an object from a single-view RGB image. Most previous work predict the 3D point coordinates from single RGB images directly. We decompose this problem into depth estimation from single images and point completion from partial point clouds. Our method sequentially predicts the depth maps and then infers the complete 3D object point clouds based on the predicted partial point clouds. We explicitly impose the camera model geometrical constraint in our pipeline and enforce the alignment of the generated point clouds and estimated depth maps. Experimental results for the single image 3D object reconstruction task show that the proposed method outperforms state-of-the-art methods. Both the qualitative and quantitative results demonstrate the generality and suitability of our method.

READ FULL TEXT

page 1

page 3

page 6

page 8

research
12/01/2022

Leveraging Single-View Images for Unsupervised 3D Point Cloud Completion

Point clouds captured by scanning devices are often incomplete due to oc...
research
06/03/2020

PLG-IN: Pluggable Geometric Consistency Loss with Wasserstein Distance in Monocular Depth Estimation

We propose a novel objective to penalize geometric inconsistencies, to i...
research
03/02/2023

I2P-Rec: Recognizing Images on Large-scale Point Cloud Maps through Bird's Eye View Projections

Place recognition is an important technique for autonomous cars to achie...
research
07/01/2022

Leveraging Monocular Disparity Estimation for Single-View Reconstruction

We present a fine-tuning method to improve the appearance of 3D geometri...
research
02/04/2021

3D Surface Reconstruction From Multi-Date Satellite Images

The reconstruction of accurate three-dimensional environment models is o...
research
11/16/2022

Semantic keypoint extraction for scanned animals using multi-depth-camera systems

Keypoint annotation in point clouds is an important task for 3D reconstr...
research
06/19/2013

Finite Element Based Tracking of Deforming Surfaces

We present an approach to robustly track the geometry of an object that ...

Please sign up or login with your details

Forgot password? Click here to reset