Fusion of Range and Stereo Data for High-Resolution Scene-Modeling

by   Georgios D. Evangelidis, et al.

This paper addresses the problem of range-stereo fusion, for the construction of high-resolution depth maps. In particular, we combine low-resolution depth data with high-resolution stereo data, in a maximum a posteriori (MAP) formulation. Unlike existing schemes that build on MRF optimizers, we infer the disparity map from a series of local energy minimization problems that are solved hierarchically, by growing sparse initial disparities obtained from the depth data. The accuracy of the method is not compromised, owing to three properties of the data-term in the energy function. Firstly, it incorporates a new correlation function that is capable of providing refined correlations and disparities, via subpixel correction. Secondly, the correlation scores rely on an adaptive cost aggregation step, based on the depth data. Thirdly, the stereo and depth likelihoods are adaptively fused, based on the scene texture and camera geometry. These properties lead to a more selective growing process which, unlike previous seed-growing methods, avoids the tendency to propagate incorrect disparities. The proposed method gives rise to an intrinsically efficient algorithm, which runs at 3FPS on 2.0MP images on a standard desktop computer. The strong performance of the new method is established both by quantitative comparisons with state-of-the-art methods, and by qualitative comparisons using real depth-stereo data-sets.


page 1

page 2

page 4

page 12

page 13

page 14


High-Resolution Depth Maps Based on TOF-Stereo Fusion

The combination of range sensors with color cameras can be very useful f...

LiStereo: Generate Dense Depth Maps from LIDAR and Stereo Imagery

An accurate depth map of the environment is critical to the safe operati...

Robust High Quality Image Guided Depth Upsampling

Time-of-Flight (ToF) depth sensing camera is able to obtain depth maps a...

Stereo Matching With Color-Weighted Correlation, Hierarchical Belief Propagation And Occlusion Handling

In this paper, we contrive a stereo matching algorithm with careful hand...

Multi-resolution Monocular Depth Map Fusion by Self-supervised Gradient-based Composition

Monocular depth estimation is a challenging problem on which deep neural...

SMD-Nets: Stereo Mixture Density Networks

Despite stereo matching accuracy has greatly improved by deep learning i...

Scale Estimation of Monocular SfM for a Multi-modal Stereo Camera

This paper proposes a novel method of estimating the absolute scale of m...

Please sign up or login with your details

Forgot password? Click here to reset