Robust and accurate depth estimation by fusing LiDAR and Stereo

by   Guangyao Xu, et al.

Depth estimation is one of the key technologies in some fields such as autonomous driving and robot navigation. However, the traditional method of using a single sensor is inevitably limited by the performance of the sensor. Therefore, a precision and robust method for fusing the LiDAR and stereo cameras is proposed. This method fully combines the advantages of the LiDAR and stereo camera, which can retain the advantages of the high precision of the LiDAR and the high resolution of images respectively. Compared with the traditional stereo matching method, the texture of the object and lighting conditions have less influence on the algorithm. Firstly, the depth of the LiDAR data is converted to the disparity of the stereo camera. Because the density of the LiDAR data is relatively sparse on the y-axis, the converted disparity map is up-sampled using the interpolation method. Secondly, in order to make full use of the precise disparity map, the disparity map and stereo matching are fused to propagate the accurate disparity. Finally, the disparity map is converted to the depth map. Moreover, the converted disparity map can also increase the speed of the algorithm. We evaluate the proposed pipeline on the KITTI benchmark. The experiment demonstrates that our algorithm has higher accuracy than several classic methods.


page 1

page 4

page 6

page 8

page 9


Real Time Dense Depth Estimation by Fusing Stereo with Sparse Depth Measurements

We present an approach to depth estimation that fuses information from a...

Non-learning Stereo-aided Depth Completion under Mis-projection via Selective Stereo Matching

We propose a non-learning depth completion method for a sparse depth map...

Computationally efficient dense moving object detection based on reduced space disparity estimation

Computationally efficient moving object detection and depth estimation f...

Efficient and accurate monitoring of the depth information in a Wireless Multimedia Sensor Network based surveillance

Wireless Multimedia Sensor Network (WMSN) is a promising technology capt...

Innovative 3D Depth Map Generation From A Holoscopic 3D Image Based on Graph Cut Technique

Holoscopic 3D imaging is a promising technique for capturing full colour...

Joint Recursive Monocular Filtering of Camera Motion and Disparity Map

Monocular scene reconstruction is essential for modern applications such...

Depth Refinement for Improved Stereo Reconstruction

Depth estimation is a cornerstone of a vast number of applications requi...

Please sign up or login with your details

Forgot password? Click here to reset