Depth Monocular Estimation with Attention-based Encoder-Decoder Network from Single Image

by   Xin Zhang, et al.

Depth information is the foundation of perception, essential for autonomous driving, robotics, and other source-constrained applications. Promptly obtaining accurate and efficient depth information allows for a rapid response in dynamic environments. Sensor-based methods using LIDAR and RADAR obtain high precision at the cost of high power consumption, price, and volume. While due to advances in deep learning, vision-based approaches have recently received much attention and can overcome these drawbacks. In this work, we explore an extreme scenario in vision-based settings: estimate a depth map from one monocular image severely plagued by grid artifacts and blurry edges. To address this scenario, We first design a convolutional attention mechanism block (CAMB) which consists of channel attention and spatial attention sequentially and insert these CAMBs into skip connections. As a result, our novel approach can find the focus of current image with minimal overhead and avoid losses of depth features. Next, by combining the depth value, the gradients of X axis, Y axis and diagonal directions, and the structural similarity index measure (SSIM), we propose our novel loss function. Moreover, we utilize pixel blocks to accelerate the computation of the loss function. Finally, we show, through comprehensive experiments on two large-scale image datasets, i.e. KITTI and NYU-V2, that our method outperforms several representative baselines.


page 1

page 3

page 8


Visual Attention-based Self-supervised Absolute Depth Estimation using Geometric Priors in Autonomous Driving

Although existing monocular depth estimation methods have made great pro...

S&CNet: A Enhanced Coarse-to-fine Framework For Monocular Depth Completion

Real-time depth completing is a critical problem for robotics and autono...

Attention Attention Everywhere: Monocular Depth Prediction with Skip Attention

Monocular Depth Estimation (MDE) aims to predict pixel-wise depth given ...

On Deep Learning Techniques to Boost Monocular Depth Estimation for Autonomous Navigation

Inferring the depth of images is a fundamental inverse problem within th...

SIDE: Center-based Stereo 3D Detector with Structure-aware Instance Depth Estimation

3D detection plays an indispensable role in environment perception. Due ...

Towards Building the Semantic Map from a Monocular Camera with a Multi-task Network

In many robotic applications, especially for the autonomous driving, und...

Please sign up or login with your details

Forgot password? Click here to reset