Context-Enhanced Stereo Transformer

10/21/2022
by   Weiyu Guo, et al.
20

Stereo depth estimation is of great interest for computer vision research. However, existing methods struggles to generalize and predict reliably in hazardous regions, such as large uniform regions. To overcome these limitations, we propose Context Enhanced Path (CEP). CEP improves the generalization and robustness against common failure cases in existing solutions by capturing the long-range global information. We construct our stereo depth estimation model, Context Enhanced Stereo Transformer (CSTR), by plugging CEP into the state-of-the-art stereo depth estimation method Stereo Transformer. CSTR is examined on distinct public datasets, such as Scene Flow, Middlebury-2014, KITTI-2015, and MPI-Sintel. We find CSTR outperforms prior approaches by a large margin. For example, in the zero-shot synthetic-to-real setting, CSTR outperforms the best competing approaches on Middlebury-2014 dataset by 11 information is critical for stereo matching task and CEP successfully captures such information.

READ FULL TEXT

page 3

page 10

page 11

research
10/27/2022

2T-UNET: A Two-Tower UNet with Depth Clues for Robust Stereo Depth Estimation

Stereo correspondence matching is an essential part of the multi-step st...
research
07/28/2022

Depth Field Networks for Generalizable Multi-view Scene Representation

Modern 3D computer vision leverages learning to boost geometric reasonin...
research
05/22/2023

Gated Stereo: Joint Depth Estimation from Gated and Wide-Baseline Active Stereo Cues

We propose Gated Stereo, a high-resolution and long-range depth estimati...
research
06/01/2020

A Survey on Deep Learning Techniques for Stereo-based Depth Estimation

Estimating depth from RGB images is a long-standing ill-posed problem, w...
research
10/07/2021

DoubleStar: Long-Range Attack Towards Depth Estimation based Obstacle Avoidance in Autonomous Systems

Depth estimation-based obstacle avoidance has been widely adopted by aut...
research
08/28/2023

Semi-Supervised Semantic Depth Estimation using Symbiotic Transformer and NearFarMix Augmentation

In computer vision, depth estimation is crucial for domains like robotic...
research
05/14/2020

Bi3D: Stereo Depth Estimation via Binary Classifications

Stereo-based depth estimation is a cornerstone of computer vision, with ...

Please sign up or login with your details

Forgot password? Click here to reset