D2NT: A High-Performing Depth-to-Normal Translator

04/24/2023
by   Yi Feng, et al.
0

Surface normal holds significant importance in visual environmental perception, serving as a source of rich geometric information. However, the state-of-the-art (SoTA) surface normal estimators (SNEs) generally suffer from an unsatisfactory trade-off between efficiency and accuracy. To resolve this dilemma, this paper first presents a superfast depth-to-normal translator (D2NT), which can directly translate depth images into surface normal maps without calculating 3D coordinates. We then propose a discontinuity-aware gradient (DAG) filter, which adaptively generates gradient convolution kernels to improve depth gradient estimation. Finally, we propose a surface normal refinement module that can easily be integrated into any depth-to-normal SNEs, substantially improving the surface normal estimation accuracy. Our proposed algorithm demonstrates the best accuracy among all other existing real-time SNEs and achieves the SoTA trade-off between efficiency and accuracy.

READ FULL TEXT

page 3

page 5

research
08/18/2022

SDA-SNE: Spatial Discontinuity-Aware Surface Normal Estimation via Multi-Directional Dynamic Programming

The state-of-the-art (SoTA) surface normal estimators (SNEs) generally t...
research
09/17/2022

Fast, Accurate and Object Boundary-Aware Surface Normal Estimation from Depth Maps

This paper proposes a fast and accurate surface normal estimation method...
research
05/17/2020

Three-Filters-to-Normal: An Accurate and Ultrafast Surface Normal Estimator

Over the past decade, significant efforts have been made to improve the ...
research
12/13/2020

GeoNet++: Iterative Geometric Neural Network with Edge-Aware Refinement for Joint Depth and Surface Normal Estimation

In this paper, we propose a geometric neural network with edge-aware ref...
research
03/13/2023

A Surface-normal Based Neural Framework for Colonoscopy Reconstruction

Reconstructing a 3D surface from colonoscopy video is challenging due to...
research
03/29/2021

Adaptive Surface Normal Constraint for Depth Estimation

We present a novel method for single image depth estimation using surfac...
research
07/29/2019

Enforcing geometric constraints of virtual normal for depth prediction

Monocular depth prediction plays a crucial role in understanding 3D scen...

Please sign up or login with your details

Forgot password? Click here to reset