A Simple Attempt for 3D Occupancy Estimation in Autonomous Driving

03/17/2023
by   Wanshui Gan, et al.
0

The task of estimating 3D occupancy from surrounding view images is an exciting development in the field of autonomous driving, following the success of Birds Eye View (BEV) perception.This task provides crucial 3D attributes of the driving environment, enhancing the overall understanding and perception of the surrounding space. However, there is still a lack of a baseline to define the task, such as network design, optimization, and evaluation. In this work, we present a simple attempt for 3D occupancy estimation, which is a CNN-based framework designed to reveal several key factors for 3D occupancy estimation. In addition, we explore the relationship between 3D occupancy estimation and other related tasks, such as monocular depth estimation, stereo matching, and BEV perception (3D object detection and map segmentation), which could advance the study on 3D occupancy estimation. For evaluation, we propose a simple sampling strategy to define the metric for occupancy evaluation, which is flexible for current public datasets. Moreover, we establish a new benchmark in terms of the depth estimation metric, where we compare our proposed method with monocular depth estimation methods on the DDAD and Nuscenes datasets.The relevant code will be available in https://github.com/GANWANSHUI/SimpleOccupancy

READ FULL TEXT

page 4

page 7

research
06/27/2022

MGNet: Monocular Geometric Scene Understanding for Autonomous Driving

We introduce MGNet, a multi-task framework for monocular geometric scene...
research
07/20/2022

Latent Discriminant deterministic Uncertainty

Predictive uncertainty estimation is essential for deploying Deep Neural...
research
03/29/2023

An intelligent modular real-time vision-based system for environment perception

A significant portion of driving hazards is caused by human error and di...
research
12/22/2022

Vision-Based Environmental Perception for Autonomous Driving

Visual perception plays an important role in autonomous driving. One of ...
research
01/09/2023

Deep Planar Parallax for Monocular Depth Estimation

Depth estimation is a fundamental problem in the perception system of au...
research
02/20/2023

On the Metrics for Evaluating Monocular Depth Estimation

Monocular Depth Estimation (MDE) is performed to produce 3D information ...
research
08/20/2021

AutoLay: Benchmarking amodal layout estimation for autonomous driving

Given an image or a video captured from a monocular camera, amodal layou...

Please sign up or login with your details

Forgot password? Click here to reset