An intelligent modular real-time vision-based system for environment perception

03/29/2023
by   Amirhossein Kazerouni, et al.
0

A significant portion of driving hazards is caused by human error and disregard for local driving regulations; Consequently, an intelligent assistance system can be beneficial. This paper proposes a novel vision-based modular package to ensure drivers' safety by perceiving the environment. Each module is designed based on accuracy and inference time to deliver real-time performance. As a result, the proposed system can be implemented on a wide range of vehicles with minimum hardware requirements. Our modular package comprises four main sections: lane detection, object detection, segmentation, and monocular depth estimation. Each section is accompanied by novel techniques to improve the accuracy of others along with the entire system. Furthermore, a GUI is developed to display perceived information to the driver. In addition to using public datasets, like BDD100K, we have also collected and annotated a local dataset that we utilize to fine-tune and evaluate our system. We show that the accuracy of our system is above 80 data are available at https://github.com/Pandas-Team/Autonomous-Vehicle-Environment-Perception

READ FULL TEXT

page 2

page 5

page 7

page 8

research
03/17/2023

A Simple Attempt for 3D Occupancy Estimation in Autonomous Driving

The task of estimating 3D occupancy from surrounding view images is an e...
research
03/17/2022

HybridNets: End-to-End Perception Network

End-to-end Network has become increasingly important in multi-tasking. O...
research
12/22/2022

Vision-Based Environmental Perception for Autonomous Driving

Visual perception plays an important role in autonomous driving. One of ...
research
07/16/2019

Real-time Vision-based Depth Reconstruction with NVidia Jetson

Vision-based depth reconstruction is a challenging problem extensively s...
research
03/15/2023

BEVHeight: A Robust Framework for Vision-based Roadside 3D Object Detection

While most recent autonomous driving system focuses on developing percep...
research
01/27/2020

A Robust Real-Time Computing-based Environment Sensing System for Intelligent Vehicle

For intelligent vehicles, sensing the 3D environment is the first but cr...
research
04/05/2023

Training Strategies for Vision Transformers for Object Detection

Vision-based Transformer have shown huge application in the perception m...

Please sign up or login with your details

Forgot password? Click here to reset