SHIFT: A Synthetic Driving Dataset for Continuous Multi-Task Domain Adaptation

06/16/2022
by   Tao Sun, et al.
32

Adapting to a continuously evolving environment is a safety-critical challenge inevitably faced by all autonomous driving systems. Existing image and video driving datasets, however, fall short of capturing the mutable nature of the real world. In this paper, we introduce the largest multi-task synthetic dataset for autonomous driving, SHIFT. It presents discrete and continuous shifts in cloudiness, rain and fog intensity, time of day, and vehicle and pedestrian density. Featuring a comprehensive sensor suite and annotations for several mainstream perception tasks, SHIFT allows investigating the degradation of a perception system performance at increasing levels of domain shift, fostering the development of continuous adaptation strategies to mitigate this problem and assess model robustness and generality. Our dataset and benchmark toolkit are publicly available at www.vis.xyz/shift.

READ FULL TEXT

page 1

page 4

page 5

page 17

research
03/03/2023

Visual Exemplar Driven Task-Prompting for Unified Perception in Autonomous Driving

Multi-task learning has emerged as a powerful paradigm to solve a range ...
research
04/24/2023

Synthetic Datasets for Autonomous Driving: A Survey

Autonomous driving techniques have been flourishing in recent years whil...
research
02/17/2022

V2X-Sim: A Virtual Collaborative Perception Dataset for Autonomous Driving

Vehicle-to-everything (V2X), which denotes the collaboration between a v...
research
08/11/2023

Defensive Perception: Estimation and Monitoring of Neural Network Performance under Deployment

In this paper, we propose a method for addressing the issue of unnoticed...
research
11/15/2021

Towards Optimal Strategies for Training Self-Driving Perception Models in Simulation

Autonomous driving relies on a huge volume of real-world data to be labe...
research
07/06/2021

Attention-based Adversarial Appearance Learning of Augmented Pedestrians

Synthetic data became already an essential component of machine learning...
research
12/08/2022

Surround-view Fisheye BEV-Perception for Valet Parking: Dataset, Baseline and Distortion-insensitive Multi-task Framework

Surround-view fisheye perception under valet parking scenes is fundament...

Please sign up or login with your details

Forgot password? Click here to reset