Scenario-Based Test Reduction and Prioritization for Multi-Module Autonomous Driving Systems

by   Yao Deng, et al.

When developing autonomous driving systems (ADS), developers often need to replay previously collected driving recordings to check the correctness of newly introduced changes to the system. However, simply replaying the entire recording is not necessary given the high redundancy of driving scenes in a recording (e.g., keeping the same lane for 10 minutes on a highway). In this paper, we propose a novel test reduction and prioritization approach for multi-module ADS. First, our approach automatically encodes frames in a driving recording to feature vectors based on a driving scene schema. Then, the given recording is sliced into segments based on the similarity of consecutive vectors. Lengthy segments are truncated to reduce the length of a recording and redundant segments with the same vector are removed. The remaining segments are prioritized based on both the coverage and the rarity of driving scenes. We implemented this approach on an industry level, multi-module ADS called Apollo and evaluated it on three road maps in various regression settings. The results show that our approach significantly reduced the original recordings by over 34 injected faults. Furthermore, our test prioritization method achieves about 22 to 39 average percentage of faults detected (APFD) and TOP-K.


page 7

page 10


Coverage-based Scene Fuzzing for Virtual Autonomous Driving Testing

Simulation-based virtual testing has become an essential step to ensure ...

DeepRoad: GAN-based Metamorphic Autonomous Driving System Testing

While Deep Neural Networks (DNNs) have established the fundamentals of D...

A Study on Quantifying Sim2Real Image Gap in Autonomous Driving Simulations Using Lane Segmentation Attention Map Similarity

Autonomous driving simulations require highly realistic images. Our prel...

SAD-GAN: Synthetic Autonomous Driving using Generative Adversarial Networks

Autonomous driving is one of the most recent topics of interest which is...

The 1st-place Solution for CVPR 2023 OpenLane Topology in Autonomous Driving Challenge

We present the 1st-place solution of OpenLane Topology in Autonomous Dri...

Multi-IF : An Approach to Anomaly Detection in Self-Driving Systems

Autonomous driving vehicles (ADVs) are implemented with rich software fu...

Please sign up or login with your details

Forgot password? Click here to reset