Learning for Vehicle-to-Vehicle Cooperative Perception under Lossy Communication

by   Jinlong Li, et al.

Deep learning has been widely used in the perception (e.g., 3D object detection) of intelligent vehicle driving. Due to the beneficial Vehicle-to-Vehicle (V2V) communication, the deep learning based features from other agents can be shared to the ego vehicle so as to improve the perception of the ego vehicle. It is named as Cooperative Perception in the V2V research, whose algorithms have been dramatically advanced recently. However, all the existing cooperative perception algorithms assume the ideal V2V communication without considering the possible lossy shared features because of the Lossy Communication (LC) which is common in the complex real-world driving scenarios. In this paper, we first study the side effect (e.g., detection performance drop) by the lossy communication in the V2V Cooperative Perception, and then we propose a novel intermediate LC-aware feature fusion method to relieve the side effect of lossy communication by a LC-aware Repair Network (LCRN) and enhance the interaction between the ego vehicle and other vehicles by a specially designed V2V Attention Module (V2VAM) including intra-vehicle attention of ego vehicle and uncertainty-aware inter-vehicle attention. The extensive experiment on the public cooperative perception dataset OPV2V (based on digital-twin CARLA simulator) demonstrates that the proposed method is quite effective for the cooperative point cloud based 3D object detection under lossy V2V communication.


page 1

page 3

page 4

page 7


Human-Vehicle Cooperative Visual Perception for Shared Autonomous Driving

With the development of key technologies like environment perception, th...

Map Container: A Map-based Framework for Cooperative Perception

The idea of cooperative perception is to benefit from shared perception ...

TruPercept: Trust Modelling for Autonomous Vehicle Cooperative Perception from Synthetic Data

Inter-vehicle communication for autonomous vehicles (AVs) stands to prov...

V2VNet: Vehicle-to-Vehicle Communication for Joint Perception and Prediction

In this paper, we explore the use of vehicle-to-vehicle (V2V) communicat...

QUEST: Query Stream for Vehicle-Infrastructure Cooperative Perception

Cooperative perception can effectively enhance individual perception per...

Collaborative 3D Object Detection for Automatic Vehicle Systems via Learnable Communications

Accurate detection of objects in 3D point clouds is a key problem in aut...

Control-aware Communication for Cooperative Adaptive Cruise Control

Utilizing vehicle-to-everything (V2X) communication technologies, vehicl...

Please sign up or login with your details

Forgot password? Click here to reset