Vehicle Tracking Using Surveillance with Multimodal Data Fusion

by   Yue Zhang, et al.

Vehicle location prediction or vehicle tracking is a significant topic within connected vehicles. This task, however, is difficult if only a single modal data is available, probably causing bias and impeding the accuracy. With the development of sensor networks in connected vehicles, multimodal data are becoming accessible. Therefore, we propose a framework for vehicle tracking with multimodal data fusion. Specifically, we fuse the results of two modalities, images and velocity, in our vehicle-tracking task. Images, being processed in the module of vehicle detection, provide direct information about the features of vehicles, whereas velocity estimation can further evaluate the possible location of the target vehicles, which reduces the number of features being compared, and decreases the time consumption and computational cost. Vehicle detection is designed with a color-faster R-CNN, which takes both the shape and color of the vehicles into consideration. Meanwhile, velocity estimation is through the Kalman filter, which is a classical method for tracking. Finally, a multimodal data fusion method is applied to integrate these outcomes so that vehicle-tracking tasks can be achieved. Experimental results suggest the efficiency of our methods, which can track vehicles using a series of surveillance cameras in urban areas.


Bias Estimation for Decentralized Sensor Fusion -- Multi-Agent Based Bias Estimation Method

In multi-sensor data fusion (or sensor fusion), sensor biases (or offset...

Vehicle Trajectory Tracking Through Magnetic Sensors

Traffic surveillance is an important issue in Intelligent Transportation...

Urban Traffic Surveillance (UTS): A fully probabilistic 3D tracking approach based on 2D detections

Urban Traffic Surveillance (UTS) is a surveillance system based on a mon...

Distributed Multi-Target Tracking for Autonomous Vehicle Fleets

We present a scalable distributed target tracking algorithm based on the...

Vehicle Detection and Tracking From Surveillance Cameras in Urban Scenes

Detecting and tracking vehicles in urban scenes is a crucial step in man...

Path-Constrained State Estimation for Rail Vehicles

Globally rising demand for transportation by rail is pushing existing in...

Asynchronous Trajectory Matching-Based Multimodal Maritime Data Fusion for Vessel Traffic Surveillance in Inland Waterways

The automatic identification system (AIS) and video cameras have been wi...

Please sign up or login with your details

Forgot password? Click here to reset