Drone Detection and Tracking in Real-Time by Fusion of Different Sensing Modalities

by   Fredrik Svanstrom, et al.

Automatic detection of flying drones is a key issue where its presence, specially if unauthorized, can create risky situations or compromise security. Here, we design and evaluate a multi-sensor drone detection system. In conjunction with common video cameras and microphone sensors, we explore the use of thermal infrared cameras, pointed out as a feasible and promising solution that is scarcely addressed in the related literature. Our solution integrates a fish-eye camera as well to monitor a wider part of the sky and steer the other cameras towards objects of interest. The sensing solutions are complemented with an ADS-B receiver, a GPS receiver, and a radar module, although the latter has been not included in our final deployment due to its limited detection range. The thermal camera is shown to be a feasible solution as good as the video camera, even if the camera employed here has a lower resolution. Two other novelties of our work are the creation of a new public dataset of multi-sensor annotated data that expand the number of classes in comparison to existing ones, as well as the study of the detector performance as a function of the sensor-to-target distance. Sensor fusion is also explored, showing that the system can be made more robust in this way, mitigating false detections of the individual sensors


page 9

page 13

page 15

page 22

page 25

page 28

page 33

page 38


Real-Time Drone Detection and Tracking With Visible, Thermal and Acoustic Sensors

This paper explores the process of designing an automatic multi-sensor d...

An early warning AI-powered portable system to reduce workload and inspect environmental damage after natural disasters

1.3 million household fires, 3,400 civilian deaths, and 23 billion dolla...

A dataset for multi-sensor drone detection

The use of small and remotely controlled unmanned aerial vehicles (UAVs)...

HRFuser: A Multi-resolution Sensor Fusion Architecture for 2D Object Detection

Besides standard cameras, autonomous vehicles typically include multiple...

Towards a Drone Cinematographer: Guiding Quadrotor Cameras using Visual Composition Principles

We present a system to capture video footage of human subjects in the re...

Robust Human Detection under Visual Degradation via Thermal and mmWave Radar Fusion

The majority of human detection methods rely on the sensor using visible...

Towards a Multispectral RGB-IR-UV-D Vision System – Seeing the Invisible in 3D

In this paper, we present the development of a sensing system with the c...

Please sign up or login with your details

Forgot password? Click here to reset