Multi-UAV Conflict Resolution with Graph Convolutional Reinforcement Learning

11/29/2021
by   Ralvi Isufaj, et al.
0

Safety is the primary concern when it comes to air traffic. In-flight safety between Unmanned Aircraft Vehicles (UAVs) is ensured through pairwise separation minima, utilizing conflict detection and resolution methods. Existing methods mainly deal with pairwise conflicts, however due to an expected increase in traffic density, encounters with more than two UAVs are likely to happen. In this paper, we model multi-UAV conflict resolution as a multi-agent reinforcement learning problem. We implement an algorithm based on graph neural networks where cooperative agents can communicate to jointly generate resolution maneuvers. The model is evaluated in scenarios with 3 and 4 present agents. Results show that agents are able to successfully solve the multi-UAV conflicts through a cooperative strategy.

READ FULL TEXT

page 11

page 12

research
06/15/2022

Automating the resolution of flight conflicts: Deep reinforcement learning in service of air traffic controllers

Dense and complex air traffic scenarios require higher levels of automat...
research
04/04/2022

Optimising Energy Efficiency in UAV-Assisted Networks using Deep Reinforcement Learning

In this letter, we study the energy efficiency (EE) optimisation of unma...
research
05/22/2021

Attention-based Reinforcement Learning for Real-Time UAV Semantic Communication

In this article, we study the problem of air-to-ground ultra-reliable an...
research
06/14/2023

Density-Aware Reinforcement Learning to Optimise Energy Efficiency in UAV-Assisted Networks

Unmanned aerial vehicles (UAVs) serving as aerial base stations can be d...
research
10/22/2018

Graph Convolutional Reinforcement Learning for Multi-Agent Cooperation

Learning to cooperate is crucially important in multi-agent reinforcemen...
research
05/10/2019

ES-CTC: A Deep Neuroevolution Model for Cooperative Intelligent Freeway Traffic Control

Cooperative intelligent freeway traffic control is an important applicat...
research
07/21/2021

Multi-Agent Belief Sharing through Autonomous Hierarchical Multi-Level Clustering

Coordination in multi-agent systems is challenging for agile robots such...

Please sign up or login with your details

Forgot password? Click here to reset