Multi-Agent Routing Value Iteration Network

07/09/2020
by   Quinlan Sykora, et al.
3

In this paper we tackle the problem of routing multiple agents in a coordinated manner. This is a complex problem that has a wide range of applications in fleet management to achieve a common goal, such as mapping from a swarm of robots and ride sharing. Traditional methods are typically not designed for realistic environments hich contain sparsely connected graphs and unknown traffic, and are often too slow in runtime to be practical. In contrast, we propose a graph neural network based model that is able to perform multi-agent routing based on learned value iteration in a sparsely connected graph with dynamically changing traffic conditions. Moreover, our learned communication module enables the agents to coordinate online and adapt to changes more effectively. We created a simulated environment to mimic realistic mapping performed by autonomous vehicles with unknown minimum edge coverage and traffic conditions; our approach significantly outperforms traditional solvers both in terms of total cost and runtime. We also show that our model trained with only two agents on graphs with a maximum of 25 nodes can easily generalize to situations with more agents and/or nodes.

READ FULL TEXT

page 9

page 13

page 14

research
06/13/2022

Multi-Agent Neural Rewriter for Vehicle Routing with Limited Disclosure of Costs

We interpret solving the multi-vehicle routing problem as a team Markov ...
research
03/31/2023

MAGNNETO: A Graph Neural Network-based Multi-Agent system for Traffic Engineering

Current trends in networking propose the use of Machine Learning (ML) fo...
research
10/29/2021

Learning to Communicate with Reinforcement Learning for an Adaptive Traffic Control System

Recent work in multi-agent reinforcement learning has investigated inter...
research
07/28/2021

Packet Routing with Graph Attention Multi-agent Reinforcement Learning

Packet routing is a fundamental problem in communication networks that d...
research
04/26/2022

Multi-Agent Reinforcement Learning for Traffic Signal Control through Universal Communication Method

How to coordinate the communication among intersections effectively in r...
research
03/23/2023

Stochastic Graph Neural Network-based Value Decomposition for MARL in Internet of Vehicles

Autonomous driving has witnessed incredible advances in the past several...
research
10/22/2019

Distributed interference cancellation in multi-agent scenarios

This paper considers the problem of detecting impaired and noisy nodes o...

Please sign up or login with your details

Forgot password? Click here to reset