Dynamic-Group-Aware Networks for Multi-Agent Trajectory Prediction with Relational Reasoning

06/27/2022
by   Chenxin Xu, et al.
0

Demystifying the interactions among multiple agents from their past trajectories is fundamental to precise and interpretable trajectory prediction. However, previous works mainly consider static, pair-wise interactions with limited relational reasoning. To promote more comprehensive interaction modeling and relational reasoning, we propose DynGroupNet, a dynamic-group-aware network, which can i) model time-varying interactions in highly dynamic scenes; ii) capture both pair-wise and group-wise interactions; and iii) reason both interaction strength and category without direct supervision. Based on DynGroupNet, we further design a prediction system to forecast socially plausible trajectories with dynamic relational reasoning. The proposed prediction system leverages the Gaussian mixture model, multiple sampling and prediction refinement to promote prediction diversity, training stability and trajectory smoothness, respectively. Extensive experiments show that: 1)DynGroupNet can capture time-varying group behaviors, infer time-varying interaction category and interaction strength during trajectory prediction without any relation supervision on physical simulation datasets; 2)DynGroupNet outperforms the state-of-the-art trajectory prediction methods by a significant improvement of 22.6 the NBA, NFL Football and SDD datasets and achieve the state-of-the-art performance on the ETH-UCY dataset.

READ FULL TEXT

page 2

page 11

page 15

page 17

page 18

research
04/19/2022

GroupNet: Multiscale Hypergraph Neural Networks for Trajectory Prediction with Relational Reasoning

Demystifying the interactions among multiple agents from their past traj...
research
04/11/2023

Another Vertical View: A Hierarchical Network for Heterogeneous Trajectory Prediction via Spectrums

With the fast development of AI-related techniques, the applications of ...
research
07/31/2019

DROGON: A Causal Reasoning Framework for Future Trajectory Forecast

We propose DROGON (Deep RObust Goal-Oriented trajectory prediction Netwo...
research
10/19/2021

Trajectory Prediction with Linguistic Representations

Language allows humans to build mental models that interpret what is hap...
research
03/20/2023

EqMotion: Equivariant Multi-agent Motion Prediction with Invariant Interaction Reasoning

Learning to predict agent motions with relationship reasoning is importa...
research
12/19/2021

Representation Learning for Dynamic Hyperedges

Recently there has been a massive interest in extracting information fro...
research
05/21/2019

Looking to Relations for Future Trajectory Forecast

Inferring relational behavior between road users as well as road users a...

Please sign up or login with your details

Forgot password? Click here to reset