Decoder Fusion RNN: Context and Interaction Aware Decoders for Trajectory Prediction

08/12/2021
by   Edoardo Mello Rella, et al.
0

Forecasting the future behavior of all traffic agents in the vicinity is a key task to achieve safe and reliable autonomous driving systems. It is a challenging problem as agents adjust their behavior depending on their intentions, the others' actions, and the road layout. In this paper, we propose Decoder Fusion RNN (DF-RNN), a recurrent, attention-based approach for motion forecasting. Our network is composed of a recurrent behavior encoder, an inter-agent multi-headed attention module, and a context-aware decoder. We design a map encoder that embeds polyline segments, combines them to create a graph structure, and merges their relevant parts with the agents' embeddings. We fuse the encoded map information with further inter-agent interactions only inside the decoder and propose to use explicit training as a method to effectively utilize the information available. We demonstrate the efficacy of our method by testing it on the Argoverse motion forecasting dataset and show its state-of-the-art performance on the public benchmark.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/12/2022

Wayformer: Motion Forecasting via Simple Efficient Attention Networks

Motion forecasting for autonomous driving is a challenging task because ...
research
11/13/2017

Attention-based Information Fusion using Multi-Encoder-Decoder Recurrent Neural Networks

With the rising number of interconnected devices and sensors, modeling d...
research
11/29/2021

MultiPath++: Efficient Information Fusion and Trajectory Aggregation for Behavior Prediction

Predicting the future behavior of road users is one of the most challeng...
research
11/04/2022

GoRela: Go Relative for Viewpoint-Invariant Motion Forecasting

The task of motion forecasting is critical for self-driving vehicles (SD...
research
05/23/2021

HOME: Heatmap Output for future Motion Estimation

In this paper, we propose HOME, a framework tackling the motion forecast...
research
06/26/2023

SIMF: Semantics-aware Interactive Motion Forecasting for Autonomous Driving

Autonomous vehicles require motion forecasting of their surrounding mult...
research
12/02/2021

ShuttleNet: Position-aware Fusion of Rally Progress and Player Styles for Stroke Forecasting in Badminton

The increasing demand for analyzing the insights in sports has stimulate...

Please sign up or login with your details

Forgot password? Click here to reset