Self-Supervised Scene Flow Estimation with 4D Automotive Radar

03/02/2022
by   Fangqiang Ding, et al.
0

Scene flow allows autonomous vehicles to reason about the arbitrary motion of multiple independent objects which is the key to long-term mobile autonomy. While estimating the scene flow from LiDAR has progressed recently, it remains largely unknown how to estimate the scene flow from a 4D radar - an increasingly popular automotive sensor for its robustness against adverse weather and lighting conditions. Compared with the LiDAR point clouds, radar data are drastically sparser, noisier and in much lower resolution. Annotated datasets for radar scene flow are also in absence and costly to acquire in the real world. These factors jointly pose the radar scene flow estimation as a challenging problem. This work aims to address the above challenges and estimate scene flow from 4D radar point clouds by leveraging self-supervised learning. A robust scene flow estimation architecture and three novel losses are bespoken designed to cope with intractable radar data. Real-world experimental results validate that our method is able to robustly estimate the radar scene flow in the wild and effectively supports the downstream task of motion segmentation.

READ FULL TEXT

page 1

page 7

research
10/31/2020

Scene Flow from Point Clouds with or without Learning

Scene flow is the three-dimensional (3D) motion field of a scene. It pro...
research
12/23/2020

Warping of Radar Data into Camera Image for Cross-Modal Supervision in Automotive Applications

In this paper, we present a novel framework to project automotive radar ...
research
05/12/2022

CorAl: Introspection for Robust Radar and Lidar Perception in Diverse Environments Using Differential Entropy

Robust perception is an essential component to enable long-term operatio...
research
07/19/2021

GenRadar: Self-supervised Probabilistic Camera Synthesis based on Radar Frequencies

Autonomous systems require a continuous and dependable environment perce...
research
04/04/2023

Re-Evaluating LiDAR Scene Flow for Autonomous Driving

Current methods for self-supervised LiDAR scene flow estimation work poo...
research
06/21/2021

Coherent, super resolved radar beamforming using self-supervised learning

High resolution automotive radar sensors are required in order to meet t...
research
11/01/2021

Neural Scene Flow Prior

Before the deep learning revolution, many perception algorithms were bas...

Please sign up or login with your details

Forgot password? Click here to reset