Deconvolutional Networks for Point-Cloud Vehicle Detection and Tracking in Driving Scenarios

by   Victor Vaquero, et al.

Vehicle detection and tracking is a core ingredient for developing autonomous driving applications in urban scenarios. Recent image-based Deep Learning (DL) techniques are obtaining breakthrough results in these perceptive tasks. However, DL research has not yet advanced much towards processing 3D point clouds from lidar range-finders. These sensors are very common in autonomous vehicles since, despite not providing as semantically rich information as images, their performance is more robust under harsh weather conditions than vision sensors. In this paper we present a full vehicle detection and tracking system that works with 3D lidar information only. Our detection step uses a Convolutional Neural Network (CNN) that receives as input a featured representation of the 3D information provided by a Velodyne HDL-64 sensor and returns a per-point classification of whether it belongs to a vehicle or not. The classified point cloud is then geometrically processed to generate observations for a multi-object tracking system implemented via a number of Multi-Hypothesis Extended Kalman Filters (MH-EKF) that estimate the position and velocity of the surrounding vehicles. The system is thoroughly evaluated on the KITTI tracking dataset, and we show the performance boost provided by our CNN-based vehicle detector over a standard geometric approach. Our lidar-based approach uses about a 4 similarly competitive results.


page 1

page 3

page 4

page 7


3D Point Cloud Processing and Learning for Autonomous Driving

We present a review of 3D point cloud processing and learning for autono...

LiDAR point-cloud processing based on projection methods: a comparison

An accurate and rapid-response perception system is fundamental for auto...

Combining LiDAR Space Clustering and Convolutional Neural Networks for Pedestrian Detection

Pedestrian detection is an important component for safety of autonomous ...

Model-free Vehicle Tracking and State Estimation in Point Cloud Sequences

Estimating the states of surrounding traffic participants stays at the c...

CurbScan: Curb Detection and Tracking Using Multi-Sensor Fusion

Reliable curb detection is critical for safe autonomous driving in urban...

Argoverse: 3D Tracking and Forecasting with Rich Maps

We present Argoverse – two datasets designed to support autonomous vehic...

Analyzing General-Purpose Deep-Learning Detection and Segmentation Models with Images from a Lidar as a Camera Sensor

Over the last decade, robotic perception algorithms have significantly b...

Please sign up or login with your details

Forgot password? Click here to reset