Towards Object Re-Identification from Point Clouds for 3D MOT

by   Benjamin Thérien, et al.

In this work, we study the problem of object re-identification (ReID) in a 3D multi-object tracking (MOT) context, by learning to match pairs of objects from cropped (e.g., using their predicted 3D bounding boxes) point cloud observations. We are not concerned with SOTA performance for 3D MOT, however. Instead, we seek to answer the following question: In a realistic tracking by-detection context, how does object ReID from point clouds perform relative to ReID from images? To enable such a study, we propose a lightweight matching head that can be concatenated to any set or sequence processing backbone (e.g., PointNet or ViT), creating a family of comparable object ReID networks for both modalities. Run in siamese style, our proposed point-cloud ReID networks can make thousands of pairwise comparisons in real-time (10 hz). Our findings demonstrate that their performance increases with higher sensor resolution and approaches that of image ReID when observations are sufficiently dense. Additionally, we investigate our network's ability to enhance 3D multi-object tracking (MOT), showing that our point-cloud ReID networks can successfully re-identify objects which led a strong motion-based tracker into error. To our knowledge, we are the first to study real-time object re-identification from point clouds in a 3D multi-object tracking context.


page 14

page 18

page 20

page 21


PointTrackNet: An End-to-End Network For 3-D Object Detection and Tracking From Point Clouds

Recent machine learning-based multi-object tracking (MOT) frameworks are...

Detection and Tracking of Small Objects in Sparse 3D Laser Range Data

Detection and tracking of dynamic objects is a key feature for autonomou...

AlignNet-3D: Fast Point Cloud Registration of Partially Observed Objects

Methods tackling multi-object tracking need to estimate the number of ta...

Exploiting More Information in Sparse Point Cloud for 3D Single Object Tracking

3D single object tracking is a key task in 3D computer vision. However, ...

Large Scale Novel Object Discovery in 3D

We present a method for discovering objects in 3D point clouds from sens...

Leveraging Shape Completion for 3D Siamese Tracking

Point clouds are challenging to process due to their sparsity, therefore...

VPIT: Real-time Embedded Single Object 3D Tracking Using Voxel Pseudo Images

In this paper, we propose a novel voxel-based 3D single object tracking ...

Please sign up or login with your details

Forgot password? Click here to reset