CXTrack: Improving 3D Point Cloud Tracking with Contextual Information

by   Tian-Xing Xu, et al.

3D single object tracking plays an essential role in many applications, such as autonomous driving. It remains a challenging problem due to the large appearance variation and the sparsity of points caused by occlusion and limited sensor capabilities. Therefore, contextual information across two consecutive frames is crucial for effective object tracking. However, points containing such useful information are often overlooked and cropped out in existing methods, leading to insufficient use of important contextual knowledge. To address this issue, we propose CXTrack, a novel transformer-based network for 3D object tracking, which exploits ConteXtual information to improve the tracking results. Specifically, we design a target-centric transformer network that directly takes point features from two consecutive frames and the previous bounding box as input to explore contextual information and implicitly propagate target cues. To achieve accurate localization for objects of all sizes, we propose a transformer-based localization head with a novel center embedding module to distinguish the target from distractors. Extensive experiments on three large-scale datasets, KITTI, nuScenes and Waymo Open Dataset, show that CXTrack achieves state-of-the-art tracking performance while running at 29 FPS.


page 1

page 2

page 3

page 4


MBPTrack: Improving 3D Point Cloud Tracking with Memory Networks and Box Priors

3D single object tracking has been a crucial problem for decades with nu...

Real-time 3D Single Object Tracking with Transformer

LiDAR-based 3D single object tracking is a challenging issue in robotics...

Exploring Point-BEV Fusion for 3D Point Cloud Object Tracking with Transformer

With the prevalence of LiDAR sensors in autonomous driving, 3D object tr...

ConTrack: Contextual Transformer for Device Tracking in X-ray

Device tracking is an important prerequisite for guidance during endovas...

A Lightweight and Detector-free 3D Single Object Tracker on Point Clouds

Recent works on 3D single object tracking treat the tracking as a target...

InterTrack: Interaction Transformer for 3D Multi-Object Tracking

3D multi-object tracking (MOT) is a key problem for autonomous vehicles,...

Siamese Attentional Keypoint Network for High Performance Visual Tracking

In this paper, we investigate impacts of three main aspects of visual tr...

Please sign up or login with your details

Forgot password? Click here to reset