Transformer Tracking

03/29/2021
by   Xin Chen, et al.
0

Correlation acts as a critical role in the tracking field, especially in recent popular Siamese-based trackers. The correlation operation is a simple fusion manner to consider the similarity between the template and the search region. However, the correlation operation itself is a local linear matching process, leading to lose semantic information and fall into local optimum easily, which may be the bottleneck of designing high-accuracy tracking algorithms. Is there any better feature fusion method than correlation? To address this issue, inspired by Transformer, this work presents a novel attention-based feature fusion network, which effectively combines the template and search region features solely using attention. Specifically, the proposed method includes an ego-context augment module based on self-attention and a cross-feature augment module based on cross-attention. Finally, we present a Transformer tracking (named TransT) method based on the Siamese-like feature extraction backbone, the designed attention-based fusion mechanism, and the classification and regression head. Experiments show that our TransT achieves very promising results on six challenging datasets, especially on large-scale LaSOT, TrackingNet, and GOT-10k benchmarks. Our tracker runs at approximatively 50 fps on GPU. Code and models are available at https://github.com/chenxin-dlut/TransT.

READ FULL TEXT

page 1

page 5

03/25/2022

High-Performance Transformer Tracking

Correlation has a critical role in the tracking field, especially in rec...
05/09/2021

TrTr: Visual Tracking with Transformer

Template-based discriminative trackers are currently the dominant tracki...
03/18/2023

ABC: Attention with Bilinear Correlation for Infrared Small Target Detection

Infrared small target detection (ISTD) has a wide range of applications ...
12/02/2021

SwinTrack: A Simple and Strong Baseline for Transformer Tracking

Transformer has recently demonstrated clear potential in improving visua...
01/22/2023

DASTSiam: Spatio-Temporal Fusion and Discriminative Augmentation for Improved Siamese Tracking

Tracking tasks based on deep neural networks have greatly improved with ...
06/13/2022

Transformer Lesion Tracker

Evaluating lesion progression and treatment response via longitudinal le...
05/25/2023

MixFormerV2: Efficient Fully Transformer Tracking

Transformer-based trackers have achieved strong accuracy on the standard...

Code Repositories

TransT

Transformer Tracking (CVPR2021)


view repo

Please sign up or login with your details

Forgot password? Click here to reset