Adaptive Correlation Filters with Long-Term and Short-Term Memory for Object Tracking

by   Chao Ma, et al.

Object tracking is challenging as target objects often undergo drastic appearance changes over time. Recently, adaptive correlation filters have been successfully applied to object tracking. However, tracking algorithms relying on highly adaptive correlation filters are prone to drift due to noisy updates. Moreover, as these algorithms do not maintain long-term memory of target appearance, they cannot recover from tracking failures caused by heavy occlusion or target disappearance in the camera view. In this paper, we propose to learn multiple adaptive correlation filters with both long-term and short-term memory of target appearance for robust object tracking. First, we learn a kernelized correlation filter with an aggressive learning rate for locating target objects precisely. We take into account the appropriate size of surrounding context and the feature representations. Second, we learn a correlation filter over a feature pyramid centered at the estimated target position for predicting scale changes. Third, we learn a complementary correlation filter with a conservative learning rate to maintain long-term memory of target appearance. We use the output responses of this long-term filter to determine if tracking failure occurs. In the case of tracking failures, we apply an incrementally learned detector to recover the target position in a sliding window fashion. Extensive experimental results on large-scale benchmark datasets demonstrate that the proposed algorithm performs favorably against the state-of-the-art methods in terms of efficiency, accuracy, and robustness.


page 2

page 4

page 5

page 7

page 17

page 18


Robust Visual Tracking via Hierarchical Convolutional Features

Visual tracking is challenging as target objects often undergo significa...

Learning Reinforced Attentional Representation for End-to-End Visual Tracking

Despite the fact that tremendous advances have been made by numerous rec...

Long-term Correlation Tracking using Multi-layer Hybrid Features in Sparse and Dense Environments

Tracking a target of interest in both sparse and crowded environments is...

Object Tracking by Reconstruction with View-Specific Discriminative Correlation Filters

Standard RGB-D trackers treat the target as an inherently 2D structure, ...

Robust Visual Tracking via Implicit Low-Rank Constraints and Structural Color Histograms

With the guaranteed discrimination and efficiency of spatial appearance ...

Human Short-Long Term Cognitive Memory Mechanism for Visual Monitoring in IoT-Assisted Smart Cities

In the Industry 4.0 era, the visualization and real-time automatic monit...

MOANA: An Online Learned Adaptive Appearance Model for Robust Multiple Object Tracking in 3D

Multiple object tracking has been a challenging field, mainly due to noi...

Please sign up or login with your details

Forgot password? Click here to reset