Learning Adaptive Target-and-Surrounding Soft Mask for Correlation Filter Based Visual Tracking

Ke Zhang, Wuwei Wang, Jingyu Wang, Qi Wang, Xuelong Li

Research output: Contribution to journalArticlepeer-review

10 Scopus citations

Abstract

Visual tracking is a very critical issue in computer vision and video processing. For Discriminative Correlation Filter (DCF)-based tracking methods, it is very essential and meaningful to adaptively incorporate reliable target and surrounding information from video frames. However, most existing DCF-based trackers solely rely on pre-defined and fixed constraints such as a binary mask or quadratic function-based regularization to improve the discrimination. Unfortunately, such attempts fail to adjust the constraints according to the change of tracking circumstance in the video sequence, and thus lead to the lack of reliability of learned filters. To mitigate these problems, we present a novel DCF-based tracking method that introduces an adaptive target-and-surrounding soft mask (ATSM) into the learning formula. The adaptive soft mask that is represented by float numbers contains the detail information for both target region and its surrounding information: first, for the background area, it introduces meaningful background information and suppressing uninformative one; second, for the target area inside the bounding box, it helps to focus on the reliable area and repress the rapidly changing area; third, the target-and-surrounding soft mask is adaptively adjusted based on the variations of the target and its surrounding during the tracking process. By jointly modeling the filter and the adaptive soft mask, our ATSM tracker achieves an efficient integration of meaningful information of both foreground and background and performs favorably against state-of-the-art algorithms on seven well-known benchmarks.

Original languageEnglish
Pages (from-to)3708-3721
Number of pages14
JournalIEEE Transactions on Circuits and Systems for Video Technology
Volume32
Issue number6
DOIs
StatePublished - 1 Jun 2022

Keywords

  • discriminative correlation filters
  • soft mask
  • target and surrounding
  • video processing
  • Visual tracking

Fingerprint

Dive into the research topics of 'Learning Adaptive Target-and-Surrounding Soft Mask for Correlation Filter Based Visual Tracking'. Together they form a unique fingerprint.

Cite this