Learning geometry information of target for visual object tracking with siamese networks

Hang Chen, Weiguo Zhang, Danghui Yan

科研成果: 期刊稿件文章同行评审

2 引用 (Scopus)

摘要

Recently, Siamese architecture has been widely used in the field of visual tracking, and has achieved great success. Most Siamese network based trackers aggregate the target information of two branches by cross-correlation. However, since the location of the sampling points in the search feature area is pre-fixed in cross-correlation operation, these trackers suffer from either background noise influence or missing foreground information. Moreover, the cross-correlation between the template and the search area neglects the geometry information of the target. In this paper, we propose a Siamese deformable cross-correlation network to model the geometric structure of target and improve the performance of visual tracking. We propose to learn an offset field end-to-end in cross-correlation. With the guidance of the offset field, the sampling in the search image area can adapt to the deformation of the target, and realize the modeling of the geometric structure of the target. We further propose an online classification sub-network to model the variation of target appearance and enhance the robustness of the tracker. Extensive experiments are conducted on four challenging benchmarks, including OTB2015, VOT2018, VOT2019 and UAV123. The results demonstrate that our tracker achieves state-of-the-art performance.

源语言英语
文章编号7790
期刊Sensors
21
23
DOI
出版状态已出版 - 12月 2021

指纹

探究 'Learning geometry information of target for visual object tracking with siamese networks' 的科研主题。它们共同构成独一无二的指纹。

引用此