Deep object tracking with multi-modal data

Xuezhi Zhang, Yuan Yuan, Xiaoqiang Lu

科研成果: 书/报告/会议事项章节会议稿件同行评审

1 引用 (Scopus)

摘要

Object tracking is a challenging topic in the field of computer vision since its performance is easily disturbed by occlusion, illumination change, background clutter, scale variation, etc. In this paper, we introduce a robust tracking algorithm that fuses information from both visible images and infrared (IR) images. The proposed tracking algorithm not only incorporates convolutional feature maps from the visible channel, but also employs a scale pyramid representation from IR channel. We estimate the target location by fusing multilayer convolutional feature maps, and predict the target scale from a scale pyramid. The pipeline of the proposed method is as follows. First, the hierarchical convolutional feature maps are obtained from visible images using VGG-Nets. Then, the accurate target location is predicted by the maximum response of correlation filters with the visible image feature maps. Finally, we obtain the precise object scale with a scale pyramid from infrared images where the difference between the target and the background is clear. In order to verify the performance of the proposed method, we capture six video sequences under different conditions. These sequences contain both visible channel and IR channel. Ten state-of-the-art tracking algorithms are compared with our method, and the experimental results show the effectiveness of the proposed tracker.

源语言英语
主期刊名IEEE CITS 2016 - 2016 International Conference on Computer, Information and Telecommunication Systems
编辑Fei Gao, Zan Li, Daniel Cascado Caballero, Jing Fan, Mohammad S. Obaidat, Petros Nicoploitidis, Kuei Fang Hsiao
出版商Institute of Electrical and Electronics Engineers Inc.
ISBN(电子版)9781509034406
DOI
出版状态已出版 - 16 8月 2016
已对外发布
活动2016 International Conference on Computer, Information and Telecommunication Systems, CITS 2016 - Kunming, 中国
期限: 6 7月 20168 7月 2016

出版系列

姓名IEEE CITS 2016 - 2016 International Conference on Computer, Information and Telecommunication Systems

会议

会议2016 International Conference on Computer, Information and Telecommunication Systems, CITS 2016
国家/地区中国
Kunming
时期6/07/168/07/16

指纹

探究 'Deep object tracking with multi-modal data' 的科研主题。它们共同构成独一无二的指纹。

引用此