跳到主要导航 跳到搜索 跳到主要内容

MiA: A plug-and-play hyperparameter-free Mamba in Attention module for spatial–temporal consistent visual tracking

  • Yao Chen
  • , Guancheng Jia
  • , Ding Ma
  • , Yufei Zha
  • , Peng Zhang
  • Northwestern Polytechnical University Xian

科研成果: 期刊稿件文章同行评审

摘要

Effectively modeling spatial-temporal consistent target dependency is essential for robust visual tracking. Existing solutions — template updating and token propagation mechanisms — suffer from non-trivial hyperparameter tuning that compromises portability and generalizability. To address this, we propose Mamba in Attention (MiA), a hyperparameter-free plug-and-play module that mitigates the need for manual tuning while effectively enhancing spatial-temporal consistency. The MiA module comprises two complementary branches: an Attention-based spatial branch that captures static spatial relationships, and a Mamba-based temporal branch, which continuously encodes historical context via hidden states of the State Space Model (SSM). By fusing these two dependencies, MiA enables static-dynamic interaction, significantly improving the robustness of target localization. For extreme scenarios, we further contribute a Channel-aware KAN (CKAN), first introducing Kolmogorov-Arnold Networks to visual tracking for enhanced nonlinear channel relationship representation. Built upon MiA and CKAN, we present a state-of-the-art lightweight tracker, MiATrack, which achieves an excellent performance-speed-parameter trade-off on all five commonly used tracking benchmarks. Notably, MiA offers seamless integration into existing tracking frameworks, delivering performance gains with only 30 training epochs, minimal overhead, and zero hyperparameter tuning. Extensive experiments across five diverse trackers and six tracking benchmarks validate the excellent portability and generalizability of our proposed MiA module. Code is available at https://github.com/Xiaochen918/MiATrack.

源语言英语
文章编号114033
期刊Pattern Recognition
180
DOI
出版状态已出版 - 12月 2026

指纹

探究 'MiA: A plug-and-play hyperparameter-free Mamba in Attention module for spatial–temporal consistent visual tracking' 的科研主题。它们共同构成独一无二的指纹。

引用此