MOSAIC-Tracker: Mutual-enhanced Occlusion-aware Spatiotemporal Adaptive Identity Consistency network for aerial multi-object tracking

Jian Zou, Wei Zhang, Qiang Li, Qi Wang

Research output: Contribution to journalArticlepeer-review

1 Scopus citations

Abstract

Multi-Object Tracking (MOT) in aerial imagery remains challenging due to small object sizes, occlusions, and dynamic environments. Existing approaches predominantly rely on high precision detection and Re ID matching but neglect spatiotemporal cues and global temporal modeling of occlusion. Their static confidence weighting during association cannot adapt to real time detector confidence fluctuations, resulting in mismatches and ID switches. To alleviate these limitations, we propose MOSAIC-Tracker, a Mutual-enhanced Occlusion-aware Spatiotemporal Adaptive Identity Conservation Network with three key dimensions. First, a Spatiotemporal Occlusion Enhancement (STOE) module integrates multi-frame temporal dependencies to model global motion patterns and local dynamic features, mitigating identity switches during occlusions. Then, an Adaptive Multi-scale Feature Enhancement (AMFE) mechanism combines a Local Enhancement Mechanism with multi-scale feature aggregation to improve small object discrimination. Finally, a Dynamic Confidence Matrix Adjustment (DCMA) strategy adaptively weights detection confidence in trajectory matching to minimize association errors. Together, the three modules reduce occlusion-induced identity switches. Extensive evaluations on UAVDT and VisDrone2019 datasets demonstrate advanced performance. The code is released at: https://github.com/aJanm/MOSAIC-Tracker.

Original languageEnglish
Pages (from-to)138-154
Number of pages17
JournalISPRS Journal of Photogrammetry and Remote Sensing
Volume229
DOIs
StatePublished - Nov 2025

Keywords

  • Data association
  • Multi-layer feature aggregation
  • Multi-object tracking
  • Spatiotemporal fusion
  • Unmanned aerial vehicle video

Fingerprint

Dive into the research topics of 'MOSAIC-Tracker: Mutual-enhanced Occlusion-aware Spatiotemporal Adaptive Identity Consistency network for aerial multi-object tracking'. Together they form a unique fingerprint.

Cite this