Integrating SAM With Feature Interaction for Remote Sensing Change Detection

Da Zhang, Feiyu Wang, Lichen Ning, Zhiyuan Zhao, Junyu Gao, Xuelong Li

Research output: Contribution to journalArticlepeer-review

10 Scopus citations

Abstract

Vision foundation models (VFMs) have rapidly gained application across various visual scenarios due to their robust universality and generalization capabilities. However, when directly applied to remote sensing images (RSIs), their performance often falls short owing to the unique inherent imaging characteristics. Moreover, these models typically suffer from inadequate feature extraction capabilities and unclear boundary detection because of the lack of specialized knowledge in the remote sensing (RS) field. To ameliorate these issues, we propose SFCD-Net, a novel network integrating SAM with feature interaction for RS change detection. To be specific, we first introduce a parameter-efficient fine-tuning (PEFT) method that allows the model to learn domain-specific knowledge, thereby enhancing its fine-grained feature extraction capability. Second, an innovative bitemporal feature interaction (BFI) module is designed to improve the model's sensitivity to changes. Finally, we use the boundary loss function (BLF) to enhance the model's ability to process boundary details, thereby improving its performance in recognizing boundaries and small targets. Through a series of ablation studies and comparative experiments, we demonstrate that the proposed SFCD-Net significantly improves model adaptability in RS tasks under limited computational resources, outperforming existing models.

Original languageEnglish
Article number4513011
JournalIEEE Transactions on Geoscience and Remote Sensing
Volume62
DOIs
StatePublished - 2024

Keywords

  • Change detection (CD)
  • remote sensing (RS)
  • vision foundation model (VFM)

Fingerprint

Dive into the research topics of 'Integrating SAM With Feature Interaction for Remote Sensing Change Detection'. Together they form a unique fingerprint.

Cite this