Integrating SAM With Feature Interaction for Remote Sensing Change Detection

Da Zhang, Feiyu Wang, Lichen Ning, Zhiyuan Zhao, Junyu Gao, Xuelong Li

科研成果: 期刊稿件文章同行评审

10 引用 (Scopus)

摘要

Vision foundation models (VFMs) have rapidly gained application across various visual scenarios due to their robust universality and generalization capabilities. However, when directly applied to remote sensing images (RSIs), their performance often falls short owing to the unique inherent imaging characteristics. Moreover, these models typically suffer from inadequate feature extraction capabilities and unclear boundary detection because of the lack of specialized knowledge in the remote sensing (RS) field. To ameliorate these issues, we propose SFCD-Net, a novel network integrating SAM with feature interaction for RS change detection. To be specific, we first introduce a parameter-efficient fine-tuning (PEFT) method that allows the model to learn domain-specific knowledge, thereby enhancing its fine-grained feature extraction capability. Second, an innovative bitemporal feature interaction (BFI) module is designed to improve the model's sensitivity to changes. Finally, we use the boundary loss function (BLF) to enhance the model's ability to process boundary details, thereby improving its performance in recognizing boundaries and small targets. Through a series of ablation studies and comparative experiments, we demonstrate that the proposed SFCD-Net significantly improves model adaptability in RS tasks under limited computational resources, outperforming existing models.

源语言英语
文章编号4513011
期刊IEEE Transactions on Geoscience and Remote Sensing
62
DOI
出版状态已出版 - 2024

指纹

探究 'Integrating SAM With Feature Interaction for Remote Sensing Change Detection' 的科研主题。它们共同构成独一无二的指纹。

引用此