TY - JOUR
T1 - Combining SAM With Limited Data for Change Detection in Remote Sensing
AU - Gao, Junyu
AU - Zhang, Da
AU - Wang, Feiyu
AU - Ning, Lichen
AU - Zhao, Zhiyuan
AU - Li, Xuelong
N1 - Publisher Copyright:
© 2025 IEEE.
PY - 2025
Y1 - 2025
N2 - Change detection is a critical task in the remote sensing image (RSI) analysis, widely used in fields such as land cover change and urban planning. With the introduction of foundational models like SAM in computer vision (CV) tasks, their advantages in zero-shot and interactive segmentation have enabled rapid application across diverse visual scenarios. Current research in change detection focuses on designing learnable plug-in modules and fine-tuning foundational models using large annotated data. However, constructing comprehensive datasets and designing effective additional modules pose significant challenges, leading to high costs. To address these issues, we propose a model named Meta-CD for remote sensing change detection (RSCD) with limited data. By introducing a simple fine-tuning module, this model is trained on limited datasets and quickly adapts to change detection tasks. Specifically, we integrate an additional CNN as an adapter with the foundational model FastSAM. Initially, we freeze the parameters of FastSAM and train only the parameters of the introduced adapter and decoder to generate change confidence maps. Subsequently, to enhance the quality of change detection, we introduce a novel pixel-level binarization module that learns the threshold for each pixel in the original image. This module combines the thresholds with the confidence maps to output binary change detection maps, filtering out invalid change pixels. Experimental results demonstrate that our method outperforms other competing approaches on limited datasets and has great zero-shot learning ability. Our code is available at Meta-CD.
AB - Change detection is a critical task in the remote sensing image (RSI) analysis, widely used in fields such as land cover change and urban planning. With the introduction of foundational models like SAM in computer vision (CV) tasks, their advantages in zero-shot and interactive segmentation have enabled rapid application across diverse visual scenarios. Current research in change detection focuses on designing learnable plug-in modules and fine-tuning foundational models using large annotated data. However, constructing comprehensive datasets and designing effective additional modules pose significant challenges, leading to high costs. To address these issues, we propose a model named Meta-CD for remote sensing change detection (RSCD) with limited data. By introducing a simple fine-tuning module, this model is trained on limited datasets and quickly adapts to change detection tasks. Specifically, we integrate an additional CNN as an adapter with the foundational model FastSAM. Initially, we freeze the parameters of FastSAM and train only the parameters of the introduced adapter and decoder to generate change confidence maps. Subsequently, to enhance the quality of change detection, we introduce a novel pixel-level binarization module that learns the threshold for each pixel in the original image. This module combines the thresholds with the confidence maps to output binary change detection maps, filtering out invalid change pixels. Experimental results demonstrate that our method outperforms other competing approaches on limited datasets and has great zero-shot learning ability. Our code is available at Meta-CD.
KW - Change detection
KW - foundation model
KW - limited data
KW - remote sensing
UR - http://www.scopus.com/inward/record.url?scp=105001066610&partnerID=8YFLogxK
U2 - 10.1109/TGRS.2025.3545040
DO - 10.1109/TGRS.2025.3545040
M3 - 文章
AN - SCOPUS:105001066610
SN - 0196-2892
VL - 63
JO - IEEE Transactions on Geoscience and Remote Sensing
JF - IEEE Transactions on Geoscience and Remote Sensing
M1 - 5614311
ER -