TY - JOUR
T1 - High-resolution triplet network with dynamic multiscale feature for change detection on satellite images
AU - Hou, Xuan
AU - Bai, Yunpeng
AU - Li, Ying
AU - Shang, Changjing
AU - Shen, Qiang
N1 - Publisher Copyright:
© 2021 International Society for Photogrammetry and Remote Sensing, Inc. (ISPRS)
PY - 2021/7
Y1 - 2021/7
N2 - Change detection in remote sensing images aims to accurately determine any significant land surface changes based on acquired multi-temporal image data, being a pivotal task of remote sensing image processing. Over the past few years, owing to its powerful learning and expression ability, deep learning has been widely applied in the general field of image processing and has demonstrated remarkable potentials in performing change detection in images. However, a majority of the existing deep learning-based change detection mechanisms are modified from single-image semantic segmentation algorithms, without considering the temporal information contained within the images, thereby not always appropriate for real-world change detection. This paper proposes a High-Resolution Triplet Network (HRTNet) framework, including a dynamic inception module, to tackle such shortcomings in change detection. First, a novel triplet input network is introduced, which is capable of learning bi-temporal image features, extracting the temporal information reflecting the difference between images over time. Then, a network is employed to extract high-resolution image features, ensuring the learned features preserving high-resolution characteristics with minimal reduction of information. The paper also proposes a novel dynamic inception module, which helps improve the feature expression ability of HRTNet, enriching the multi-scale information of the features extracted. Finally, the distances between feature pairs are measured to generate a high-precision change map. The effectiveness and robustness of HRTNet are verified on three popular high-resolution remote sensing image datasets. Systematic experimental results show that the proposed approach outperforms state-of-the-art change detection methods.
AB - Change detection in remote sensing images aims to accurately determine any significant land surface changes based on acquired multi-temporal image data, being a pivotal task of remote sensing image processing. Over the past few years, owing to its powerful learning and expression ability, deep learning has been widely applied in the general field of image processing and has demonstrated remarkable potentials in performing change detection in images. However, a majority of the existing deep learning-based change detection mechanisms are modified from single-image semantic segmentation algorithms, without considering the temporal information contained within the images, thereby not always appropriate for real-world change detection. This paper proposes a High-Resolution Triplet Network (HRTNet) framework, including a dynamic inception module, to tackle such shortcomings in change detection. First, a novel triplet input network is introduced, which is capable of learning bi-temporal image features, extracting the temporal information reflecting the difference between images over time. Then, a network is employed to extract high-resolution image features, ensuring the learned features preserving high-resolution characteristics with minimal reduction of information. The paper also proposes a novel dynamic inception module, which helps improve the feature expression ability of HRTNet, enriching the multi-scale information of the features extracted. Finally, the distances between feature pairs are measured to generate a high-precision change map. The effectiveness and robustness of HRTNet are verified on three popular high-resolution remote sensing image datasets. Systematic experimental results show that the proposed approach outperforms state-of-the-art change detection methods.
KW - Change detection
KW - Dynamic convolution
KW - High-resolution images
KW - Remote sensing
KW - Triplet network
UR - http://www.scopus.com/inward/record.url?scp=85106320034&partnerID=8YFLogxK
U2 - 10.1016/j.isprsjprs.2021.05.001
DO - 10.1016/j.isprsjprs.2021.05.001
M3 - 文章
AN - SCOPUS:85106320034
SN - 0924-2716
VL - 177
SP - 103
EP - 115
JO - ISPRS Journal of Photogrammetry and Remote Sensing
JF - ISPRS Journal of Photogrammetry and Remote Sensing
ER -