TY - JOUR
T1 - Progressive Modality-Alignment for Unsupervised Heterogeneous Change Detection
AU - Xing, Yinghui
AU - Zhang, Qi
AU - Ran, Lingyan
AU - Zhang, Xiuwei
AU - Yin, Hanlin
AU - Zhang, Yanning
N1 - Publisher Copyright:
© 1980-2012 IEEE.
PY - 2023
Y1 - 2023
N2 - Change detection (CD) based on heterogeneous images is of great importance in some applications, such as disaster monitoring and damage assessment. However, due to the huge modality discrepancy in heterogeneous images, it is difficult to accurately detect the changed regions. In this article, we analyze the interference of modality alignment and changed areas to each other and propose a progressive modality alignment-based unsupervised CD model for heterogeneous images. Specifically, the modality alignment is achieved in an iterative manner, which can improve the detection accuracy progressively. To reduce the influence of modality discrepancy and the changed regions to each other, a pseudo-label self-learning strategy is designed, where the pseudo-labels learned by the model itself are used to act as guidance of CD, and they are, in turn, refined by the proposed progressive model. Experimental results on different real heterogeneous images verify the effectiveness and robustness of the proposed method.
AB - Change detection (CD) based on heterogeneous images is of great importance in some applications, such as disaster monitoring and damage assessment. However, due to the huge modality discrepancy in heterogeneous images, it is difficult to accurately detect the changed regions. In this article, we analyze the interference of modality alignment and changed areas to each other and propose a progressive modality alignment-based unsupervised CD model for heterogeneous images. Specifically, the modality alignment is achieved in an iterative manner, which can improve the detection accuracy progressively. To reduce the influence of modality discrepancy and the changed regions to each other, a pseudo-label self-learning strategy is designed, where the pseudo-labels learned by the model itself are used to act as guidance of CD, and they are, in turn, refined by the proposed progressive model. Experimental results on different real heterogeneous images verify the effectiveness and robustness of the proposed method.
KW - Autoencoder
KW - change detection (CD)
KW - heterogeneous images
KW - progressive
KW - pseudo-label
UR - http://www.scopus.com/inward/record.url?scp=85164703573&partnerID=8YFLogxK
U2 - 10.1109/TGRS.2023.3294300
DO - 10.1109/TGRS.2023.3294300
M3 - 文章
AN - SCOPUS:85164703573
SN - 0196-2892
VL - 61
JO - IEEE Transactions on Geoscience and Remote Sensing
JF - IEEE Transactions on Geoscience and Remote Sensing
M1 - 5614612
ER -