Progressive Modality-Alignment for Unsupervised Heterogeneous Change Detection

Yinghui Xing, Qi Zhang, Lingyan Ran, Xiuwei Zhang, Hanlin Yin, Yanning Zhang

Research output: Contribution to journalArticlepeer-review

5 Scopus citations

Abstract

Change detection (CD) based on heterogeneous images is of great importance in some applications, such as disaster monitoring and damage assessment. However, due to the huge modality discrepancy in heterogeneous images, it is difficult to accurately detect the changed regions. In this article, we analyze the interference of modality alignment and changed areas to each other and propose a progressive modality alignment-based unsupervised CD model for heterogeneous images. Specifically, the modality alignment is achieved in an iterative manner, which can improve the detection accuracy progressively. To reduce the influence of modality discrepancy and the changed regions to each other, a pseudo-label self-learning strategy is designed, where the pseudo-labels learned by the model itself are used to act as guidance of CD, and they are, in turn, refined by the proposed progressive model. Experimental results on different real heterogeneous images verify the effectiveness and robustness of the proposed method.

Original languageEnglish
Article number5614612
JournalIEEE Transactions on Geoscience and Remote Sensing
Volume61
DOIs
StatePublished - 2023
Externally publishedYes

Keywords

  • Autoencoder
  • change detection (CD)
  • heterogeneous images
  • progressive
  • pseudo-label

Fingerprint

Dive into the research topics of 'Progressive Modality-Alignment for Unsupervised Heterogeneous Change Detection'. Together they form a unique fingerprint.

Cite this