Cross-Difference Semantic Consistency Network for Semantic Change Detection

Qi Wang, Wei Jing, Kaichen Chi, Yuan Yuan

Research output: Contribution to journalArticlepeer-review

12 Scopus citations

Abstract

The objective of semantic change detection (SCD) is to discern intricate changes in land cover while simultaneously identifying their semantic categories. Prior research has shown that using multiple independent branches for the distinct tasks of change localization and semantic recognition is a reliable approach to solving the SCD problem. Nevertheless, conventional SCD architectures rely heavily on a high degree of consistency within the bitemporal feature space when modeling difference features, inevitably resulting in false positives or missed alerts within change areas. In this article, we introduce an SCD framework called the cross-differential semantic consistency network. Cross-difference semantic consistency (CdSC) is designed to mine deep discrepancies in bitemporal instance features while preserving their semantic consistency. Specifically, the 3-D cross-difference module, incorporating 3-D convolutions, explores the interaction of cross-temporal features, revealing inherent differences among various land features. Simultaneously, deep semantic representations are further utilized to enhance the local correlation of difference information, thereby improving the model's discriminative capabilities within change regions. Incorporating principles from contrastive learning, a semantic co-alignment (SCA) loss is introduced to increase intra-class consistency and inter-class distinctiveness of dual-temporal semantic features, thereby addressing the challenges posed by semantic disparities. Extensive experiments on two SCD datasets demonstrate that CdSC outperforms other state-of-the-art SCD methods significantly in both qualitative and quantitative evaluations. The code and dataset are available at https://github.com/weiAI1996/CdSC.

Original languageEnglish
Article number4406312
Pages (from-to)1-12
Number of pages12
JournalIEEE Transactions on Geoscience and Remote Sensing
Volume62
DOIs
StatePublished - 2024

Keywords

  • Cross-difference
  • deep learning
  • remote sensing image
  • semantic change detection (SCD)
  • semantic consistency

Fingerprint

Dive into the research topics of 'Cross-Difference Semantic Consistency Network for Semantic Change Detection'. Together they form a unique fingerprint.

Cite this