TY - JOUR
T1 - Style Transfer-Based Unsupervised Change Detection from Heterogeneous Images
AU - Zhang, Zuowei
AU - Liu, Chuanqi
AU - Hao, Fan
AU - Liu, Zhunga
N1 - Publisher Copyright:
© 1965-2011 IEEE.
PY - 2025
Y1 - 2025
N2 - Heterogeneous images are captured through different wavelength bands, providing rich and complementary information for change detection (CD), and domain transformation has emerged as a popular and effective solution. However, existing domain transformation-based CD methods overly rely on the quality of reconstructed features, making them appear inadequate for practical complex scenarios. In this paper, we propose a Style Transfer-based CD (STCD) method through unsupervised learning. STCD improves the quality and is robust to the reconstructed images by simultaneously employing a cautious labeling strategy and classifying. Specifically, we initially converted the two heterogeneous images provided into a shared domain by constructing a convolutional autoencoder based on adaptive instance normalization, which could improve the quality of reconstructed features and mitigate the data heterogeneity. Furthermore, we extract some significant pixel pairs based on fuzzy local information c-means to reduce the over-reliance on reconstructed features. Then we propose a Dynamic Superpixel-based Label Assignment (DSLA) rule to increase the reliable pseudo-labels employed in training a binary classifier. Finally, STCD can obtain great CD results even with poor reconstruction quality. Experimental results conducted on four heterogeneous datasets have demonstrated the effectiveness of STCD over other related CD methods.
AB - Heterogeneous images are captured through different wavelength bands, providing rich and complementary information for change detection (CD), and domain transformation has emerged as a popular and effective solution. However, existing domain transformation-based CD methods overly rely on the quality of reconstructed features, making them appear inadequate for practical complex scenarios. In this paper, we propose a Style Transfer-based CD (STCD) method through unsupervised learning. STCD improves the quality and is robust to the reconstructed images by simultaneously employing a cautious labeling strategy and classifying. Specifically, we initially converted the two heterogeneous images provided into a shared domain by constructing a convolutional autoencoder based on adaptive instance normalization, which could improve the quality of reconstructed features and mitigate the data heterogeneity. Furthermore, we extract some significant pixel pairs based on fuzzy local information c-means to reduce the over-reliance on reconstructed features. Then we propose a Dynamic Superpixel-based Label Assignment (DSLA) rule to increase the reliable pseudo-labels employed in training a binary classifier. Finally, STCD can obtain great CD results even with poor reconstruction quality. Experimental results conducted on four heterogeneous datasets have demonstrated the effectiveness of STCD over other related CD methods.
KW - Change detection
KW - convolutional autoencoder
KW - heterogeneous images
KW - label assignment
KW - style transfer
UR - http://www.scopus.com/inward/record.url?scp=85215386042&partnerID=8YFLogxK
U2 - 10.1109/TAES.2025.3529431
DO - 10.1109/TAES.2025.3529431
M3 - 文章
AN - SCOPUS:85215386042
SN - 0018-9251
JO - IEEE Transactions on Aerospace and Electronic Systems
JF - IEEE Transactions on Aerospace and Electronic Systems
ER -