TY - JOUR
T1 - ECAE
T2 - Edge-Aware Class Activation Enhancement for Semisupervised Remote Sensing Image Semantic Segmentation
AU - Miao, Wang
AU - Xu, Zhe
AU - Geng, Jie
AU - Jiang, Wen
N1 - Publisher Copyright:
© 1980-2012 IEEE.
PY - 2023
Y1 - 2023
N2 - Remote sensing image semantic segmentation (RSISS) remains challenging due to the scarcity of labeled data. Semisupervised learning can leverage pseudolabels to enhance the model's ability to learn from unlabeled data. However, accurately generating pseudolabels for RSISS remains a significant challenge that severely affects the model's performance, especially for the edges of different classes. To overcome these issues, we propose a semisupervised semantic segmentation framework for remote sensing images (RSIs) based on edge-aware class activation enhancement (ECAE). First, the baseline network is constructed based on the average teacher model, which separates the training of labeled and unlabeled data using student and teacher networks. Second, considering local continuity and global discreteness of object distribution in RSIs, the class activation mapping enhancement (CAME) network is designed to predict local areas more remarkably. Finally, the edge-aware network (EAN) is proposed to improve the performance of edge segmentation in RSIs. The combination of the CAME with the EAN further heightens the generation of high-confidence pseudolabels. Experiments were performed on two publicly available remote sensing semantic segmentation datasets, Potsdam and ISPRS Vaihingen, which verify the superiorities of the proposed ECAE model.
AB - Remote sensing image semantic segmentation (RSISS) remains challenging due to the scarcity of labeled data. Semisupervised learning can leverage pseudolabels to enhance the model's ability to learn from unlabeled data. However, accurately generating pseudolabels for RSISS remains a significant challenge that severely affects the model's performance, especially for the edges of different classes. To overcome these issues, we propose a semisupervised semantic segmentation framework for remote sensing images (RSIs) based on edge-aware class activation enhancement (ECAE). First, the baseline network is constructed based on the average teacher model, which separates the training of labeled and unlabeled data using student and teacher networks. Second, considering local continuity and global discreteness of object distribution in RSIs, the class activation mapping enhancement (CAME) network is designed to predict local areas more remarkably. Finally, the edge-aware network (EAN) is proposed to improve the performance of edge segmentation in RSIs. The combination of the CAME with the EAN further heightens the generation of high-confidence pseudolabels. Experiments were performed on two publicly available remote sensing semantic segmentation datasets, Potsdam and ISPRS Vaihingen, which verify the superiorities of the proposed ECAE model.
KW - Class activation mapping
KW - remote sensing images (RSIs)
KW - semantic segmentation
KW - semisupervised learning
UR - http://www.scopus.com/inward/record.url?scp=85177038102&partnerID=8YFLogxK
U2 - 10.1109/TGRS.2023.3330490
DO - 10.1109/TGRS.2023.3330490
M3 - 文章
AN - SCOPUS:85177038102
SN - 0196-2892
VL - 61
SP - 1
EP - 14
JO - IEEE Transactions on Geoscience and Remote Sensing
JF - IEEE Transactions on Geoscience and Remote Sensing
M1 - 5625014
ER -