TY - JOUR
T1 - Task-specific contrastive learning for few-shot remote sensing image scene classification
AU - Zeng, Qingjie
AU - Geng, Jie
N1 - Publisher Copyright:
© 2022 International Society for Photogrammetry and Remote Sensing, Inc. (ISPRS)
PY - 2022/9
Y1 - 2022/9
N2 - Deep neural network has been successfully applied to remote sensing image scene classification, which requires a large amount of annotated data for training. However, it is time-consuming and labor-intensive to obtain abundant labeled samples in various applications. Therefore, it is of great importance to conduct scene classification with only a few annotated images. In order to address the issue, we propose a task-specific contrastive learning (TSC) model for few-shot scene classification of remote sensing images, which aims to enhance the scene classification performance with fewer labeled samples. Specifically, a self-attention and mutual-attention module (SMAM) is developed to learn feature correlations and reduce the background interference. Moreover, a task-specific contrastive loss function is proposed to optimize the deep network, which generates task-specific paired data based on different views of original images. This strategy has a contribution to enhance the discrimination of features between intra-class and inter-class images. Experimental results on NWPU-RESISC45, WHU-RS19 and UCM datasets demonstrate that the proposed method produces superior accuracies compared with other related few-shot learning methods.
AB - Deep neural network has been successfully applied to remote sensing image scene classification, which requires a large amount of annotated data for training. However, it is time-consuming and labor-intensive to obtain abundant labeled samples in various applications. Therefore, it is of great importance to conduct scene classification with only a few annotated images. In order to address the issue, we propose a task-specific contrastive learning (TSC) model for few-shot scene classification of remote sensing images, which aims to enhance the scene classification performance with fewer labeled samples. Specifically, a self-attention and mutual-attention module (SMAM) is developed to learn feature correlations and reduce the background interference. Moreover, a task-specific contrastive loss function is proposed to optimize the deep network, which generates task-specific paired data based on different views of original images. This strategy has a contribution to enhance the discrimination of features between intra-class and inter-class images. Experimental results on NWPU-RESISC45, WHU-RS19 and UCM datasets demonstrate that the proposed method produces superior accuracies compared with other related few-shot learning methods.
KW - Contrastive learning
KW - Few-shot learning
KW - Remote sensing image
KW - Scene classification
UR - http://www.scopus.com/inward/record.url?scp=85134724747&partnerID=8YFLogxK
U2 - 10.1016/j.isprsjprs.2022.07.013
DO - 10.1016/j.isprsjprs.2022.07.013
M3 - 文章
AN - SCOPUS:85134724747
SN - 0924-2716
VL - 191
SP - 143
EP - 154
JO - ISPRS Journal of Photogrammetry and Remote Sensing
JF - ISPRS Journal of Photogrammetry and Remote Sensing
ER -