TY - JOUR
T1 - Progressive Parsing and Commonality Distillation for Few-Shot Remote Sensing Segmentation
AU - Lang, Chunbo
AU - Wang, Junyi
AU - Cheng, Gong
AU - Tu, Binfei
AU - Han, Junwei
N1 - Publisher Copyright:
© 1980-2012 IEEE.
PY - 2023
Y1 - 2023
N2 - In recent years, few-shot segmentation (FSS) has received widespread attention from scholars by virtue of its superiority in low-data regimes. Most existing research focuses on natural image processing, and very few studies are dedicated to the practical but challenging topic of remote sensing image understanding. Related experimental results show that directly transferring the previously proposed framework to the current domain is prone to produce unsatisfactory results with incomplete objects and irrelevant distractors. Such phenomena can be attributed to the lack of modules specifically designed for the complex characteristics of remote sensing images, e.g., great intra-class diversity and low target-background contrast. In this article, we propose a conceptually simple and easy-to-implement framework to tackle the aforementioned problems. Specifically, our innovative design embodies two main aspects: 1) the support mask is progressively parsed into multiple valuable subregions that can be further exploited to compute local descriptors with segmentation cues about intractable parts; and 2) the base-class memories stored in the meta-training phase are replayed and leveraged for the distillation of novel-class prototypes, where the commonalities between classes are adequately explored, more in line with the concept of learning to learn. These two components, i.e., the progressive parsing module and commonality distillation module, contribute to each other and together constitute the proposed PCNet. We conduct extensive experiments on the standard benchmark to evaluate segmentation performance in few-shot settings. Quantitative and qualitative results illustrate that our PCNet distinctly outperforms previous FSS approaches and sets a new state-of-the-art.
AB - In recent years, few-shot segmentation (FSS) has received widespread attention from scholars by virtue of its superiority in low-data regimes. Most existing research focuses on natural image processing, and very few studies are dedicated to the practical but challenging topic of remote sensing image understanding. Related experimental results show that directly transferring the previously proposed framework to the current domain is prone to produce unsatisfactory results with incomplete objects and irrelevant distractors. Such phenomena can be attributed to the lack of modules specifically designed for the complex characteristics of remote sensing images, e.g., great intra-class diversity and low target-background contrast. In this article, we propose a conceptually simple and easy-to-implement framework to tackle the aforementioned problems. Specifically, our innovative design embodies two main aspects: 1) the support mask is progressively parsed into multiple valuable subregions that can be further exploited to compute local descriptors with segmentation cues about intractable parts; and 2) the base-class memories stored in the meta-training phase are replayed and leveraged for the distillation of novel-class prototypes, where the commonalities between classes are adequately explored, more in line with the concept of learning to learn. These two components, i.e., the progressive parsing module and commonality distillation module, contribute to each other and together constitute the proposed PCNet. We conduct extensive experiments on the standard benchmark to evaluate segmentation performance in few-shot settings. Quantitative and qualitative results illustrate that our PCNet distinctly outperforms previous FSS approaches and sets a new state-of-the-art.
KW - Few-shot learning
KW - few-shot segmentation (FSS)
KW - image processing
KW - remote sensing
KW - semantic segmentation
UR - http://www.scopus.com/inward/record.url?scp=85162665157&partnerID=8YFLogxK
U2 - 10.1109/TGRS.2023.3286183
DO - 10.1109/TGRS.2023.3286183
M3 - 文章
AN - SCOPUS:85162665157
SN - 0196-2892
VL - 61
JO - IEEE Transactions on Geoscience and Remote Sensing
JF - IEEE Transactions on Geoscience and Remote Sensing
M1 - 5613610
ER -