TY - JOUR
T1 - Diffusion-Augmented Cross-Domain Prototypical Knowledge Distillation for Few-Shot Learning in Hyperspectral Image Classification
AU - Ding, Chen
AU - Zheng, Sirui
AU - Zheng, Mengmeng
AU - Dong, Yizhou
AU - Hua, Wenqiang
AU - Wei, Wei
AU - Zhang, Lei
AU - Zhang, Yanning
N1 - Publisher Copyright:
© 1980-2012 IEEE.
PY - 2025
Y1 - 2025
N2 - Cross-domain few-shot learning (CDFSL) has demonstrated remarkable new class recognition capabilities in hyperspectral image classification (HSIC) tasks. However, existing domain adaptation methods face two critical challenges in the cross-domain feature alignment process: first, the domain shift leads to misaligned feature transfer and diminished classification accuracy, and second, the intraclass feature dispersion and interclass boundary blurring in few-shot tasks result in degraded classification performance for novel classes. Moreover, the impact of redundant and noisy data on model discriminability is rarely considered in existing approaches. To solve these issues, this article proposes a cross-domain FSL HSIC method based on diffusion-augmented prototype knowledge distillation. First, we introduce a diffusion-augmented unsupervised domain adaptation pretraining framework to address the domain shift by performing a domain-adversarial (DA) denoising and reconstruction task using visible source data and masked target data. Second, our dual-branch spatial–spectral attention (DB-SSA) captures global and local spectral–spatial dependencies to enhance feature representation. Then, the proposed global–local prototype knowledge distillation (GL-PKD) performs global prototype alignment while conducting local contrastive learning, addressing feature dispersion and boundary ambiguity. Finally, a dynamic learning strategy prioritizes feature alignment early, gradually strengthens classification supervision through adaptive loss weights, and incorporates a signal-to-noise ratio (SNR)-enhanced loss to effectively mitigate noise interference. The experimental results on three HSI datasets demonstrate the superiority and effectiveness of the proposed cross-domain FSL based on diffusion-augmented prototype knowledge distillation (DAPKD-CFSL).
AB - Cross-domain few-shot learning (CDFSL) has demonstrated remarkable new class recognition capabilities in hyperspectral image classification (HSIC) tasks. However, existing domain adaptation methods face two critical challenges in the cross-domain feature alignment process: first, the domain shift leads to misaligned feature transfer and diminished classification accuracy, and second, the intraclass feature dispersion and interclass boundary blurring in few-shot tasks result in degraded classification performance for novel classes. Moreover, the impact of redundant and noisy data on model discriminability is rarely considered in existing approaches. To solve these issues, this article proposes a cross-domain FSL HSIC method based on diffusion-augmented prototype knowledge distillation. First, we introduce a diffusion-augmented unsupervised domain adaptation pretraining framework to address the domain shift by performing a domain-adversarial (DA) denoising and reconstruction task using visible source data and masked target data. Second, our dual-branch spatial–spectral attention (DB-SSA) captures global and local spectral–spatial dependencies to enhance feature representation. Then, the proposed global–local prototype knowledge distillation (GL-PKD) performs global prototype alignment while conducting local contrastive learning, addressing feature dispersion and boundary ambiguity. Finally, a dynamic learning strategy prioritizes feature alignment early, gradually strengthens classification supervision through adaptive loss weights, and incorporates a signal-to-noise ratio (SNR)-enhanced loss to effectively mitigate noise interference. The experimental results on three HSI datasets demonstrate the superiority and effectiveness of the proposed cross-domain FSL based on diffusion-augmented prototype knowledge distillation (DAPKD-CFSL).
KW - Cross domain
KW - diffusion model
KW - few-shot learning (FSL)
KW - hyperspectral image classification (HSIC)
KW - knowledge distillation
KW - prototypical learning
UR - https://www.scopus.com/pages/publications/105009615100
U2 - 10.1109/TGRS.2025.3584804
DO - 10.1109/TGRS.2025.3584804
M3 - 文章
AN - SCOPUS:105009615100
SN - 0196-2892
VL - 63
JO - IEEE Transactions on Geoscience and Remote Sensing
JF - IEEE Transactions on Geoscience and Remote Sensing
M1 - 5518319
ER -