Skip to main navigation Skip to search Skip to main content

A Grouping-Based Spectral Reconstruction Network Through Frequency-Domain Attention

  • Nan Wang
  • , Yifan Zhang
  • , Shaohui Mei
  • , Chengjin Liu
  • , Duo Zhan
  • Northwestern Polytechnical University Xian

Research output: Contribution to journalArticlepeer-review

Abstract

To break through the hardware limitations, spectral super-resolution (SSR) is an effective way to reconstruct hyperspectral images (HSIs) from RGB images. However, current methods tend to recover tens of hundreds of bands from the only three channels of RGB images, which ignores the spectral correlations and distinguished high-frequency (HF)/low-frequency (LF) spatial patterns, resulting in inconsiderable reconstruction. In this article, a novel grouping-based spectral reconstruction network (GBSRNet) is proposed, in which the complex entire image reconstruction is separated into a number of subimage reconstructions through adopting a divide-and-conquer strategy. Specifically, for each subreconstruction, a spatial feature reconstruction module (SFRM) is proposed for discriminative learning of HF/LF spatial patterns through integrating a parallel Transformer with the Fourier transform to disentangle the spatial features. Thus, more precise representations of distinguished HF/LF spatial counterparts can be obtained. Furthermore, to improve the spectral fidelity, a spectral feature enhancement module (SFEM) incorporated with local and global learning is designed to efficiently enhance the local self-similarities and global diversities of spectral features. Comprehensive experiments on several datasets illustrate that the newly proposed GBSRNet clearly outperforms some state-of-the-art SSR methods, generating HSIs from an RGB image with better spatial quality and spectral fidelity.

Original languageEnglish
Article number5529314
JournalIEEE Transactions on Geoscience and Remote Sensing
Volume63
DOIs
StatePublished - 2025

Keywords

  • Attention mechanism
  • Fourier transform
  • spectral grouping
  • spectral super-resolution (SSR)

Fingerprint

Dive into the research topics of 'A Grouping-Based Spectral Reconstruction Network Through Frequency-Domain Attention'. Together they form a unique fingerprint.

Cite this