Reconstructing Hyperspectral Images from RGB Inputs Based on Intrinsic Image Decomposition

Nan Wang, Shaohui Mei, Yifan Zhang, Bowei Zhang, Mingyang Ma, Xiangqing Zhang

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

Spectral super-resolution (SR), which generally reconstructs hyperspectral images (HSIs) from RGB inputs, has attracted lots of attention recently. In this paper, a spectral SR algorithm based on intrinsic image decomposition (IID) is proposed, in which RGB images are decomposed into reflectance images and shading images to fully explore RGB features for HSI reconstruction. Considering that features of the reflectance image are only related to the material of objects, the sparsity of material reflectivity is used to reconstruct the reflectance image of HSI. Moreover, an convonlutional neural network (CNN) is constructed to reconstruct shading parts of HSI. Finally, these two reconstructed results are fused to generate the high spectral resolution HSI and an enhancement network is also designed to further improve the recontruction performance. Experimental results with two benchmark datasets, ICVL and CAVE, demonstrate that the performance of the proposed algorithm is superior to several state-of-the-art spectral SR algorithms.

Original languageEnglish
Title of host publicationIGARSS 2022 - 2022 IEEE International Geoscience and Remote Sensing Symposium
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages2374-2377
Number of pages4
ISBN (Electronic)9781665427920
DOIs
StatePublished - 2022
Event2022 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2022 - Kuala Lumpur, Malaysia
Duration: 17 Jul 202222 Jul 2022

Publication series

NameInternational Geoscience and Remote Sensing Symposium (IGARSS)
Volume2022-July

Conference

Conference2022 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2022
Country/TerritoryMalaysia
CityKuala Lumpur
Period17/07/2222/07/22

Keywords

  • Convolutional neural network
  • Hyperspectral
  • Intrinsic image decomposition
  • Super-resolution

Fingerprint

Dive into the research topics of 'Reconstructing Hyperspectral Images from RGB Inputs Based on Intrinsic Image Decomposition'. Together they form a unique fingerprint.

Cite this