Unsupervised Spectral Demosaicing With Lightweight Spectral Attention Networks

Kai Feng, Haijin Zeng, Yongqiang Zhao, Seong G. Kong, Yuanyang Bu

科研成果: 期刊稿件文章同行评审

12 引用 (Scopus)

摘要

This paper presents a deep learning-based spectral demosaicing technique trained in an unsupervised manner. Many existing deep learning-based techniques relying on supervised learning with synthetic images, often underperform on real-world images, especially as the number of spectral bands increases. This paper presents a comprehensive unsupervised spectral demosaicing (USD) framework based on the characteristics of spectral mosaic images. This framework encompasses a training method, model structure, transformation strategy, and a well-fitted model selection strategy. To enable the network to dynamically model spectral correlation while maintaining a compact parameter space, we reduce the complexity and parameters of the spectral attention module. This is achieved by dividing the spectral attention tensor into spectral attention matrices in the spatial dimension and spectral attention vector in the channel dimension. This paper also presents {Mosaic {25}} , a real 25-band hyperspectral mosaic image dataset featuring various objects, illuminations, and materials for benchmarking purposes. Extensive experiments on both synthetic and real-world datasets demonstrate that the proposed method outperforms conventional unsupervised methods in terms of spatial distortion suppression, spectral fidelity, robustness, and computational cost. Our code and dataset are publicly available at https://github.com/polwork/Unsupervised-Spectral-Demosaicing.

源语言英语
页(从-至)1655-1669
页数15
期刊IEEE Transactions on Image Processing
33
DOI
出版状态已出版 - 2024

指纹

探究 'Unsupervised Spectral Demosaicing With Lightweight Spectral Attention Networks' 的科研主题。它们共同构成独一无二的指纹。

引用此