TY - JOUR
T1 - Spatial-Spectral Structured Sparse Low-Rank Representation for Hyperspectral Image Super-Resolution
AU - Xue, Jize
AU - Zhao, Yong Qiang
AU - Bu, Yuanyang
AU - Liao, Wenzhi
AU - Chan, Jonathan Cheung Wai
AU - Philips, Wilfried
N1 - Publisher Copyright:
© 1992-2012 IEEE.
PY - 2021
Y1 - 2021
N2 - Hyperspectral image super-resolution by fusing high-resolution multispectral image (HR-MSI) and low-resolution hyperspectral image (LR-HSI) aims at reconstructing high resolution spatial-spectral information of the scene. Existing methods mostly based on spectral unmixing and sparse representation are often developed from a low-level vision task perspective, they cannot sufficiently make use of the spatial and spectral priors available from higher-level analysis. To this issue, this paper proposes a novel HSI super-resolution method that fully considers the spatial/spectral subspace low-rank relationships between available HR-MSI/LR-HSI and latent HSI. Specifically, it relies on a new subspace clustering method named 'structured sparse low-rank representation' (SSLRR), to represent the data samples as linear combinations of the bases in a given dictionary, where the sparse structure is induced by low-rank factorization for the affinity matrix. Then we exploit the proposed SSLRR model to learn the SSLRR along spatial/spectral domain from the MSI/HSI inputs. By using the learned spatial and spectral low-rank structures, we formulate the proposed HSI super-resolution model as a variational optimization problem, which can be readily solved by the ADMM algorithm. Compared with state-of-the-art hyperspectral super-resolution methods, the proposed method shows better performance on three benchmark datasets in terms of both visual and quantitative evaluation.
AB - Hyperspectral image super-resolution by fusing high-resolution multispectral image (HR-MSI) and low-resolution hyperspectral image (LR-HSI) aims at reconstructing high resolution spatial-spectral information of the scene. Existing methods mostly based on spectral unmixing and sparse representation are often developed from a low-level vision task perspective, they cannot sufficiently make use of the spatial and spectral priors available from higher-level analysis. To this issue, this paper proposes a novel HSI super-resolution method that fully considers the spatial/spectral subspace low-rank relationships between available HR-MSI/LR-HSI and latent HSI. Specifically, it relies on a new subspace clustering method named 'structured sparse low-rank representation' (SSLRR), to represent the data samples as linear combinations of the bases in a given dictionary, where the sparse structure is induced by low-rank factorization for the affinity matrix. Then we exploit the proposed SSLRR model to learn the SSLRR along spatial/spectral domain from the MSI/HSI inputs. By using the learned spatial and spectral low-rank structures, we formulate the proposed HSI super-resolution model as a variational optimization problem, which can be readily solved by the ADMM algorithm. Compared with state-of-the-art hyperspectral super-resolution methods, the proposed method shows better performance on three benchmark datasets in terms of both visual and quantitative evaluation.
KW - Hyperspectral and multispectral images fusion
KW - affinity matrix
KW - low-rank representation
KW - structured sparse
KW - subspace low-rank recovery
UR - http://www.scopus.com/inward/record.url?scp=85100914953&partnerID=8YFLogxK
U2 - 10.1109/TIP.2021.3058590
DO - 10.1109/TIP.2021.3058590
M3 - 文章
C2 - 33596175
AN - SCOPUS:85100914953
SN - 1057-7149
VL - 30
SP - 3084
EP - 3097
JO - IEEE Transactions on Image Processing
JF - IEEE Transactions on Image Processing
M1 - 9356457
ER -