Heterogeneous two-stream network with hierarchical feature Prefusion for multispectral pan-sharpening

Dong Wang, Yunpeng Bai, Bendu Bai, Chanyue Wu, Ying Li

科研成果: 书/报告/会议事项章节会议稿件同行评审

7 引用 (Scopus)

摘要

Multispectral (MS) pan-sharpening aims at producing a high spatial resolution (HR) MS image by fusing a single-band HR panchromatic (PAN) image and a corresponding MS image with low spatial resolution. In this paper, we propose a heterogeneous two-stream network (HTSNet) with hierarchical feature prefusion for MS pan-sharpening. The HTSNet employs a heterogeneous group of spatial and spectral streams for spatial and spectral information extraction, respectively. The spatial stream utilizes a 2D CNN for spatial information extraction from the PAN images, and the spectral stream obtains spectral feature cubes from the MS images by a 3D CNN. At the same time, a prefusion module is introduced to prefuse the spatial details with spectral information and transfer information between different streams, which can enhance later processing. In the experiment, the Gaofen-2 satellite dataset is utilized to compare the proposed method with the state-of-the-art MS pan-sharpening methods. Experimental results demonstrate the superiority of our HTSNet in terms of visual effect and quantitative qualities.

源语言英语
主期刊名2021 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2021 - Proceedings
出版商Institute of Electrical and Electronics Engineers Inc.
1845-1849
页数5
ISBN(电子版)9781728176055
DOI
出版状态已出版 - 2021
活动2021 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2021 - Virtual, Toronto, 加拿大
期限: 6 6月 202111 6月 2021

出版系列

姓名ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
2021-June
ISSN(印刷版)1520-6149

会议

会议2021 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2021
国家/地区加拿大
Virtual, Toronto
时期6/06/2111/06/21

指纹

探究 'Heterogeneous two-stream network with hierarchical feature Prefusion for multispectral pan-sharpening' 的科研主题。它们共同构成独一无二的指纹。

引用此