TY - GEN
T1 - Multi-scale spatial adaptive kernel selection and feature modulation network for lightweight single image super-resolution
AU - Liu, Bingzan
AU - Chen, Hongyu
AU - Ning, Xin
N1 - Publisher Copyright:
© 2024 Technical Committee on Control Theory, Chinese Association of Automation.
PY - 2024
Y1 - 2024
N2 - Although, numerous methods have proposed to improve the quality and running-time of single image super-resolution (SR) reconstruction tasks, most of them cannot be deployed on edge devices because of the huge computation consumption and long running-time. In this paper, a lightweight SR method named multi-scale spatial adaptive kernel selection and feature modulation network (MKSFMN) is proposed to address such problems, efficiently. In detail, a global-to-local feature extraction module (AFHEM) like transformer is proposed, which can realize long range dependence and capture high-frequency information. Within it, the spatially-adaptive kernel selection and feature modulation module (SKFM) is introduced to realize channel mixer, dynamic spatial kernel selection and feature modulation in adaptation. What's more, by applying pixel attention, an enhanced convolutional channel mixer (ECCM) and a multi-scale progressive feature extraction module (MPEFM). Extensive experimental results show that the proposed method is outperforms in PSNR, SSIM, parameters and running-time, which is suitable for deploying on edge devices.
AB - Although, numerous methods have proposed to improve the quality and running-time of single image super-resolution (SR) reconstruction tasks, most of them cannot be deployed on edge devices because of the huge computation consumption and long running-time. In this paper, a lightweight SR method named multi-scale spatial adaptive kernel selection and feature modulation network (MKSFMN) is proposed to address such problems, efficiently. In detail, a global-to-local feature extraction module (AFHEM) like transformer is proposed, which can realize long range dependence and capture high-frequency information. Within it, the spatially-adaptive kernel selection and feature modulation module (SKFM) is introduced to realize channel mixer, dynamic spatial kernel selection and feature modulation in adaptation. What's more, by applying pixel attention, an enhanced convolutional channel mixer (ECCM) and a multi-scale progressive feature extraction module (MPEFM). Extensive experimental results show that the proposed method is outperforms in PSNR, SSIM, parameters and running-time, which is suitable for deploying on edge devices.
KW - adaptive feature modulation
KW - global-to-local feature extraction
KW - Lightweight single image super-resolution
KW - multi-scale spatial adaptive kernel selection
UR - http://www.scopus.com/inward/record.url?scp=85205507569&partnerID=8YFLogxK
U2 - 10.23919/CCC63176.2024.10662092
DO - 10.23919/CCC63176.2024.10662092
M3 - 会议稿件
AN - SCOPUS:85205507569
T3 - Chinese Control Conference, CCC
SP - 7468
EP - 7473
BT - Proceedings of the 43rd Chinese Control Conference, CCC 2024
A2 - Na, Jing
A2 - Sun, Jian
PB - IEEE Computer Society
T2 - 43rd Chinese Control Conference, CCC 2024
Y2 - 28 July 2024 through 31 July 2024
ER -