TY - GEN
T1 - DiffLight
T2 - 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2024
AU - Feng, Yixu
AU - Hou, Shuo
AU - Lin, Haotian
AU - Zhu, Yu
AU - Wu, Peng
AU - Dong, Wei
AU - Sun, Jinqiu
AU - Yan, Qingsen
AU - Zhang, Yanning
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - The Low Light Image Enhancement (LLIE) task has been a hotspot in low-level computer vision research. The camera sensor can only capture a small amount of ambient light signal in low-light condition, resulting in significant noise black pseudo artifacts in images, which not only degrade visual quality but also affect the performance of down-stream visual tasks. However, current methods often produce overly smoothed and distorted results, or introduce strong noise artifacts. Moreover, for recent UHD high-definition low-light images, due to GPU memory limitations, LLIE must be conducted in patches, leading to block artifacts. Faced with these challenges, we propose a dual-branch pipeline called DiffLight. Specifically, it consists of the Denoising Enhancement (DE) branch and the Detail Preservation (DP) branch. The DE-branch adopts a combination of DiffIR and LEDNet to reduce noise and enhance brightness, while the DP-branch utilizes a novel Light Full-Former (LFF) method, which comprises 20 Full-Attention (LFA) modules to preserve full-scale image details. To tackle block artifacts, we further introduce Progressive Patch Fusion (PPF) for patch fusion. Experimental results demonstrate that our approach is high-ranked in the CVPR2024 NTIRE Low Light Enhancement challenge and produced state-of-the (SOTA) results on other datasets.
AB - The Low Light Image Enhancement (LLIE) task has been a hotspot in low-level computer vision research. The camera sensor can only capture a small amount of ambient light signal in low-light condition, resulting in significant noise black pseudo artifacts in images, which not only degrade visual quality but also affect the performance of down-stream visual tasks. However, current methods often produce overly smoothed and distorted results, or introduce strong noise artifacts. Moreover, for recent UHD high-definition low-light images, due to GPU memory limitations, LLIE must be conducted in patches, leading to block artifacts. Faced with these challenges, we propose a dual-branch pipeline called DiffLight. Specifically, it consists of the Denoising Enhancement (DE) branch and the Detail Preservation (DP) branch. The DE-branch adopts a combination of DiffIR and LEDNet to reduce noise and enhance brightness, while the DP-branch utilizes a novel Light Full-Former (LFF) method, which comprises 20 Full-Attention (LFA) modules to preserve full-scale image details. To tackle block artifacts, we further introduce Progressive Patch Fusion (PPF) for patch fusion. Experimental results demonstrate that our approach is high-ranked in the CVPR2024 NTIRE Low Light Enhancement challenge and produced state-of-the (SOTA) results on other datasets.
KW - Diffusion
KW - Low Light Enhancement
KW - Low-level Task
KW - Transformer
UR - http://www.scopus.com/inward/record.url?scp=85199404042&partnerID=8YFLogxK
U2 - 10.1109/CVPRW63382.2024.00619
DO - 10.1109/CVPRW63382.2024.00619
M3 - 会议稿件
AN - SCOPUS:85199404042
T3 - IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops
SP - 6143
EP - 6152
BT - Proceedings - 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2024
PB - IEEE Computer Society
Y2 - 16 June 2024 through 22 June 2024
ER -