HL-HDR: Multi-Exposure High Dynamic Range Reconstruction with High-Low Frequency Decomposition

Xiang Zhang, Genggeng Chen, Tao Hu, Kangzhen Yang, Fan Zhang, Qingsen Yan

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Generating high-quality High Dynamic Range (HDR) images in dynamic scenes is particularly challenging. Recent Transformer have been introduced in HDR imaging, demonstrating promising performance, particularly in scenarios involving large-scale motion compared to previous CNN-based methods. However, Transformer-based methods face hurdles capturing local details and come with high computational complexity, hindering further progress. In this paper, inspired by the distinct characteristics of high and low-frequency in image patterns, we propose a Frequency Decomposition Processing Block (FDPB) for ghost-free HDR imaging. In the image reconstruction process, FDPB decouples features into resolution-invariant high-frequency features and resolution-reduced low-frequency features to separately address local and global information. Specifically, considering the characteristics of different frequencies, for the high-frequency components, we design a Local Feature Extractor (LFE) based on CNN to extract local feature maps. Meanwhile, for the low-frequency components, we propose a Global Feature Extractor (GFE) that learns long-range dependencies through carefully designed Transformer modules. Importantly, the downscaled low-frequency features exploit Transformer's remote learning capabilities while substantially reducing self-attention computational costs. By incorporating the FDPB as basic components, we further build a Low/High-Frequency Aware Network (HL-HDR), a hierarchical network to reconstruct high-quality ghost-free HDR images. Extensive experiments on four public datasets confirm the superior performance of the proposed method, both in terms of quantitative and qualitative evaluations.

Original languageEnglish
Title of host publication2024 International Joint Conference on Neural Networks, IJCNN 2024 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798350359312
DOIs
StatePublished - 2024
Event2024 International Joint Conference on Neural Networks, IJCNN 2024 - Yokohama, Japan
Duration: 30 Jun 20245 Jul 2024

Publication series

NameProceedings of the International Joint Conference on Neural Networks

Conference

Conference2024 International Joint Conference on Neural Networks, IJCNN 2024
Country/TerritoryJapan
CityYokohama
Period30/06/245/07/24

Keywords

  • High Dynamic Range
  • High-Low Frequency Decomposition

Fingerprint

Dive into the research topics of 'HL-HDR: Multi-Exposure High Dynamic Range Reconstruction with High-Low Frequency Decomposition'. Together they form a unique fingerprint.

Cite this