TY - JOUR
T1 - Uncertainty estimation in HDR imaging with Bayesian neural networks
AU - Yan, Qingsen
AU - Wang, Haishen
AU - Ma, Yifan
AU - Liu, Yuhang
AU - Dong, Wei
AU - Woźniak, Marcin
AU - Zhang, Yanning
N1 - Publisher Copyright:
© 2024 Elsevier Ltd
PY - 2024/12
Y1 - 2024/12
N2 - The goal of high dynamic range (HDR) imaging is to estimate potential high-quality images from multi-exposed low dynamic range (LDR) inputs. Intuitively, there exist various possible HDR images corresponding to given LDR inputs, which results in uncertainty in the estimated results. However, most existing HDR imaging methods employ l1 or l2 loss only to provide one possible estimation from various possible solutions, which fails to model the uncertainty, and thus lacks high-frequency details. In this work, we design Bayesian neural networks to capture the uncertainty, which can model one-to-many relations and provide various possible solutions. Concretely, we propose a Variational Bayesian Layer by leveraging a hierarchical prior on the network weights and inferring a new joint posterior, which is utilized to model uncertainty in high-frequency details (e.g., textures), and model uncertainty in semantic information (e.g., ghost areas), respectively. By leveraging Bayesian framework, the proposed method can provide various potential high-quality estimations, especially in high-frequency details. Experiments on different datasets show that the proposed method enables sampling possible HDR imaging, and the consensus estimate achieves state-of-the-art quantitative and qualitative results.
AB - The goal of high dynamic range (HDR) imaging is to estimate potential high-quality images from multi-exposed low dynamic range (LDR) inputs. Intuitively, there exist various possible HDR images corresponding to given LDR inputs, which results in uncertainty in the estimated results. However, most existing HDR imaging methods employ l1 or l2 loss only to provide one possible estimation from various possible solutions, which fails to model the uncertainty, and thus lacks high-frequency details. In this work, we design Bayesian neural networks to capture the uncertainty, which can model one-to-many relations and provide various possible solutions. Concretely, we propose a Variational Bayesian Layer by leveraging a hierarchical prior on the network weights and inferring a new joint posterior, which is utilized to model uncertainty in high-frequency details (e.g., textures), and model uncertainty in semantic information (e.g., ghost areas), respectively. By leveraging Bayesian framework, the proposed method can provide various potential high-quality estimations, especially in high-frequency details. Experiments on different datasets show that the proposed method enables sampling possible HDR imaging, and the consensus estimate achieves state-of-the-art quantitative and qualitative results.
KW - Deep learning
KW - Exposure fusion
KW - Ghosting artifacts
KW - High dynamic range imaging
KW - Semantic information
KW - Uncertainty
UR - http://www.scopus.com/inward/record.url?scp=85199329327&partnerID=8YFLogxK
U2 - 10.1016/j.patcog.2024.110802
DO - 10.1016/j.patcog.2024.110802
M3 - 文章
AN - SCOPUS:85199329327
SN - 0031-3203
VL - 156
JO - Pattern Recognition
JF - Pattern Recognition
M1 - 110802
ER -