DB-GAN: A Low Contrast Image Enhancer Based on NIR-RGB Fusion

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

RGB images captured under haze or over-/under-exposure conditions frequently have low contrast and lack of detail. Due to the limited information in the original image, the majority of enhancement techniques that rely solely on visible information fail to restore the original image satisfactorily. This emphasizes the need for information beyond the visible spectrum. In this paper, we formulate the low contrast image enhancement problem based on near-infrared (NIR)-RGB fusion. A Dual-Branch Generative Adversarial Network (DB-GAN) is designed based on the specific characteristics of NIR-RGB fusion problem. To be specific, with the guidance of the two discriminators that respectively extract information from RGB and NIR images, a U-net based generator generates informative, high-quality fused images. In addition, we create an NIR-RGB dataset with over 1300 aligned image pairs for training the network. Quantitative and qualitative experimental results show the superior performance of our proposed framework.

Original languageEnglish
Title of host publication2022 IEEE 32nd International Workshop on Machine Learning for Signal Processing, MLSP 2022
PublisherIEEE Computer Society
ISBN (Electronic)9781665485470
DOIs
StatePublished - 2022
Event32nd IEEE International Workshop on Machine Learning for Signal Processing, MLSP 2022 - Xi'an, China
Duration: 22 Aug 202225 Aug 2022

Publication series

NameIEEE International Workshop on Machine Learning for Signal Processing, MLSP
Volume2022-August
ISSN (Print)2161-0363
ISSN (Electronic)2161-0371

Conference

Conference32nd IEEE International Workshop on Machine Learning for Signal Processing, MLSP 2022
Country/TerritoryChina
CityXi'an
Period22/08/2225/08/22

Keywords

  • Adversarial Generative Network
  • Image fusion
  • RGB
  • low contrast enhancement
  • near-infrared(NIR)

Fingerprint

Dive into the research topics of 'DB-GAN: A Low Contrast Image Enhancer Based on NIR-RGB Fusion'. Together they form a unique fingerprint.

Cite this