DualBLN: Dual Branch LUT-Aware Network for Real-Time Image Retouching

Xiang Zhang, Chengzhe Lu, Dawei Yan, Wei Dong, Qingsen Yan

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The 3D Lookup Table (3D LUT) is an efficient tool for image retouching tasks, which models non-linear 3D color transformations by sparsely sampling them into a discrete 3D lattice. We propose DualBLN (Dual Branch LUT-aware Network) which innovatively incorporates the data representing the color transformation of 3D LUT into the real-time retouching process, which forces the network to learn the adaptive weights and the multiple 3D LUTs with strong representation capability. The estimated adaptive weights not only consider the content of the raw input but also use the information of the learned 3D LUTs. Specifically, the network contains two branches for feature extraction from the input image and 3D LUTs, to regard the information of the image and the 3D LUTs, and generate the precise LUT fusion weights. In addition, to better integrate the features of the input image and the learned 3D LUTs, we employ bilinear pooling to solve the problem of feature information loss that occurs when fusing features from the dual branch network, avoiding the feature distortion caused by direct concatenation or summation. Extensive experiments on several datasets demonstrate the effectiveness of our work, which is also efficient in processing high-resolution images. Our approach is not limited to image retouching tasks, but can also be applied to other pairwise learning-based tasks with fairly good generality. Our code is available at https://github.com/120326/DualBLN.

Original languageEnglish
Title of host publicationComputer Vision – ACCV 2022 - 16th Asian Conference on Computer Vision, Proceedings
EditorsLei Wang, Juergen Gall, Tat-Jun Chin, Imari Sato, Rama Chellappa
PublisherSpringer Science and Business Media Deutschland GmbH
Pages173-189
Number of pages17
ISBN (Print)9783031263125
DOIs
StatePublished - 2023
Event16th Asian Conference on Computer Vision, ACCV 2022 - Macao, China
Duration: 4 Dec 20228 Dec 2022

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume13843 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference16th Asian Conference on Computer Vision, ACCV 2022
Country/TerritoryChina
CityMacao
Period4/12/228/12/22

Keywords

  • 3D lookup table
  • Color enhancement
  • Photo retouching

Fingerprint

Dive into the research topics of 'DualBLN: Dual Branch LUT-Aware Network for Real-Time Image Retouching'. Together they form a unique fingerprint.

Cite this