A Double-stream Exchange Transformer Network for Intrinsic Image Decomposition

Feng Zhang, Xiaoyue Jiang, Zhaoqiang Xia, Moncef Gabbouj, Jinye Peng, Xiaoyi Feng

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Intrinsic image decomposition separates the input image into several layers which reflect the attributes of the scene. In this paper, we present a double-stream exchange transformer network for intrinsic image decomposition, in which an independent and interrelated relationship is built between reflectance and shading. There are two core designs in the double-stream exchange transformer network (DSETNet). First, we propose a novel exchange transformer block, which performs the information exchange and reconstruction between reflectance and shading components in a window-based self-attention. Second, a residual structure is added into the exchange transformer block to form a residual exchange transformer block to eliminate artifacts caused by local window areas. We predict reflectance and shading constraint relationship between reflectance and shading is established through residual exchange transformer block. The evaluation results on two real and synthetic public datasets BOLD and ShapeNet show that the DSETNet achieves competitive results with other advanced algorithms.

Original languageEnglish
Title of host publicationProceedings - 2022 International Conference on Image Processing and Media Computing, ICIPMC 2022
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages51-55
Number of pages5
ISBN (Electronic)9781665468725
DOIs
StatePublished - 2022
Event2022 International Conference on Image Processing and Media Computing, ICIPMC 2022 - Xi�an, China
Duration: 27 May 202229 May 2022

Publication series

NameProceedings - 2022 International Conference on Image Processing and Media Computing, ICIPMC 2022

Conference

Conference2022 International Conference on Image Processing and Media Computing, ICIPMC 2022
Country/TerritoryChina
CityXi�an
Period27/05/2229/05/22

Keywords

  • double stream structure
  • exchange transformer block
  • intrinsic image decomposition

Fingerprint

Dive into the research topics of 'A Double-stream Exchange Transformer Network for Intrinsic Image Decomposition'. Together they form a unique fingerprint.

Cite this