Skip to main navigation Skip to search Skip to main content

RGB-Infrared Paired-Images Generation Based on Feature Disentangle and Cross-Modality Reconstruction

  • Lingfei Li
  • , Shun Zhang
  • , Guanshu Ao
  • , Zunheng Chu
  • , Shaohui Mei
  • Northwestern Polytechnical University Xian

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

3 Scopus citations

Abstract

Infrared image acquisition is extremely challenging due to the huge spend of manpower and material resources. This paper presents a novel approach for generating paired RGB-infrared images by leveraging feature disentanglement and cross-modality reconstruction. The proposed model effectively extracts unique style features and shared content features from input RGB or infrared images and integrates these features to generate synthetic images corresponding to their respective modalities. This method aims to bridge the gap between different imaging modalities. Experimental evaluations were conducted on the ThermalWorld, LLVIP and SYSU-MM01 datasets, demonstrating the superiority of our method over recent image generation networks in terms of generated infrared image quality. The effectiveness of the model is further evidenced by its superior performance in a pedestrian re-identification task.

Original languageEnglish
Title of host publicationIGARSS 2023 - 2023 IEEE International Geoscience and Remote Sensing Symposium, Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages6105-6108
Number of pages4
ISBN (Electronic)9798350320107
DOIs
StatePublished - 2023
Event2023 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2023 - Pasadena, United States
Duration: 16 Jul 202321 Jul 2023

Publication series

NameInternational Geoscience and Remote Sensing Symposium (IGARSS)
Volume2023-July

Conference

Conference2023 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2023
Country/TerritoryUnited States
CityPasadena
Period16/07/2321/07/23

Keywords

  • Feature Disentanglement and Reconstruction
  • Generative Adversarial Networks
  • Image Generation

Fingerprint

Dive into the research topics of 'RGB-Infrared Paired-Images Generation Based on Feature Disentangle and Cross-Modality Reconstruction'. Together they form a unique fingerprint.

Cite this