TY - JOUR
T1 - Visible-to-Infrared Image Translation via Disentangled Imaging Attribute Transfer
AU - Han, Zonghao
AU - Ye, Zixiang
AU - Shi, Fangqi
AU - Chen, Zhengtao
AU - He, Kun
AU - Mei, Shaohui
N1 - Publisher Copyright:
© 1980-2012 IEEE.
PY - 2026
Y1 - 2026
N2 - Visible (VI)-to-infrared (IR) image translation aims to synthesize IR images from easily accessible VI acquisitions, offering a cost-effective alternative to expensive IR data collection in remote sensing scenarios. Despite remarkable advances achieved, existing methods still struggle to generate high-fidelity IR images. This limitation stems from their reliance on holistic image-level domain-to-domain mapping, which prioritizes global visual alignment while failing to bridge the gap between the imaging attributes of the two modalities. To tackle this critical issue, we propose a novel disentangled architecture for VI-to-IR image translation, which abandons direct global domain mapping and instead explicitly models the transfer of thermal imaging attributes. Specifically, we first decompose the latent representation of each image into two disentangled components: modality-invariant semantic content and modality-specific imaging attributes. Subsequently, an attribute transfer module is designed to map VI-specific imaging attributes to the IR domain. Finally, the transferred IR attributes and preserved semantic content are fed into a conditional generative adversarial network (cGAN) to synthesize IR images with authentic thermal properties. Furthermore, we adopt a multi-stage end-to-end training paradigm integrated with dedicated hybrid loss functions to ensure stable model convergence and enhance the fidelity of the generated IR images. Extensive experiments conducted on the AVIID, Day-DroneVehicle, and Night-DroneVehicle benchmarks demonstrate that our method outperforms multiple state-of-the-art (SOTA) methods in both quantitative and qualitative evaluations. The source code is available at https://github.com/silver-hzh/VIAT.
AB - Visible (VI)-to-infrared (IR) image translation aims to synthesize IR images from easily accessible VI acquisitions, offering a cost-effective alternative to expensive IR data collection in remote sensing scenarios. Despite remarkable advances achieved, existing methods still struggle to generate high-fidelity IR images. This limitation stems from their reliance on holistic image-level domain-to-domain mapping, which prioritizes global visual alignment while failing to bridge the gap between the imaging attributes of the two modalities. To tackle this critical issue, we propose a novel disentangled architecture for VI-to-IR image translation, which abandons direct global domain mapping and instead explicitly models the transfer of thermal imaging attributes. Specifically, we first decompose the latent representation of each image into two disentangled components: modality-invariant semantic content and modality-specific imaging attributes. Subsequently, an attribute transfer module is designed to map VI-specific imaging attributes to the IR domain. Finally, the transferred IR attributes and preserved semantic content are fed into a conditional generative adversarial network (cGAN) to synthesize IR images with authentic thermal properties. Furthermore, we adopt a multi-stage end-to-end training paradigm integrated with dedicated hybrid loss functions to ensure stable model convergence and enhance the fidelity of the generated IR images. Extensive experiments conducted on the AVIID, Day-DroneVehicle, and Night-DroneVehicle benchmarks demonstrate that our method outperforms multiple state-of-the-art (SOTA) methods in both quantitative and qualitative evaluations. The source code is available at https://github.com/silver-hzh/VIAT.
KW - Generative adversarial network
KW - image-to-image translation
KW - Visible-to-infrared image translation
UR - https://www.scopus.com/pages/publications/105043048748
U2 - 10.1109/TGRS.2026.3707587
DO - 10.1109/TGRS.2026.3707587
M3 - 文章
AN - SCOPUS:105043048748
SN - 0196-2892
JO - IEEE Transactions on Geoscience and Remote Sensing
JF - IEEE Transactions on Geoscience and Remote Sensing
ER -