Skip to main navigation Skip to search Skip to main content

Degradation-Robust and Temporally Consistent Infrared–Visible Video Fusion via One-Step Diffusion Framework

  • Songcheng Du
  • , Haoyuan Xu
  • , Xingyuan Li
  • , Yang Zou
  • , Jinyuan Liu
  • , Yunpeng Bai
  • , Ying Li
  • Northwestern Polytechnical University Xian
  • Dalian University of Technology
  • Zhejiang University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

Infrared–visible video fusion aims to integrate complementary thermal and visual information to produce stable and informative fused videos for real-world applications. While recent advances have achieved remarkable progress in image-level fusion, extending these methods to dynamic video scenarios remains challenging. Existing video fusion approaches typically adopt a ‘temporal-first’ processing strategy, where temporal modeling is performed within each modality before cross-modal fusion. However, such designs may become vulnerable to modality-specific degradations, including low illumination in visible videos and noise or flicker in infrared sequences, which often lead to unreliable motion estimation and temporally inconsistent fusion results. To address this limitation, we advocate a ‘fusion-first’ strategy and propose DRT-VF, a unified degradation-robust and temporally consistent infrared–visible video fusion method built upon a one-step diffusion architecture with a two-stage progressive training strategy. In Stage I, a Modality-Collaborative Attention module integrates complementary infrared and visible cues to establish robust intra-frame fusion representations. In Stage II, temporal consistency is modeled through a hierarchical design consisting of a Global Temporal Consistency module and a Local Motion Compensation module, which jointly enhance global temporal consistency and refine motion-sensitive regions. Extensive experiments demonstrate that DRT-VF improves temporal stability while preserving fine structural details.

Original languageEnglish
Title of host publicationComputer Vision – ECCV 2026 - 19th European Conference, 2026, Proceedings
EditorsPaolo Favaro, Zuzana Kukelova, Atsuto Maki, Anna Rohrbach, Konrad Schindler, Federico Tombari
PublisherSpringer Science and Business Media Deutschland GmbH
Pages279-298
Number of pages20
ISBN (Print)9783032373823
DOIs
StatePublished - 2026
Event19th European Conference on Computer Vision, ECCV 2026 - Malmö, Sweden
Duration: 8 Sep 2026 → 12 Sep 2026

Publication series

NameLecture Notes in Computer Science
Volume17016 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference19th European Conference on Computer Vision, ECCV 2026
Country/TerritorySweden
CityMalmö
Period8/09/26 → 12/09/26

Keywords

  • Infrared–Visible Video Fusion
  • Low-Level Vision
  • Multimodal Image Fusion

Fingerprint

Dive into the research topics of 'Degradation-Robust and Temporally Consistent Infrared–Visible Video Fusion via One-Step Diffusion Framework'. Together they form a unique fingerprint.

Cite this