跳到主要导航 跳到搜索 跳到主要内容

Degradation-Robust and Temporally Consistent Infrared–Visible Video Fusion via One-Step Diffusion Framework

  • Songcheng Du
  • , Haoyuan Xu
  • , Xingyuan Li
  • , Yang Zou
  • , Jinyuan Liu
  • , Yunpeng Bai
  • , Ying Li
  • Northwestern Polytechnical University Xian
  • Dalian University of Technology
  • Zhejiang University

科研成果: 书/报告/会议事项章节 › 会议稿件 › 同行评审

摘要

Infrared–visible video fusion aims to integrate complementary thermal and visual information to produce stable and informative fused videos for real-world applications. While recent advances have achieved remarkable progress in image-level fusion, extending these methods to dynamic video scenarios remains challenging. Existing video fusion approaches typically adopt a ‘temporal-first’ processing strategy, where temporal modeling is performed within each modality before cross-modal fusion. However, such designs may become vulnerable to modality-specific degradations, including low illumination in visible videos and noise or flicker in infrared sequences, which often lead to unreliable motion estimation and temporally inconsistent fusion results. To address this limitation, we advocate a ‘fusion-first’ strategy and propose DRT-VF, a unified degradation-robust and temporally consistent infrared–visible video fusion method built upon a one-step diffusion architecture with a two-stage progressive training strategy. In Stage I, a Modality-Collaborative Attention module integrates complementary infrared and visible cues to establish robust intra-frame fusion representations. In Stage II, temporal consistency is modeled through a hierarchical design consisting of a Global Temporal Consistency module and a Local Motion Compensation module, which jointly enhance global temporal consistency and refine motion-sensitive regions. Extensive experiments demonstrate that DRT-VF improves temporal stability while preserving fine structural details.

源语言英语
主期刊名Computer Vision – ECCV 2026 - 19th European Conference, 2026, Proceedings
编辑Paolo Favaro, Zuzana Kukelova, Atsuto Maki, Anna Rohrbach, Konrad Schindler, Federico Tombari
出版商Springer Science and Business Media Deutschland GmbH
页279-298
页数20
ISBN(印刷版)9783032373823
DOI
出版状态已出版 - 2026
活动19th European Conference on Computer Vision, ECCV 2026 - Malmö, 瑞典
期限: 8 9月 2026 → 12 9月 2026

丛书

姓名Lecture Notes in Computer Science
卷17016 LNCS
ISSN(印刷版)0302-9743
ISSN(电子版)1611-3349

会议

会议19th European Conference on Computer Vision, ECCV 2026
国家/地区瑞典
市Malmö
时期8/09/26 → 12/09/26

学术指纹

探究 'Degradation-Robust and Temporally Consistent Infrared–Visible Video Fusion via One-Step Diffusion Framework' 的科研主题。它们共同构成独一无二的学术指纹。

引用此