Skip to main navigation Skip to search Skip to main content

Robust-R1: Degradation-Aware Reasoning for Robust Visual Understanding

  • Jiaqi Tang
  • , Jianmin Chen
  • , Wei Wei
  • , Xiaogang Xu
  • , Runtao Liu
  • , Xiangyu Wu
  • , Qipeng Xie
  • , Jiafei Wu
  • , Lei Zhang
  • , Qifeng Chen
  • Hong Kong University of Science and Technology
  • Northwestern Polytechnical University Xian
  • Chinese University of Hong Kong
  • Nanjing University of Science and Technology
  • The University of Hong Kong

Research output: Contribution to journalConference articlepeer-review

Abstract

Multimodal Large Language Models struggle to maintain reliable performance under extreme real-world visual degradations, which impede their practical robustness. Existing robust MLLMs predominantly rely on implicit training/adaptation that focuses solely on visual encoder generalization, suffering from limited interpretability and isolated optimization. To overcome these limitations, we propose Robust-R1, a novel framework that explicitly models visual degradations through structured reasoning chains. Our approach integrates: (i) supervised fine-tuning for degradation-aware reasoning foundations, (ii) reward-driven alignment for accurately perceiving degradation parameters, and (iii) dynamic reasoning depth scaling adapted to degradation intensity. To facilitate this approach, we introduce a specialized 11K dataset featuring realistic degradations synthesized across four critical real-world visual processing stages, each annotated with structured chains connecting degradation parameters, perceptual influence, pristine semantic reasoning chain, and conclusion. Comprehensive evaluations demonstrate state-of-the-art robustness: Robust-R1 outperforms all general and robust baselines on the real-world degradation benchmark R-Bench, while maintaining superior anti-degradation performance under multi-intensity adversarial degradations on MMMB, MMStar, and RealWorldQA.

Original languageEnglish
Pages (from-to)9421-9429
Number of pages9
JournalProceedings of the AAAI Conference on Artificial Intelligence
Volume40
Issue number11
DOIs
StatePublished - 2026
Event40th AAAI Conference on Artificial Intelligence, AAAI 2026 - Singapore, Singapore
Duration: 20 Jan 202627 Jan 2026

Fingerprint

Dive into the research topics of 'Robust-R1: Degradation-Aware Reasoning for Robust Visual Understanding'. Together they form a unique fingerprint.

Cite this