跳到主要导航 跳到搜索 跳到主要内容

A Multi-Scale Multimodal Fusion Method with Attention Mechanism for Constrained Environments

  • Hao Wang
  • , Tian Xia
  • , Zehan Wang
  • , Pengfei Jiang
  • , Beiya Yang
  • , Haobin Shi
  • Northwestern Polytechnical University Xian

科研成果: 书/报告/会议事项章节会议稿件同行评审

摘要

Multi-Temperature environments in industrial intelligent warehouses facilitate the formation of salt-fog, which degrades the performance of both vision and LiDAR sensors. Thus, the salt-fog severely undermines the reliability of key tasks such as object detection and trajectory prediction. To address this challenge, we propose a Multi-Scale Multi-Modal Fusion Method with Attention Mechanism (MMA). The proposed approach consists of two core modules. First, an attention-based fusion module performs interaction between visual and LiDAR features in a unified feature space, realizing information complementarity across modalities. Second, a multi-scale feature enhancement module reconstructs and strengthens the fused features, alleviating local feature loss and semantic degradation caused by salt-fog interference. In addition, an intelligent warehouse simulation environment with controllable salt-fog intensity and dynamic entities is constructed, and the proposed method is systematically evaluated on two representative downstream tasks: object detection and trajectory prediction. Experimental results demonstrate that MMA significantly improves perception performance and prediction stability in varying downstream tasks. Under severe salt-fog conditions, mAP@50:95 for object detection is improved by 2.9%, and the average displacement error for trajectory prediction is reduced by 30% compared to the baseline.

源语言英语
主期刊名Proceedings - 2026 International Conference on Robotics, Automation and Intelligent Transportation Systems, RAITS 2026
出版商Institute of Electrical and Electronics Engineers Inc.
ISBN(电子版)9798331558079
DOI
出版状态已出版 - 2026
活动2026 International Conference on Robotics, Automation and Intelligent Transportation Systems, RAITS 2026 - Xi'an, 中国
期限: 23 1月 202625 1月 2026

丛书

姓名Proceedings - 2026 International Conference on Robotics, Automation and Intelligent Transportation Systems, RAITS 2026

会议

会议2026 International Conference on Robotics, Automation and Intelligent Transportation Systems, RAITS 2026
国家/地区中国
Xi'an
时期23/01/2625/01/26

学术指纹

探究 'A Multi-Scale Multimodal Fusion Method with Attention Mechanism for Constrained Environments' 的科研主题。它们共同构成独一无二的学术指纹。

引用此