Perception and Decision-Making for Multi‑Modal Interaction Based on Fuzzy Theory in the Dynamic Environment

Jie Zhang, Shuxia Wang, Weiping He, Jianghong Li, Shixin Wu, Zhiwei Cao, Manxian Wang

Research output: Contribution to journalArticlepeer-review

1 Scopus citations

Abstract

The projection-augmented reality assembly assistance system, which supports natural multi-modal human–computer interaction, has the potential to improve interaction efficiency. However, the effectiveness of the interaction method is compromised by the interference caused by the dynamically changing industrial environment. To address this issue, this study proposed a multi-model interaction model based on fuzzy theory and developed an environment perception decision-making interaction system. This system continuously monitors real-time environment data, evaluates interaction performance, and visually recommends the optimal method to assist users in completing their tasks. A comparative experiment was conducted between the proposed system and a non-environment perception interaction system. The collected data, including interaction success rate, task time, system usability, and user experience, were analyzed. The results demonstrated that the proposed system effectively enhances the adaptability and comfort of computer systems in complex environments and improves communication efficiency between humans and machines.

Original languageEnglish
Pages (from-to)8794-8808
Number of pages15
JournalInternational Journal of Human-Computer Interaction
Volume40
Issue number24
DOIs
StatePublished - 2024

Keywords

  • environment perception
  • fuzzy theory
  • human–computer interaction
  • multi-modal interaction
  • Projection augmented reality

Fingerprint

Dive into the research topics of 'Perception and Decision-Making for Multi‑Modal Interaction Based on Fuzzy Theory in the Dynamic Environment'. Together they form a unique fingerprint.

Cite this