TY - JOUR
T1 - Perception and Decision-Making for Multi‑Modal Interaction Based on Fuzzy Theory in the Dynamic Environment
AU - Zhang, Jie
AU - Wang, Shuxia
AU - He, Weiping
AU - Li, Jianghong
AU - Wu, Shixin
AU - Cao, Zhiwei
AU - Wang, Manxian
N1 - Publisher Copyright:
© 2023 Taylor & Francis Group, LLC.
PY - 2024
Y1 - 2024
N2 - The projection-augmented reality assembly assistance system, which supports natural multi-modal human–computer interaction, has the potential to improve interaction efficiency. However, the effectiveness of the interaction method is compromised by the interference caused by the dynamically changing industrial environment. To address this issue, this study proposed a multi-model interaction model based on fuzzy theory and developed an environment perception decision-making interaction system. This system continuously monitors real-time environment data, evaluates interaction performance, and visually recommends the optimal method to assist users in completing their tasks. A comparative experiment was conducted between the proposed system and a non-environment perception interaction system. The collected data, including interaction success rate, task time, system usability, and user experience, were analyzed. The results demonstrated that the proposed system effectively enhances the adaptability and comfort of computer systems in complex environments and improves communication efficiency between humans and machines.
AB - The projection-augmented reality assembly assistance system, which supports natural multi-modal human–computer interaction, has the potential to improve interaction efficiency. However, the effectiveness of the interaction method is compromised by the interference caused by the dynamically changing industrial environment. To address this issue, this study proposed a multi-model interaction model based on fuzzy theory and developed an environment perception decision-making interaction system. This system continuously monitors real-time environment data, evaluates interaction performance, and visually recommends the optimal method to assist users in completing their tasks. A comparative experiment was conducted between the proposed system and a non-environment perception interaction system. The collected data, including interaction success rate, task time, system usability, and user experience, were analyzed. The results demonstrated that the proposed system effectively enhances the adaptability and comfort of computer systems in complex environments and improves communication efficiency between humans and machines.
KW - environment perception
KW - fuzzy theory
KW - human–computer interaction
KW - multi-modal interaction
KW - Projection augmented reality
UR - http://www.scopus.com/inward/record.url?scp=85180884098&partnerID=8YFLogxK
U2 - 10.1080/10447318.2023.2291607
DO - 10.1080/10447318.2023.2291607
M3 - 文章
AN - SCOPUS:85180884098
SN - 1044-7318
VL - 40
SP - 8794
EP - 8808
JO - International Journal of Human-Computer Interaction
JF - International Journal of Human-Computer Interaction
IS - 24
ER -