TY - JOUR
T1 - Less gets more attention
T2 - A novel human-centered MR remote collaboration assembly method with information recommendation and visual enhancement
AU - Yan, Yuxiang
AU - Bai, Xiaoliang
AU - He, Weiping
AU - Wang, Shuxia
AU - Zhang, Xiang Yu
AU - Liu, Liwei
AU - Yu, Qing
AU - Zhang, Bing
N1 - Publisher Copyright:
© 2024 Elsevier Ltd
PY - 2025/4
Y1 - 2025/4
N2 - Mixed reality remote collaboration assembly is a type of computer-supported collaborative assembly work that uses mixed reality technology to enable spatial information and collaboration status sharing among geographically distributed collaborators, including remote experts and local users. However, due to the abundance of mixed virtual and real-world information in the MR space and the limitations imposed by narrow field-of-view augmented reality (AR) glasses, users face challenges in effectively focusing on relevant and valuable visual information. Our research aims to enhance users' visual attention to critical guidance information in MR collaborative assembly tasks, thereby improving the clear expression of instructions and facilitating the transmission of collaborative intention. We developed the Information Recommendation and Visual Enhancement System (IRVES) through an assembly process information hierarchy division mechanism, a content-based information recommendation system, and a gesture interaction-based information visual enhancement method. IRVES can leverage the guidance expertise and preferences of remote experts to recommend information to filter out irrelevant information and present the key information that the remote expert conveys to the local user in an intuitive way through visual enhancement. We conducted a user study experiment of a collaborative assembly task of a small engine in a laboratory environment. The experimental results indicate that IRVES outperforms traditional MR remote collaborative assembly methods (VG3DV) in terms of time performance, operational errors, cognitive performance and user experience. Our research contributes a human-centered information visualization approach for remote experts and local users, providing a novel method and idea for designing visual information interfaces in MR remote collaboration assembly tasks.
AB - Mixed reality remote collaboration assembly is a type of computer-supported collaborative assembly work that uses mixed reality technology to enable spatial information and collaboration status sharing among geographically distributed collaborators, including remote experts and local users. However, due to the abundance of mixed virtual and real-world information in the MR space and the limitations imposed by narrow field-of-view augmented reality (AR) glasses, users face challenges in effectively focusing on relevant and valuable visual information. Our research aims to enhance users' visual attention to critical guidance information in MR collaborative assembly tasks, thereby improving the clear expression of instructions and facilitating the transmission of collaborative intention. We developed the Information Recommendation and Visual Enhancement System (IRVES) through an assembly process information hierarchy division mechanism, a content-based information recommendation system, and a gesture interaction-based information visual enhancement method. IRVES can leverage the guidance expertise and preferences of remote experts to recommend information to filter out irrelevant information and present the key information that the remote expert conveys to the local user in an intuitive way through visual enhancement. We conducted a user study experiment of a collaborative assembly task of a small engine in a laboratory environment. The experimental results indicate that IRVES outperforms traditional MR remote collaborative assembly methods (VG3DV) in terms of time performance, operational errors, cognitive performance and user experience. Our research contributes a human-centered information visualization approach for remote experts and local users, providing a novel method and idea for designing visual information interfaces in MR remote collaboration assembly tasks.
KW - Attention information recommendation
KW - Cognition
KW - Hand gesture
KW - MR remote collaborative assembly
KW - Vision enhancement
UR - http://www.scopus.com/inward/record.url?scp=85208595157&partnerID=8YFLogxK
U2 - 10.1016/j.rcim.2024.102898
DO - 10.1016/j.rcim.2024.102898
M3 - 文章
AN - SCOPUS:85208595157
SN - 0736-5845
VL - 92
JO - Robotics and Computer-Integrated Manufacturing
JF - Robotics and Computer-Integrated Manufacturing
M1 - 102898
ER -