3DGAM: using 3D gesture and CAD models for training on mixed reality remote collaboration

Peng Wang, Xiaoliang Bai, Mark Billinghurst, Shusheng Zhang, Sili Wei, Guangyao Xu, Weiping He, Xiangyu Zhang, Jie Zhang

科研成果: 期刊稿件文章同行评审

52 引用 (Scopus)

摘要

As Virtual Reality(VR), Augmented Reality(AR), Mixed Reality(MR) technology becomes more accessible, it is important to explore VR/AR/MR technologies that can be used for remote collaboration on physical tasks. Previous research has shown that gesture-based interaction is intuitive and expressive for remote collaboration, and using 3D CAD models can provide clear instructions for assembly tasks. In this paper, therefore, we describe a new MR remote collaboration system which combines the use of gesture and CAD models in a complementary manner. The prototype system enables a remote expert in VR to provide instructions based on 3D gesture and CAD models (3DGAM) for a local worker who uses AR to see these instructions. Using this interface, we conducted a formal user study to explore the effect of sharing 3D gesture and CAD models in an assembly training task. We found that the combination of 3D gesture and CAD models can improve remote collaboration on an assembly task with respect to the performance time and user experience. Finally, we provide some conclusions and directions for future research.

源语言英语
页(从-至)31059-31084
页数26
期刊Multimedia Tools and Applications
80
20
DOI
出版状态已出版 - 8月 2021

指纹

探究 '3DGAM: using 3D gesture and CAD models for training on mixed reality remote collaboration' 的科研主题。它们共同构成独一无二的指纹。

引用此