Research on 3D Gesture Interaction System Based on Leap Motion

Yu Xing Liu, Shu Xia Wang, Guang Yao Xu, Wang Gui Lan, Wei Ping He

科研成果: 期刊稿件文章同行评审

6 引用 (Scopus)

摘要

The rapid development of gesture recognition and the continuous updating of somatosensory devices provide inspiration for 3D gesture interaction; based on Leap Motion gesture recognition and nearest neighbor algorithms, a 3D gesture interaction system is established. Firstly, the theory of gesture design and the theory of interactive gesture design are studied. Based on this, the gesture function and gesture library are designed, and the gesture library is divided into eight gestures. Secondly, the gesture feature extraction is performed to establish the finger key point model and obtain the angle of the gesture feature; then calculate the gesture recognition efficiency of KNN algorithm and SVM algorithm, and KNN improved algorithm achieves better recognition efficiency. Finally, a 3D interactive system is designed, and the gesture is classified into 4 modules, each module having two gesture tasks; 20 people are gathered to extract 1 600 sets of gesture data, and a data analysis of the total sample joint point mean value is conducted. Design a 3D interactive system module, and import 1 600 sets of gesture data in the 3D interactive system created in Unity3D; the interactive design process, user experience analysis and gesture recognition efficiency statistics are completed according to the customized eight gesture driven virtual hands. Through research, it is found that Leap Motion gesture recognition has high recognition efficiency, and the three-dimensional gesture interaction system is fairly innovative.

源语言英语
页(从-至)556-564
页数9
期刊Journal of Graphics
40
3
DOI
出版状态已出版 - 30 6月 2019

指纹

探究 'Research on 3D Gesture Interaction System Based on Leap Motion' 的科研主题。它们共同构成独一无二的指纹。

引用此