Research on 3D Gesture Interaction System Based on Leap Motion

Yu Xing Liu, Shu Xia Wang, Guang Yao Xu, Wang Gui Lan, Wei Ping He

Research output: Contribution to journalArticlepeer-review

6 Scopus citations

Abstract

The rapid development of gesture recognition and the continuous updating of somatosensory devices provide inspiration for 3D gesture interaction; based on Leap Motion gesture recognition and nearest neighbor algorithms, a 3D gesture interaction system is established. Firstly, the theory of gesture design and the theory of interactive gesture design are studied. Based on this, the gesture function and gesture library are designed, and the gesture library is divided into eight gestures. Secondly, the gesture feature extraction is performed to establish the finger key point model and obtain the angle of the gesture feature; then calculate the gesture recognition efficiency of KNN algorithm and SVM algorithm, and KNN improved algorithm achieves better recognition efficiency. Finally, a 3D interactive system is designed, and the gesture is classified into 4 modules, each module having two gesture tasks; 20 people are gathered to extract 1 600 sets of gesture data, and a data analysis of the total sample joint point mean value is conducted. Design a 3D interactive system module, and import 1 600 sets of gesture data in the 3D interactive system created in Unity3D; the interactive design process, user experience analysis and gesture recognition efficiency statistics are completed according to the customized eight gesture driven virtual hands. Through research, it is found that Leap Motion gesture recognition has high recognition efficiency, and the three-dimensional gesture interaction system is fairly innovative.

Original languageEnglish
Pages (from-to)556-564
Number of pages9
JournalJournal of Graphics
Volume40
Issue number3
DOIs
StatePublished - 30 Jun 2019

Keywords

  • gesture interaction design
  • gesture recognition
  • k-nearest neighbor algorithm recognition
  • Leap Motion

Fingerprint

Dive into the research topics of 'Research on 3D Gesture Interaction System Based on Leap Motion'. Together they form a unique fingerprint.

Cite this