Assembly training system on HoloLens using embedded algorithm

Yujin Qin, Shuxia Wang, Qiang Zhang, Yao Cheng, Jiaxu Huang, Weiping He

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations

Abstract

In this article, we demonstrate an implementation on Microsoft HoloLens, deep learning supported in the context of object detection. The main aim of the training system is to create the more accurate object detection model for Augmented Reality using deep learning models for image recognition directly on the HoloLens 2. In terms of the object detection approach, a deep learning model called YOLOv5 has been used for the implementation of this system. This article uses the Windows ML API to implement machine learning in augmented reality applications. A simple and easy method of drawing lines between specified 2D coordinates on a canvas is proposed. The module division and development steps of the development of augmented reality training system are given. Our system provides the annotation of augmented object detected and its bounding box via HoloLens. It allows to detect the new object in a few milliseconds. Preliminary results show a great rate of object detection and reasonable detection time.

Original languageEnglish
Title of host publicationThird International Symposium on Computer Engineering and Intelligent Communications, ISCEIC 2022
EditorsXianye Ben
PublisherSPIE
ISBN (Electronic)9781510660298
DOIs
StatePublished - 2023
Event3rd International Symposium on Computer Engineering and Intelligent Communications, ISCEIC 2022 - Xi'an, China
Duration: 16 Sep 202218 Sep 2022

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume12462
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

Conference3rd International Symposium on Computer Engineering and Intelligent Communications, ISCEIC 2022
Country/TerritoryChina
CityXi'an
Period16/09/2218/09/22

Keywords

  • Augmented Reality
  • deep learning
  • detection time
  • Microsoft HoloLens
  • Object detection

Fingerprint

Dive into the research topics of 'Assembly training system on HoloLens using embedded algorithm'. Together they form a unique fingerprint.

Cite this