A mixed-reality museum tourism framework based on HMD and fisheye camera

Shaobo Zhang, Wanqing Zhao, Jun Wang, Hangzai Luo, Xiaoyi Feng, Jinye Peng

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

10 Scopus citations

Abstract

Mixed-reality (MR) combines virtual and physical components with display device, which can be used to construct new environments where physical and digital objects co-exist and interact in real time. In this paper, we introduce a MR museum tourism system based popular HMD and fisheye camera, which can provide a richer experience by overlying the virtual model in the real environment. First, object detection and tracking methods are used to identify the real object and to obtain its geometrical information from camera. Then, the orientation relationship between real object and camera is decided to convert them to the same coordinate system. Finally, the corresponding model is rendered in the HMD device. Experiments results show that our proposed system can accurately and stably capture the real objects and render the corresponding virtual model in real time.

Original languageEnglish
Title of host publicationProceedings - VRCAI 2016
Subtitle of host publication15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry
EditorsStephen N. Spencer
PublisherAssociation for Computing Machinery, Inc
Pages47-50
Number of pages4
ISBN (Electronic)9781450346924
DOIs
StatePublished - 3 Dec 2016
Event15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry, VRCAI 2016 - Zhuhai, China
Duration: 3 Dec 20164 Dec 2016

Publication series

NameProceedings - VRCAI 2016: 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry
Volume1

Conference

Conference15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry, VRCAI 2016
Country/TerritoryChina
CityZhuhai
Period3/12/164/12/16

Keywords

  • Head mounted display
  • Mixed-reality
  • Object detection
  • Object tracking

Fingerprint

Dive into the research topics of 'A mixed-reality museum tourism framework based on HMD and fisheye camera'. Together they form a unique fingerprint.

Cite this