Real walking on a virtual campus: A VR-based multimedia visualization and interaction system

Zhen Li, Di Xu, Yanning Zhang

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

6 Scopus citations

Abstract

The rapid development of virtual reality (VR) provides a revolutionary way for multimedia data visualization and interaction. Instead of sitting on a chair and playing with a controller, real walking gives the most natural experience when exploring the virtual world. However, considering both physiology and psychology factors, there are several challenges to achieve high fidelity when walking in a VR world with massive multimedia data. That is, the isometrical mapping is not feasible in most cases, as the real space can be completely different from the virtual world (usually smaller). Moreover, the sound is usually not consistent with visual cues when considering the directions. Therefore in this paper, we present a VR walking system that contains a huge virtual campus with extensive multimedia data, which combines 3D models, animations and stereo sound. To this end, we adopt a VR redirected walking method for the purpose of perception manipulation, and HRTF-based sound system for audio-visual consistency. By wearing a head-mounted display and walking in a small room tracked by our indoor localization algorithm, the user is able to freely explore the whole VR world with high fidelity.

Original languageEnglish
Title of host publicationICCSP 2019 - Proceeding of 2019 the 3rd International Conference on Cryptography, Security and Privacy, with workshop 2019 the 4th International Conference on Multimedia and Image Processing, ICMIP 2019
PublisherAssociation for Computing Machinery
Pages261-266
Number of pages6
ISBN (Electronic)9781450366182
DOIs
StatePublished - 19 Jan 2019
Event3rd International Conference on Cryptography, Security and Privacy, ICCSP 2019 with Workshop 2019 the 4th International Conference on Multimedia and Image Processing, ICMIP 2019 - Kuala Lumpur, Malaysia
Duration: 19 Jan 201921 Jan 2019

Publication series

NameACM International Conference Proceeding Series

Conference

Conference3rd International Conference on Cryptography, Security and Privacy, ICCSP 2019 with Workshop 2019 the 4th International Conference on Multimedia and Image Processing, ICMIP 2019
Country/TerritoryMalaysia
CityKuala Lumpur
Period19/01/1921/01/19

Keywords

  • Audiovisual interaction
  • Indoor localization
  • Multimedia system
  • Redirected walking
  • Virtual reality

Fingerprint

Dive into the research topics of 'Real walking on a virtual campus: A VR-based multimedia visualization and interaction system'. Together they form a unique fingerprint.

Cite this