Towards More Effective Interactions: A Hybrid Embodied Interaction Approach in Stereoscopic Displays

Le Liu, Yuhao Wang, Jayandra Raj Shrestha, Kaixing Zhao, Yanning Zhang

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations

Abstract

Head-mounted virtual reality/augmented reality (VR/AR) devices have become prevalent in implementing immersive analytics. However, these devices have certain limitations, such as disconnecting the user from the real working world and possibly causing discomfort. Recently, portable glasses-free stereoscopic display devices have emerged as a potential solution to address these limitations. Unlike head-mounted devices, these displays utilize screens to render the virtual space, resulting in virtual content appearing either inside or outside of the screen. Therefore, designing natural, intuitive, and immersive user interactions in this virtual environment with a physical boundary is crucial for enhancing device usability. This research focuses on developing an effective interaction method for selecting and moving objects within the stereoscopic displays. We propose a hybrid embodied interaction method that leverages gesture controls. Specifically, inside-screen object manipulation is achieved using ray-object intersection and pinch gestures, while outside-screen manipulation involves a grab gesture and hand movements. The transition between these two interaction modes can be accomplished using either the "OK"gesture or an automatic attraction mechanism.We conducted a user study to evaluate our hybrid interaction method, and the results indicate that participants found it to be more natural and capable of accurately selecting and moving objects.

Original languageEnglish
Title of host publicationProceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2023
EditorsGerd Bruder, Anne-Helene Olivier, Andrew Cunningham, Evan Yifan Peng, Jens Grubert, Ian Williams
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages113-117
Number of pages5
ISBN (Electronic)9798350328912
DOIs
StatePublished - 2023
Event2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2023 - Sydney, Australia
Duration: 16 Oct 202320 Oct 2023

Publication series

NameProceedings - 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2023

Conference

Conference2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct, ISMAR-Adjunct 2023
Country/TerritoryAustralia
CitySydney
Period16/10/2320/10/23

Keywords

  • Embodied interaction
  • Gesture interaction
  • Glasses-free
  • Hybrid interaction method
  • Stereoscopic display
  • User study

Fingerprint

Dive into the research topics of 'Towards More Effective Interactions: A Hybrid Embodied Interaction Approach in Stereoscopic Displays'. Together they form a unique fingerprint.

Cite this