Towards More Effective Interactions: A Hybrid Embodied Interaction Approach in Stereoscopic Displays

Head-mounted virtual reality/augmented reality (VR/AR) devices have become prevalent in implementing immersive analytics. However, these devices have certain limitations, such as disconnecting the user from the real working world and possibly causing discomfort. Recently, portable glasses-free stereoscopic display devices have emerged as a potential solution to address these limitations. Unlike head-mounted devices, these displays utilize screens to render the virtual space, resulting in virtual content appearing either inside or outside of the screen. Therefore, designing natural, intuitive, and immersive user interactions in this virtual environment with a physical boundary is crucial for enhancing device usability. This research focuses on developing an effective interaction method for selecting and moving objects within the stereoscopic displays. We propose a hybrid embodied interaction method that leverages gesture controls. Specifically, inside-screen object manipulation is achieved using ray-object intersection and pinch gestures, while outside-screen manipulation involves a grab gesture and hand movements. The transition between these two interaction modes can be accomplished using either the "OK"gesture or an automatic attraction mechanism.We conducted a user study to evaluate our hybrid interaction method, and the results indicate that participants found it to be more natural and capable of accurately selecting and moving objects.