Skip to main navigation Skip to search Skip to main content

An intuitive robot manipulation interface based on mixed reality and multi-point mapping for assembly applications

  • Jilong Bai
  • , Weiping He
  • , Tianyu Liu
  • , Bokai Zheng
  • , Haoran Zhang
  • , Xiaotian Zhang
  • , Mark Billinghurst
  • Northwestern Polytechnical University Xian
  • University of South Australia

Research output: Contribution to journalArticlepeer-review

Abstract

In Industry 5.0, high-precision human–robot collaborative assembly requires intuitive interfaces that minimize cognitive load. However, traditional 6-DoF control interfaces are hindered by kinematic coupling, as the control coordinate system (CCS) is rigidly fixed to the robot’s end-effector (EEF), forcing operators to perform complex compensatory movements. To address this, we propose the Multi-Point Mapping Interface (MPMI), a Mixed Reality (MR) strategy that dynamically decouples the CCS from the EEF, allowing operators to align control with task-relevant geometric features. A single-factor within-subjects user study ((Formula presented) ) was conducted to validate the system against a traditional Single-Point Mapping Interface (SPMI). Experimental results demonstrate that MPMI significantly reduced task completion time by 14.6% ((Formula presented) ) and improved input efficiency, as indicated by a 15.0% reduction in cumulative operator input pose change ((Formula presented) ). Furthermore, subjective assessments confirmed a significant decrease in NASA-TLX cognitive load ((Formula presented) ) and superior usability of the system. These findings empirically validate the principle of dynamic control origin decoupling as a critical methodology for enhancing efficiency in complex robotic assembly, providing a foundation for future cognitive-optimized HRC systems.

Original languageEnglish
Article number103441
JournalDisplays
Volume93
DOIs
StatePublished - Jul 2026

Keywords

  • Assembly applications
  • Human–robot interaction
  • Mixed reality
  • Robotic manipulation

Fingerprint

Dive into the research topics of 'An intuitive robot manipulation interface based on mixed reality and multi-point mapping for assembly applications'. Together they form a unique fingerprint.

Cite this