Visualizing Impedance Control in Augmented Reality for Teleoperation: Design and User Evaluation

2026-03-26

AI Summary

This work addresses the challenge of fine contact-force control in low-cost teleoperation systems, which lack haptic feedback and thus underperform in contact-intensive tasks. To circumvent the need for conventional haptic devices, the authors propose an augmented reality (AR)-based visualization method that, for the first time, renders in real time the target pose of an impedance controller alongside its offset from the robot’s end-effector, providing operators with intuitive force perception. Integrating AR, impedance control, dual-arm teleoperation, and motion-capture interfaces, the approach significantly enhances performance in force-sensitive tasks—reducing completion time by 24% in a suitcase-lifting task—while showing no significant effect in non-force-sensitive sliding tasks. These results demonstrate both the efficacy and task-specific nature of the proposed method in augmenting force awareness during teleoperation.

Technology Category

• Intelligent Robots: Manipulation
• Humans and AI: Interaction Techniques and Devices
• Computer Vision: Motion & Tracking

Application Category

• Responsible Web: Machine-in-the-loop, human agency and autonomy
• Search and Retrieval-Augmented AI: Web evaluation methodologies and metrics
• Economics, Online Markets and Human Computation: LLM based quality controls for crowd work

Abstract

Teleoperation for contact-rich manipulation remains challenging, especially when using low-cost, motion-only interfaces that provide no haptic feedback. Virtual reality controllers enable intuitive motion control but do not allow operators to directly perceive or regulate contact forces, limiting task performance. To address this, we propose an augmented reality (AR) visualization of the impedance controller's target pose and its displacement from each robot end effector. This visualization conveys the forces generated by the controller, providing operators with intuitive, real-time feedback without expensive haptic hardware. We evaluate the design in a dual-arm manipulation study with 17 participants who repeatedly reposition a box with and without the AR visualization. Results show that AR visualization reduces completion time by 24% for force-critical lifting tasks, with no significant effect on sliding tasks where precise force control is less critical. These findings indicate that making the impedance target visible through AR is a viable approach to improve human-robot interaction for contact-rich teleoperation.

Problem

• teleoperation
• impedance control
• haptic feedback
• contact-rich manipulation
• augmented reality

Innovation

• augmented reality
• impedance control
• teleoperation
• force feedback
• human-robot interaction