HumanoidTurk: Expanding VR Haptics with Humanoids for Driving Simulations

2026-01-26

AI Summary

This study addresses the limited realism of traditional VR driving simulators, which often fail to convey authentic acceleration and dynamic motion cues due to insufficient multidimensional haptic feedback. To overcome this, the work proposes a novel hybrid haptic feedback system that leverages a humanoid robot as an autonomous tactile medium. A filter-based motion synthesis method is introduced to translate in-game g-force signals into synchronized, real-time robotic body movements. Experimental results demonstrate that this approach significantly enhances users’ sense of immersion, realism, and enjoyment. The system exhibits distinct advantages in fidelity, adaptability, and multifunctionality, and achieves higher feedback consistency than human operators, albeit with a slight increase in user discomfort.

Technology Category

• Humans and AI: Game Design — Virtual Humans, NPCs and Autonomous Characters
• Intelligent Robots: Human-Robot Interaction
• Cognitive Modeling & Cognitive Systems: Simulating Human Behavior

Application Category

• Responsible Web: Machine-in-the-loop, human agency and autonomy
• User Modeling, Personalization and Recommendation: User modeling and simulation for interactive and conversational systems
• Search and Retrieval-Augmented AI: Web evaluation methodologies and metrics

Abstract

We explore how humanoid robots can be repurposed as haptic media, extending beyond their conventional role as social, assistive, collaborative agents. To illustrate this approach, we implemented HumanoidTurk, taking a first step toward a humanoid-based haptic system that translates in-game g-force signals into synchronized motion feedback in VR driving. A pilot study involving six participants compared two synthesis methods, leading us to adopt a filter-based approach for smoother and more realistic feedback. A subsequent study with sixteen participants evaluated four conditions: no-feedback, controller, humanoid+controller, and human+controller. Results showed that humanoid feedback enhanced immersion, realism, and enjoyment, while introducing moderate costs in terms of comfort and simulation sickness. Interviews further highlighted the robot's consistency and predictability in contrast to the adaptability of human feedback. From these findings, we identify fidelity, adaptability, and versatility as emerging themes, positioning humanoids as a distinct haptic modality for immersive VR.

Problem

• humanoid robots
• haptic feedback
• virtual reality
• driving simulation
• immersive VR

Innovation

• humanoid robots
• haptic feedback
• virtual reality
• driving simulation
• motion synthesis