Physical surfaces make touch interactions in virtual reality precise, efficient, and bimanual

2026-07-02

AI Summary

This study addresses the limitations of gesture-based interaction in virtual reality (VR), where the absence of tactile feedback and physical reference surfaces leads to reduced precision and efficiency. To overcome these challenges, the authors propose a multimodal interaction approach that integrates a portable physical surface with vibrotactile/pressure haptic feedback and visual cues. The work presents the first systematic comparison among three conditions: no feedback, haptic-only feedback, and the inclusion of a physical surface. Experimental results demonstrate that the physical surface significantly improves selection accuracy, tracing efficiency, and drawing quality. Furthermore, it effectively facilitates bimanual coordination and enhances users’ sense of control and confidence during interaction, offering a practical and efficient solution for high-precision touch-based tasks in VR.

Abstract

Virtual reality (VR) systems can enable convenient hand-based interactions across diverse work scenarios. However, mid-air gestures lack tactile feedback and a physical reference surface to support the hand. This absence of haptic grounding can cause significant challenges in achieving precise and efficient touch interactions. This paper investigates the effect of different types of hand-grounded haptic feedback on the touch performance of VR tasks that demand high precision, such as selecting, tracing, and sketching. We compared three levels of haptic feedback: 1) No Haptic Feedback, where only visual feedback was provided; 2) Tactile Feedback, where users received vibrotactile and pressure feedback upon touching a virtual surface; 3) Physical Surface, where users interacted with a portable and tangible surface. Our study found that portable physical surfaces enabled the best selection precision, tracing efficiency, and sketch quality. Furthermore, participants showed increased bimanual hand utilization when engaging with a physical surface during tasks. These observed behaviors corresponded to participants' preference for interacting with physical surfaces, attributed to a better sense of confidence and control.

Problem

• virtual reality
• haptic feedback
• touch interaction
• physical surface
• mid-air gestures

Innovation

• physical surface
• haptic feedback
• bimanual interaction
• virtual reality
• touch precision