HandPad: A Bimanual Hand Interface for Fluid Window Interactions in VR

2026-07-13

AI Summary

Current mobile VR systems rely on external input devices, limiting their utility for on-the-go productivity tasks. To address this constraint, this work proposes HandPad—a self-contained bimanual interaction technique that eliminates the need for peripherals by repurposing the non-dominant palm as a spatial reference and tactile feedback surface while the dominant hand performs fine-grained manipulations. Through asymmetric bimanual coordination, HandPad enables window navigation, content manipulation, and task management within virtual environments. The approach integrates bare-hand gesture recognition, bimanual spatial remapping, mode-switching modifiers, and egocentric tactile feedback. An exploratory study demonstrates that HandPad supports efficient and ergonomically viable knowledge work in VR, highlighting its feasibility and potential for peripheral-free productivity applications in mobile virtual reality.

Abstract

Virtual Reality (VR) offers potential for productivity work by creating expansive displays anywhere, yet current systems often rely on external input devices that limit the on-the-go use of mobile VR. We introduce HandPad, a suite of bare-hand interaction techniques that leverage the benefits of asymmetric bimanual coordination and self-haptic support. HandPad assigns the non-dominant hand (NDH) to establish spatial frames and interaction contexts, while the dominant hand (DH) performs fine-grained manipulation. Users can use NDH gestures as an input modifier to change the mode and target of DH interactions, including multi-window navigation, in-window content interaction, and window management. The palm surface of the NDH also serves as a physical touch surface, providing passive haptic feedback for effective DH touch interaction. Both hands and their interactions are spatially remapped to the window surface, enabling comfortable and direct interaction with virtual content. An exploratory study showed that HandPad enables efficient and ergonomic interaction, demonstrating its potential as a device-free approach for knowledge work in VR.

Problem

• Virtual Reality
• bimanual interaction
• window management
• device-free interaction
• productivity

Innovation

• bimanual interaction
• bare-hand interface
• asymmetric coordination
• passive haptics
• spatial remapping