StylusPort: Investigating Teleportation using Stylus in VR

2026-02-25

AI Summary

This study addresses the challenge of naturally integrating teleportation interaction in virtual reality (VR) without disrupting conventional stylus-based handwriting. The authors propose an intuitive mode-switching mechanism that leverages stylus flipping to toggle between drawing and teleportation modes. For the first time, they combine gaze for orientation setting with stylus pose for position control, enabling coordinated localization and orientation. Building upon flip detection, button triggers, gaze tracking, and pose sensing, six teleportation techniques were implemented and evaluated through a user study. Results reveal significant differences in efficiency and user experience across mode-switching and orientation-setting strategies, with the GazePoint–Flip combination yielding optimal performance, thereby filling a critical gap in stylus-based VR teleportation interaction research.

Technology Category

• Intelligent Robots: Manipulation
• Computer Vision: Motion & Tracking
• Humans and AI: Interaction Techniques and Devices

Application Category

• User Modeling, Personalization and Recommendation: Practical large-scale studies of user experience
• Security and Privacy: Large-scale security measurements
• Systems and Infrastructure for Web, Mobile and WoT: Virtualization and resource management in Web systems and infrastructures

Abstract

With a stylus, users can both sweep sketches across models and pinpoint locations with precision. Building on this dual capability, we explore how teleportation can be integrated into stylus interaction without disrupting the flow of common stylus usage. We introduce two key ideas: flipping the stylus as an intuitive mode switch between drawing and teleportation, and using gaze to set orientation while the stylus handles positioning. In a user study that features a teleport-and-orient task, we evaluate six teleportation techniques, covering two mode-switching methods (Button and Flip) and three orientation approaches (StylusRoll, StylusPoint, and GazePoint). The results offer new insights into the relative merits and limitations of each technique. Our work contributes to knowledge about teleportation in VR and fills the gap in seamlessly integrating teleportation with stylus use in 3D.

Problem

• teleportation
• stylus
• virtual reality
• mode switching
• 3D interaction

Innovation

• StylusPort
• teleportation
• VR interaction
• mode switching
• gaze-pointing