Bumpy Ride? Understanding the Effects of External Forces on Spatial Interactions in Moving Vehicles

2025-02-23

AI Summary

This study investigates how vehicular dynamic motion—such as G-forces, vibrations, and sharp turns—affects 3D interaction performance in head-mounted displays (HMDs). Method: Through in-vehicle field experiments, we systematically evaluate four interaction paradigms—Gaze&Pinch, DirectTouch, HandRay, and HeadGaze—under real-world road conditions. Leveraging the Fitts’ Law paradigm, we conduct a multi-dimensional assessment encompassing accuracy, latency, throughput, and subjective cognitive load. Contribution/Results: We present the first quantitative analysis of the coupled effects among road type, curve characteristics, and interaction modality. Results demonstrate that vehicle motion significantly degrades interaction accuracy and throughput while increasing error rates and cognitive workload. These findings provide empirical evidence and actionable design guidelines for mobile augmented/virtual reality (AR/VR) interfaces operating in dynamic environments, advancing robust interaction design for automotive and on-the-move AR/VR applications.

Technology Category

• Computer Vision: Motion & Tracking
• Application Domains: Mobility, Driving & Flight
• Humans and AI: Interaction Techniques and Devices

Application Category

• User Modeling, Personalization and Recommendation: Practical large-scale studies of user experience
• Systems and Infrastructure for Web, Mobile and WoT: Web performance, measurement, and characterization
• Responsible Web: Machine-in-the-loop, human agency and autonomy

Abstract

As the use of Head-Mounted Displays in moving vehicles increases, passengers can immerse themselves in visual experiences independent of their physical environment. However, interaction methods are susceptible to physical motion, leading to input errors and reduced task performance. This work investigates the impact of G-forces, vibrations, and unpredictable maneuvers on 3D interaction methods. We conducted a field study with 24 participants in both stationary and moving vehicles to examine the effects of vehicle motion on four interaction methods: (1) Gaze&Pinch, (2) DirectTouch, (3) Handray, and (4) HeadGaze. Participants performed selections in a Fitts' Law task. Our findings reveal a significant effect of vehicle motion on interaction accuracy and duration across the tested combinations of Interaction Method x Road Type x Curve Type. We found a significant impact of movement on throughput, error rate, and perceived workload. Finally, we propose future research considerations and recommendations on interaction methods during vehicle movement.

Problem

• Impact of G-forces on 3D interaction
• Vehicle motion affects interaction accuracy
• Study on interaction methods in moving vehicles

Innovation

• Head-Mounted Displays
• 3D interaction methods
• Fitts' Law task