Reaction Time as a Proxy for Presence in Mixed Reality with Distraction

2024-11-08

arXiv.org

AI Summary

This study investigates the mechanism by which distractor consistency affects user experience in mixed reality (MR). A within-subjects experiment with 54 participants integrated an image classification task, subjective measures (IPQ), objective behavioral time-series logging, and mediation analysis to propose and empirically validate the “Distractor Consistency Theory Model”—the first of its kind. Critically, reaction time was identified as a valid proxy metric for presence. Inconsistent distractors significantly reduced presence (p < 0.001), which in turn mediated increased cognitive load, prolonged reaction time (+19.3%), and elevated frequency of breaks in presence (BIP) (+37.6%). These findings provide both theoretical grounding and empirical evidence to inform MR human–computer interaction design, particularly regarding environmental coherence and attentional management.

Technology Category

• Cognitive Modeling & Cognitive Systems: Social Cognition And Interaction
• Humans and AI: Game Design — Virtual Humans, NPCs and Autonomous Characters
• Constraint Satisfaction and Optimization: Mixed Discrete/Continuous Optimization

Application Category

• User Modeling, Personalization and Recommendation: Practical large-scale studies of user experience
• Responsible Web: Machine-in-the-loop, human agency and autonomy
• Search and Retrieval-Augmented AI: Web evaluation methodologies and metrics

Abstract

Distractions in mixed reality (MR) environments can significantly influence user experience, affecting key factors such as presence, reaction time, cognitive load, and Break in Presence (BIP). Presence measures immersion, reaction time captures user responsiveness, cognitive load reflects mental effort, and BIP represents moments when attention shifts from the virtual to the real world, breaking immersion. However, the effects of distractions on these elements remain insufficiently explored. To address this gap, we have presented a theoretical model to understand how congruent and incongruent distractions affect all these constructs. We conducted a within-subject study (N=54) where participants performed image-sorting tasks under different distraction conditions. Our findings show that incongruent distractions significantly increase cognitive load, slow reaction times, and elevate BIP frequency, with presence mediating these effects.

Problem

• Effects of distractions on mixed reality
• Impact on cognitive load and reaction time
• Understanding presence and break in presence

Innovation

• Mixed Reality distraction analysis
• Reaction time measurement
• Cognitive load assessment