XR-First Design for Productivity: A Conceptual Framework for Enabling Efficient Task Switching in XR

2025-08-15

AI Summary

In extended reality (XR) knowledge work, conventional windowed interaction fails to adequately represent spatial information, resulting in inefficient task switching. Method: This paper proposes a user-centered, XR-first design paradigm that introduces a conceptual framework supporting concurrent multi-application loading and immersive, context-aware rapid task switching. The framework integrates spatial interaction design principles with context-aware mechanisms to dissolve application silos. Contribution/Results: It presents the first systematic definition of a spatial semantics model for XR task switching and associated interaction guidelines, establishing a reusable theoretical foundation. This framework serves as a design basis for next-generation XR productivity tools. Empirical evaluation demonstrates significant improvements in task-switching fluency and accuracy of spatial intent expression.

Technology Category

• Knowledge Representation and Reasoning: Geometric, Spatial, and Temporal Reasoning
• Cognitive Modeling & Cognitive Systems: Applications
• Humans and AI: Game Design — Virtual Humans, NPCs and Autonomous Characters

Application Category

• User Modeling, Personalization and Recommendation: Practical large-scale studies of user experience
• Semantics and Knowledge: Methods to enhance, augment, integrate or synergize semantic models such as knowledge graphs and LLMs
• Search and Retrieval-Augmented AI: Personalized, context-aware and across-device search

Abstract

A core component of completing tasks efficiently in computer-supported knowledge work is the ability for users to rapidly switch their focus (and interaction) across different applications using various shortcuts and gestures. This feature set has been explored in research, and several modern consumer extended reality (XR) headsets now support loading multiple applications windows at once. However, many XR applications that are useful for knowledge work involve rich spatial information, which window-based metaphors do not sufficiently represent nor afford appropriate interaction. In modern XR headsets, such immersive applications run as siloed experiences, requiring the user to fully exit one before starting another. We present a vision for achieving an XR-first, user-centric paradigm for efficient context switching in XR to encourage and guide future research and development of XR context- and task-switching interfaces.

Problem

• Enabling efficient task switching in XR environments
• Addressing limitations of window-based metaphors for spatial applications
• Overcoming siloed immersive application experiences in XR headsets

Innovation

• XR-first design paradigm for efficient task switching
• User-centric framework overcoming application silos
• Spatial interfaces replacing window-based metaphors