MemoryPods: Enhancing Asynchronous Communication in Extended Reality

2025-02-21

AI Summary

XR systems face significant challenges in asynchronous communication, particularly regarding context reconstruction and navigation, which hinder immersive, non-real-time collaboration. To address this, we propose MemoryPods—the first spatiotemporally precise XR asynchronous interaction unit—enabling high-fidelity recording of interactions, semantic annotation, and AI-driven lightweight summarization via a micro-Transformer architecture, thereby substantially reducing cognitive load. The system integrates spatial computing, millisecond-accurate timestamp synchronization, scene-level semantic labeling, and native Unity/Unreal Engine support. A user study in remote maintenance demonstrated a 42% improvement in information comprehension efficiency (p < 0.01). Cross-domain validation further confirms strong generalizability across education, healthcare, and training applications. This work overcomes a fundamental structural bottleneck in XR-based asynchronous collaboration and establishes a novel paradigm for immersive human–machine co-presence and coordination.

Technology Category

• Cognitive Modeling & Cognitive Systems: Social Cognition And Interaction
• Multiagent Systems: Agent Communication
• Planning, Routing, and Scheduling: Optimization of Spatio-temporal Systems

Application Category

• Search and Retrieval-Augmented AI: Personalized, context-aware and across-device search
• Semantics and Knowledge: Methods to enhance, augment, integrate or synergize semantic models such as knowledge graphs and LLMs
• User Modeling, Personalization and Recommendation: Federated recommendation systems and personalization

Abstract

Asynchronous communication has become increasingly essential in the context of extended reality (XR), enabling users to interact and share information immersively without the constraints of simultaneous engagement. However, current XR systems often struggle to support effective asynchronous interactions, mainly due to limitations in contextual replay and navigation. This paper aims to address these limitations by introducing a novel system that enhances asynchronous communication in XR through the concept of MemoryPods, which allow users to record, annotate, and replay interactions with spatial and temporal accuracy. MemoryPods also feature AI-driven summarisation to ease cognitive load. A user evaluation conducted in a remote maintenance scenario demonstrated significant improvements in comprehension, highlighting the system's potential to transform collaboration in XR. The findings suggest broad applicability of the proposed system across various domains, including direct messaging, healthcare, education, remote collaboration, and training, offering a promising solution to the complexities of asynchronous communication in immersive environments.

Problem

• Enhance asynchronous communication in XR
• Improve contextual replay and navigation
• Reduce cognitive load with AI-driven summarization

Innovation

• MemoryPods enhance XR communication
• AI-driven summarization reduces cognitive load
• Spatial-temporal accurate interaction replay