Exploring Experiential Differences Between Virtual and Physical Memory-Linked Objects in Extended Reality

2026-03-22

AI Summary

This study investigates how different interface representations in extended reality (XR) influence users’ ability to revisit and share personal memory experiences. Through a within-subjects experiment, it systematically compares three interaction modalities—physical memory cues, virtual memory cues, and a conventional virtual gallery—in the context of capturing, accessing, and sharing 360° video memories, complemented by qualitative analysis of their social and affective dimensions. Findings reveal that physical objects significantly enhance social interaction and dialogue, virtual objects strike a balance between engagement and usability, while the gallery interface, though efficient, lacks personalization. This work is the first to demonstrate the unique value of both physical and virtual memory cues in fostering interpersonal connection, offering theoretical insights and practical guidance for designing XR memory systems that prioritize shared meaning.

Technology Category

• Cognitive Modeling & Cognitive Systems: Social Cognition And Interaction
• Humans and AI: Interaction Techniques and Devices
• Knowledge Representation and Reasoning: Preferences

Application Category

• User Modeling, Personalization and Recommendation: Practical large-scale studies of user experience
• Search and Retrieval-Augmented AI: Web evaluation methodologies and metrics
• Responsible Web: Machine-in-the-loop, human agency and autonomy

Abstract

Extended Reality (XR) enables immersive capture and re-experience of personal memories, yet how interface representations shape these experiences remains underexplored. We examine how users relive and share XR memories through three interaction approaches: (1) physical memory-linked objects, (2) virtual memory-linked objects, and (3) a conventional virtual gallery interface. In a within-subjects study (N=24, 12 pairs), participants captured shared experiences using 360° video and later accessed and shared these memories across the three interfaces. We analyzed open-ended qualitative responses focusing on perceived value, enjoyment, usability, emotional attachment, and social connection. The findings reveal trade-offs: physical objects fostered stronger social connection and conversation through tangible exchange; virtual objects balanced engagement and usability; and the gallery interface was efficient but less personal. These results suggest that object-based representations, physical and virtual, support key social dimensions of XR memory experiences, offering lessons for designing future systems that emphasize shared meaning and interpersonal connection.

Problem

• Extended Reality
• memory-linked objects
• user experience
• social connection
• interface representation

Innovation

• memory-linked objects
• Extended Reality
• social connection
• object-based interaction
• immersive memory