Augmenting Teamwork through AI Agents as Spatial Collaborators

2025-03-12

AI Summary

This study addresses the limitation of AI agents in augmented reality (AR) environments—where they function primarily as static, individual tools—by proposing the “Spatial Collaborator” paradigm, elevating AI from a passive interaction tool to a dynamic, team-aware partner capable of real-time situational awareness and adaptive response. Methodologically, we integrate AR, spatial computing, multi-agent collaborative modeling, and context-aware reasoning to develop an AI collaboration framework supporting virtual whiteboards, shared mental map construction, and spatial memory recall. Our key contributions are: (1) the first systematic articulation of spatial collaboration design principles and real-time intervention paradigms for Human-AI Teams (HATs); and (2) the formalization of a closed-loop mechanism—comprising team-level need identification, resource generation, and collaborative regulation—that provides a scalable theoretical foundation and architectural guidance for immersive collaborative systems. (149 words)

Technology Category

• Humans and AI: Human-AI Collaboration / Human-AI Teaming
• Multiagent Systems: Teamwork
• Cognitive Modeling & Cognitive Systems: Agent Architectures

Application Category

• Responsible Web: Machine-in-the-loop, human agency and autonomy
• Search and Retrieval-Augmented AI: Agentic search
• Semantics and Knowledge: Data modeling to support human-machine intelligence, including LLMs agents, intelligent system behavior, explanations, and user-friendly interactions

Abstract

As Augmented Reality (AR) and Artificial Intelligence (AI) continue to converge, new opportunities emerge for AI agents to actively support human collaboration in immersive environments. While prior research has primarily focused on dyadic human-AI interactions, less attention has been given to Human-AI Teams (HATs) in AR, where AI acts as an adaptive teammate rather than a static tool. This position paper takes the perspective of team dynamics and work organization to propose that AI agents in AR should not only interact with individuals but also recognize and respond to team-level needs in real time. We argue that spatially aware AI agents should dynamically generate the resources necessary for effective collaboration, such as virtual blackboards for brainstorming, mental map models for shared understanding, and memory recall of spatial configurations to enhance knowledge retention and task coordination. This approach moves beyond predefined AI assistance toward context-driven AI interventions that optimize team performance and decision-making.

Problem

• AI agents in AR enhance human team collaboration
• AI dynamically responds to team-level needs
• AI generates resources for effective teamwork

Innovation

• AI agents as adaptive teammates in AR
• Real-time recognition of team-level needs
• Dynamic resource generation for collaboration