Agentic Visualization: Extracting Agent-based Design Patterns from Visualization Systems

2025-05-25

AI Summary

Current agentic visualization faces a core challenge: how to enhance analytical capabilities with AI agents while preserving human agency, autonomy, and collaborative control. This paper introduces the novel paradigm of *embodied visualization*, which foregrounds the human as the central cognitive agent within closed-loop reasoning and emphasizes the organic integration of human cognition with AI agent capabilities. Through systematic multi-case analysis and cross-paradigm modeling—synthesizing human–AI collaboration theory, visualization design principles, and LLM-based agent architectures—we first distill a comprehensive design pattern system for embodied visualization, encompassing agent roles, communication mechanisms, and coordination strategies. Key contributions include: (1) formalizing the theoretical boundaries of bidirectional human–AI empowerment; (2) establishing the first reusable design pattern library for embodied visualization; and (3) providing a methodological foundation for developing next-generation intelligent visualization systems that are explainable, intervenable, and evolvable.

Technology Category

• Intelligent Robots: Embodied AI
• Cognitive Modeling & Cognitive Systems: Agent Architectures
• Multiagent Systems: Agent-Based Simulation and Emergent Behavior

Application Category

• Semantics and Knowledge: Data modeling to support human-machine intelligence, including LLMs agents, intelligent system behavior, explanations, and user-friendly interactions
• Search and Retrieval-Augmented AI: Agentic search
• Responsible Web: Machine-in-the-loop, human agency and autonomy

Abstract

Autonomous agents powered by Large Language Models are transforming AI, creating an imperative for the visualization field to embrace agentic frameworks. However, our field's focus on a human in the sensemaking loop raises critical questions about autonomy, delegation, and coordination for such extit{agentic visualization} that preserve human agency while amplifying analytical capabilities. This paper addresses these questions by reinterpreting existing visualization systems with semi-automated or fully automatic AI components through an agentic lens. Based on this analysis, we extract a collection of design patterns for agentic visualization, including agentic roles, communication and coordination. These patterns provide a foundation for future agentic visualization systems that effectively harness AI agents while maintaining human insight and control.

Problem

• Exploring agent-based design patterns in visualization systems
• Balancing human agency with AI autonomy in visual analytics
• Developing coordination frameworks for agentic visualization components

Innovation

• Extracts agent-based design patterns from visualizations
• Reinterprets systems with AI through agentic lens
• Provides design patterns for agentic visualization systems