Illuminating LLM Coding Agents: Visual Analytics for Deeper Understanding and Enhancement

2025-08-17

AI Summary

ML scientists struggle to efficiently audit the iterative coding processes of LLM-based programming agents; existing manual inspection of individual outputs hinders tracing code evolution, comparing multi-turn behaviors, and identifying improvement opportunities. Method: We propose the first multi-level visual analytics system specifically designed for LLM programming agents, enabling coordinated analysis across three granularities: code (diff-based comparison), process (reconstruction of solution paths), and model (cross-model behavioral contrast). Built upon the AIDE framework, the system integrates interactive visualization techniques to ensure traceable coding trajectories, visible iterative differences, and comparable model strategies. Contribution/Results: Evaluated on multiple Kaggle competition case studies, our system significantly enhances users’ depth of understanding of agent behavior and accelerates prompt debugging. It establishes a novel paradigm for controllable development and explainability research of LLM agents.

Technology Category

• Multiagent Systems: Modeling other Agents
• Cognitive Modeling & Cognitive Systems: Agent Architectures
• Machine Learning: Large Multimodal Models (LMMs)

Application Category

• Semantics and Knowledge: Data modeling to support human-machine intelligence, including LLMs agents, intelligent system behavior, explanations, and user-friendly interactions
• Economics, Online Markets and Human Computation: Cost models of using LLMs in production systems
• User Modeling, Personalization and Recommendation: Large Language Models (LLM) for user modeling and recommendation

Abstract

Coding agents powered by large language models (LLMs) have gained traction for automating code generation through iterative problem-solving with minimal human involvement. Despite the emergence of various frameworks, e.g., LangChain, AutoML, and AIDE, ML scientists still struggle to effectively review and adjust the agents' coding process. The current approach of manually inspecting individual outputs is inefficient, making it difficult to track code evolution, compare coding iterations, and identify improvement opportunities. To address this challenge, we introduce a visual analytics system designed to enhance the examination of coding agent behaviors. Focusing on the AIDE framework, our system supports comparative analysis across three levels: (1) Code-Level Analysis, which reveals how the agent debugs and refines its code over iterations; (2) Process-Level Analysis, which contrasts different solution-seeking processes explored by the agent; and (3) LLM-Level Analysis, which highlights variations in coding behavior across different LLMs. By integrating these perspectives, our system enables ML scientists to gain a structured understanding of agent behaviors, facilitating more effective debugging and prompt engineering. Through case studies using coding agents to tackle popular Kaggle competitions, we demonstrate how our system provides valuable insights into the iterative coding process.

Problem

• Enhancing understanding of LLM coding agent behaviors
• Improving efficiency in reviewing iterative code generation
• Enabling comparative analysis across code, process, and LLM levels

Innovation

• Visual analytics system for coding agents
• Comparative analysis across three levels
• Enhances debugging and prompt engineering