ProbeLLM: Automating Principled Diagnosis of LLM Failures
Application Category
📝 Abstract
Understanding how and why large language models (LLMs) fail is becoming a central challenge as models rapidly evolve and static evaluations fall behind. While automated probing has been enabled by dynamic test generation, existing approaches often discover isolated failure cases, lack principled control over exploration, and provide limited insight into the underlying structure of model weaknesses. We propose ProbeLLM, a benchmark-agnostic automated probing framework that elevates weakness discovery from individual failures to structured failure modes. ProbeLLM formulates probing as a hierarchical Monte Carlo Tree Search, explicitly allocating limited probing budgets between global exploration of new failure regions and local refinement of recurring error patterns. By restricting probing to verifiable test cases and leveraging tool-augmented generation and verification, ProbeLLM grounds failure discovery in reliable evidence. Discovered failures are further consolidated into interpretable failure modes via failure-aware embeddings and boundary-aware induction. Across diverse benchmarks and LLMs, ProbeLLM reveals substantially broader, cleaner, and more fine-grained failure landscapes than static benchmarks and prior automated methods, supporting a shift from case-centric evaluation toward principled weakness discovery.
Problem
Research questions and friction points this paper is trying to address.
LLM failures
automated probing
failure modes
weakness discovery
structured diagnosis
Innovation
Methods, ideas, or system contributions that make the work stand out.
ProbeLLM
Monte Carlo Tree Search
failure modes
tool-augmented verification
failure-aware embeddings
🔎 Similar Papers
No similar papers found.
