Beyond Generalist LLMs: Specialist Agentic Systems for Structured Code Workflow Execution

2026-07-15

AI Summary

This work addresses the limitations of general-purpose large language models in business process automation, where inconsistent functionality, frequent tool-calling errors, and unstable code quality hinder industrial-grade reliability and maintainability. Focusing on the task of translating BPMN diagrams into executable agent workflows, we propose the first specialized agent system designed for structured code generation. By integrating BPMN control-flow semantics, a deterministic path execution mechanism, and a lightweight code generation strategy, our approach achieves high-precision, low-latency, and zero-repair automation. Experimental results demonstrate that, compared to general-purpose models, our method improves tool-calling accuracy by 9–20 percentage points, reduces latency by 2–4×, decreases calling errors by a factor of three, lowers token-generation costs by over 95%, and entirely eliminates the need for repair iterations.

Abstract

Large Language Models (LLMs) have accelerated the adoption of software development agents, now widely available as Integrated Development Environment (IDE) extensions and standalone applications. While these agents are typically general-purpose, it remains unclear whether specialist agents justify their additional development effort. We investigate this question in the context of business process automation, focusing on the transformation of Business Process Model and Notation (BPMN) diagrams into executable agentic workflows. Since BPMN specifies explicit control-flow semantics, we focus on deterministic workflows in which a fixed process model and inputs uniquely determine the executed path. We introduce a specialist workflow for this task and compare it against generalist agents such as Roo and Cline. Our results show that the specialist solution produces agents that outperform generalist baselines by approximately 9-20 percentage points in tool-use exactness, 2-4x in penalty-adjusted latency, and 3x fewer tool-call errors, while reducing generation token cost by over 95% and eliminating repair iterations. We also find that generalist agents generate code inconsistently in both functionality and quality, limiting their suitability for industrial settings where reliability and maintainability are essential.

Problem

• specialist agents
• BPMN
• workflow execution
• tool-use reliability
• code consistency

Innovation

• specialist agentic systems
• BPMN-to-workflow transformation
• deterministic workflow execution
• tool-use exactness
• token-efficient code generation