MAS-Orchestra: Understanding and Improving Multi-Agent Reasoning Through Holistic Orchestration and Controlled Benchmarks

2026-01-21

AI Summary

Existing approaches to automatic multi-agent system design suffer from complex orchestration, limited global reasoning capabilities, and ill-defined boundaries of their advantages. This work proposes MAS-Orchestra, a novel framework that formulates multi-agent orchestration as a function-call-based global reinforcement learning problem, enabling end-to-end generation of complete systems in a single pass. To systematically evaluate task characteristics, the authors introduce MASBENCH, a benchmark assessing performance across five dimensions: Depth, Horizon, Breadth, Parallelism, and Robustness. Experimental results demonstrate consistent performance gains on tasks such as mathematical reasoning and multi-hop question answering. Furthermore, the study reveals that the benefits of multi-agent collaboration are not universal but critically depend on task structure, verification mechanisms, and individual agent capabilities.

Technology Category

• Multiagent Systems: Multiagent Learning
• Intelligent Robots: Multi-Robot Systems
• Cognitive Modeling & Cognitive Systems: Agent Architectures

Application Category

• Responsible Web: Machine-in-the-loop, human agency and autonomy
• Economics, Online Markets and Human Computation: Uses of LLMs and GenAI for marketplace design, bidding, and strategic interactions
• Search and Retrieval-Augmented AI: Agentic search

Abstract

While multi-agent systems (MAS) promise elevated intelligence through coordination of agents, current approaches to automatic MAS design under-deliver. Such shortcomings stem from two key factors: (1) methodological complexity - agent orchestration is performed using sequential, code-level execution that limits global system-level holistic reasoning and scales poorly with agent complexity - and (2) efficacy uncertainty - MAS are deployed without understanding if there are tangible benefits compared to single-agent systems (SAS). We propose MASOrchestra, a training-time framework that formulates MAS orchestration as a function-calling reinforcement learning problem with holistic orchestration, generating an entire MAS at once. In MAS-Orchestra, complex, goal-oriented subagents are abstracted as callable functions, enabling global reasoning over system structure while hiding internal execution details. To rigorously study when and why MAS are beneficial, we introduce MASBENCH, a controlled benchmark that characterizes tasks along five axes: Depth, Horizon, Breadth, Parallel, and Robustness. Our analysis reveals that MAS gains depend critically on task structure, verification protocols, and the capabilities of both orchestrator and subagents, rather than holding universally. Guided by these insights, MAS-Orchestra achieves consistent improvements on public benchmarks including mathematical reasoning, multi-hop QA, and search-based QA, while achieving more than 10x efficiency over strong baselines. Together, MAS-Orchestra and MASBENCH enable better training and understanding of MAS in the pursuit of multi-agent intelligence.

Problem

• multi-agent systems
• agent orchestration
• system-level reasoning
• efficacy evaluation
• scalability

Innovation

• multi-agent orchestration
• holistic reasoning
• function-calling reinforcement learning
• controlled benchmark
• MASBENCH