OFA-MAS: One-for-All Multi-Agent System Topology Design based on Mixture-of-Experts Graph Generative Models
This work addresses the limited generalizability of existing multi-agent systems (MAS), which rely on task-specific collaboration topologies and cannot share structural knowledge across tasks. To overcome this, we propose OFA-TAD, a novel framework that pioneers a “one-model-for-all-tasks” paradigm by dynamically generating sparse, adaptive collaboration graphs from arbitrary natural language task descriptions using a single unified model. Our approach integrates a Task-Aware Graph State Encoder (TAGSE), a Mixture-of-Experts (MoE) graph generation architecture, and a three-stage training strategy—comprising unconditional pretraining, conditional pretraining with large-model-generated data, and empirical graph fine-tuning. Evaluated across six diverse benchmarks, OFA-TAD significantly outperforms task-specific methods, enabling unified cross-domain topology generation and efficient knowledge transfer.