MOSCOPT: Mixture-of-Skills Collective Optimization for LLM Agents

📅 2026-09-13
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
MOSCOPT算法通过联合优化多个技能和一个选择性激活这些技能的门控机制,解决了单一文本模板优化方法缺乏策略协同的问题。
📝 Abstract
Natural language prompts and skills serve as the strategic backbone of LLM-based agents. Recent advances in prompt and skill optimization have achieved notable gains, yet all existing methods optimize a \emph{single} text template---missing the synergy among multiple complementary strategies. We propose MOSCOPT, a text-native, parameter-free algorithm that jointly optimizes a pool of $N$ skills and a gating skill $G$ that dynamically selects $K$ skills per step. To effectively optimize the skills, we build the EditAdam with internally maintained dual states. Through the three-phase interleaved updates with EditAdam, the system monotonically improves without gradient or parameter tuning. Extensive experiments and detailed ablations across 5 benchmarks and 3 target LLMs demonstrate that MOSCOPT consistently outperforms all baselines, and confirm that both the mixture-of-skills architecture with selective activation and the collective evolution with three-phase interleaving are essential to its superior performance. Code is released https://github.com/zhangzhenyu13/SummerClaw/tree/master/summerclaw/agent_trainer/algorithms/moscopt.
Problem

Research questions and friction points this paper is trying to address.

natural language prompts
skills optimization
synergy among strategies
Innovation

Methods, ideas, or system contributions that make the work stand out.

Mixture-of-Skills
Collective Optimization
EditAdam
Three-Phase Interleaving
Parameter-Free
🔎 Similar Papers
Z
Zhenyu Zhang
ML Center, Coupang, Shanghai, China
J
Jiudong Yang
AI Center, Futu AI, Shenzhen, China