🤖 AI Summary
This work addresses how to achieve state-of-the-art performance on real-world tasks with language models while activating only a small fraction of their parameters. The authors propose a sparsely activated Mixture-of-Experts architecture integrated with agent-driven data generation, a native reinforcement learning system named Forge, and a self-evolution mechanism, effectively decoupling training, inference, and agent behavior. Leveraging window-based FIFO scheduling, prefix tree merging, and inference optimization techniques, the model activates just 9.8 billion parameters out of a total of 229.9 billion, attaining leading performance across benchmarks in agent programming, deep search, office automation, and reasoning. This approach also demonstrates initial capabilities in autonomous debugging and self-evolution.
📝 Abstract
We introduce the MiniMax-M2 series, a family of Mixture-of-Experts language models built around the principle that mini activations can unleash maximum real-world intelligence. The flagship M2 contains 229.9B total parameters with only 9.8B activated per token. Designed end-to-end for agentic deployment, the M2 series rests on three components: (i) agent-driven data pipelines producing large-scale, verifiable trajectories across agentic coding and agentic cowork, each grounded in an executable workspace and an artifact-aligned reward; (ii) Forge, a scalable agent-native RL system that adapts to long-horizon agent trajectories, paired with windowed-FIFO scheduling, prefix-tree merging, inference optimization, and a clean training-inference-agent decoupling that supports both white-box and black-box agents; (iii) the latest M2.7 checkpoint takes an early step toward self-evolution -- autonomously debugging training runs and modifying its own scaffold. Across M2 through M2.7, this combination translates a mini-activation footprint into frontier-tier performance on agentic coding, deep search, office-task, and reasoning benchmarks.