Position: Agentic Evolution is the Path to Evolving LLMs

2026-01-30

AI Summary

Static training paradigms struggle to cope with the continuously shifting deployment conditions in open environments, creating a fundamental gap between training and real-world application. To address this challenge, this work proposes evolution as a novel dimension for continual adaptation of large language models (LLMs) during deployment. It introduces the first formalization of the evolutionary process as an autonomous agent endowed with strategic intent and posits the "Evolutionary Scalability Hypothesis," which establishes a positive correlation between allocated evolutionary computation resources and adaptive capability. Building upon this foundation, we present the A-Evolve framework, which integrates goal-directed optimization, persistent system state management, and deployment-time evolutionary mechanisms. This approach transcends conventional fine-tuning and memory-based methods, offering both a theoretical foundation and a scalable pathway for enabling sustainable, open-ended adaptation of LLMs in dynamic open-world settings.

Technology Category

• Machine Learning: Evolutionary Learning
• Search and Optimization: Evolutionary Computation
• Natural Language Processing: (Large) Language Models

Application Category

• User Modeling, Personalization and Recommendation: Large Language Models (LLM) for user modeling and recommendation
• Economics, Online Markets and Human Computation: Cost models of using LLMs in production systems
• Search and Retrieval-Augmented AI: Search Tool Learning with LLM: Teaching LLMs to invoke search and make use of retrieved information

Abstract

As Large Language Models (LLMs) move from curated training sets into open-ended real-world environments, a fundamental limitation emerges: static training cannot keep pace with continual deployment environment change. Scaling training-time and inference-time compute improves static capability but does not close this train-deploy gap. We argue that addressing this limitation requires a new scaling axis-evolution. Existing deployment-time adaptation methods, whether parametric fine-tuning or heuristic memory accumulation, lack the strategic agency needed to diagnose failures and produce durable improvements. Our position is that agentic evolution represents the inevitable future of LLM adaptation, elevating evolution itself from a fixed pipeline to an autonomous evolver agent. We instantiate this vision in a general framework, A-Evolve, which treats deployment-time improvement as a deliberate, goal-directed optimization process over persistent system state. We further propose the evolution-scaling hypothesis: the capacity for adaptation scales with the compute allocated to evolution, positioning agentic evolution as a scalable path toward sustained, open-ended adaptation in the real world.

Problem

• Large Language Models
• train-deploy gap
• deployment-time adaptation
• environmental change
• static training

Innovation

• Agentic Evolution
• A-Evolve
• train-deploy gap
• evolution-scaling hypothesis
• autonomous evolver agent