Problem
Research questions and friction points this paper is trying to address.
continual learning
harness
behavior retention
forgetting
adaptation
Harness Continual Learning: Continual Adaptation Beyond Model Parameters
🤖 AI Summary
该研究提出Harness Continual Learning(HCL)框架，通过更新模型外部组件如任务接口、经验记忆等来持续学习并保留先前行为，减少遗忘。
📝 Abstract
Continual learning has largely been model-centric, treating model parameters as the state that changes with sequential experience. Modern agents can also adapt through a harness of prompts, memories, tools, skills, and routing rules. Because these contents jointly shape later execution, a harness update can disrupt previously reliable behavior even when the model is frozen. This raises a new question: how can an agent continually improve its state outside the model while retaining behavior acquired earlier? We formulate Harness Continual Learning (HCL), a new continual learning paradigm in which the harness evolves around a frozen foundation model, and define the resulting loss of earlier behavior as harness-level forgetting. We instantiate HCL with four execution-facing components: the Task Interface, Experience Memory, Capability Map, and Adaptive Router. We further introduce guarded harness evolution to separate update generation from state commitment. A Continual Optimizer proposes candidate harnesses from post-execution feedback, and a Continual Evaluator commits the resulting candidate harness only after checking current improvement, historical retention, and validity. Experiments on textual reasoning, multimodal perception, and open-world interaction demonstrate capability accumulation and failure recovery, with relative gains exceeding 10% over corresponding baselines in multiple settings. Component ablations assess the contribution of each harness component, while controlled retention sweeps reveal measurable harness-level forgetting and show that the stability--plasticity trade-off can be explicitly adjusted.
Innovation
Methods, ideas, or system contributions that make the work stand out.
Harness Continual Learning
Continual Adaptation
Frozen Foundation Model
Guarded Harness Evolution
Behavioral Retention
🔎 Similar Papers
No similar papers found.
