Functional compatibility as a determinant of persistent neural learning

2026-08-23

AI Summary

研究通过改变功能兼容性来解决神经网络持续学习时稳定性与可塑性的矛盾，证明了功能兼容性是决定持续学习的关键因素。

Abstract

Artificial neural networks can acquire new capabilities but often damage existing ones when they continue to learn. This stability-plasticity problem has motivated replay, regularization and constrained-update methods, yet it remains unclear whether a property of incoming learning itself determines what can be retained without disrupting protected behaviour. Here we show that functional compatibility, the extent to which new learning can coexist with behaviour that must be preserved, is a causal determinant of persistent learning. To our knowledge, this is the first controlled causal demonstration in which compatibility is deliberately changed from matched neural states and persistent learning is measured under a common retention requirement. The effect generalizes across independent learning directions, convolutional and transformer architectures, vision and text, and additional seeds. Learning rules differ in how efficiently they exploit available compatibility, while retention constraints limit how much can be stored. At larger finite updates, nonlinear geometry changes the available learning opportunity and ultimately prevents the matched compatibility continuum from being realized. These results establish functional compatibility as an experimentally controllable principle of persistent neural learning, shifting the problem from preventing forgetting towards identifying which components of new learning can safely become permanent.

Problem

• stability-plasticity problem
• functional compatibility
• persistent learning

Innovation

• functional compatibility
• persistent learning
• neural networks
• retention constraints
• learning rules