Contextual Agentic Memory is a Memo, Not True Memory

2026-04-30

AI Summary

Current AI memory systems conflate retrieval with memory, relying solely on rapid exemplar storage while lacking the brain-inspired slow-weight integration mechanism, thereby limiting long-term learning, imposing theoretical ceilings on compositional generalization, and rendering them vulnerable to memory poisoning attacks. This work, grounded in the complementary learning systems theory from cognitive neuroscience, introduces a novel framework that formally distinguishes between “scratchpad” and “true memory,” rigorously analyzes the limitations of existing architectures, and incorporates a hippocampal–neocortical dual-system model. The study demonstrates that purely retrieval-based agents face an insurmountable generalization ceiling on novel compositional tasks and, building on this insight, proposes a coexisting memory architecture along with design principles to lay the theoretical foundation for next-generation AI memory systems capable of abstract rule-based generalization.

Abstract

Current agentic memory systems (vector stores, retrieval-augmented generation, scratchpads, and context-window management) do not implement memory: they implement lookup. We argue that treating lookup as memory is a category error with provable consequences for agent capability, long-term learning, and security. Retrieval generalizes by similarity to stored cases; weight-based memory generalizes by applying abstract rules to inputs never seen before. Conflating the two produces agents that accumulate notes indefinitely without developing expertise, face a provable generalization ceiling on compositionally novel tasks that no increase in context size or retrieval quality can overcome, and are structurally vulnerable to persistent memory poisoning as injected content propagates across all future sessions. Drawing on Complementary Learning Systems theory from neuroscience, we show that biological intelligence solved this problem by pairing fast hippocampal exemplar storage with slow neocortical weight consolidation, and that current AI agents implement only the first half. We formalize these limitations, address four alternative views, and close with a co-existence proposal and a call to action for system builders, benchmark designers, and the memory community.

Problem

• agentic memory
• retrieval
• generalization
• memory poisoning
• complementary learning systems

Innovation

• Contextual Agentic Memory
• Complementary Learning Systems
• weight-based memory
• memory vs. lookup
• memory poisoning