ROAM: Robust Organization of Atomic Memories for Agents through Semantic Relations

📅 2026-09-09
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
ROAM通过语义关系管理原子记忆,解决长期语言模型代理中记忆冗余、重叠或冲突问题,提高回答准确性。
📝 Abstract
Long-term language-model agents rely on external memory across interactions. Atomic memories are particularly useful: their fine-grained semantic boundaries enable precise retrieval and direct comparison between observations. Yet accumulating atoms inevitably become redundant, overlapping, or conflicting. Existing methods often ask an LLM manager to add, update, delete, or rewrite memories directly, coupling semantic interpretation, storage decisions, and content generation in one error-prone operation. We introduce ROAM, a relation-guided framework that uses atomicity for management while allowing richer answer-time representations. ROAM classifies incoming--stored atom pairs as independent, equivalent, directionally subsuming, or conflicting, then organizes observations into active Primary and supporting Evidence roles. Fusion subsequently combines complementary details and temporal changes into compact, potentially non-atomic views. Only Primary views are retrieved for answering, preventing redundant or outdated atoms from competing independently. Across models and evaluation settings, ROAM improves answer accuracy by up to 29.8 percentage points. Ablations show complementary benefits from different relations and consistent gains from fusion beyond role organization. Mechanism analysis further finds 15.6-point higher answer-critical source recall and an 11.5-point lower confounder-token share. ROAM remains robust across manager scales.
Problem

Research questions and friction points this paper is trying to address.

atomic memories
redundant
conflicting
external memory
long-term language-model agents
Innovation

Methods, ideas, or system contributions that make the work stand out.

Semantic Relations
Atomic Memories
Role Organization
Fusion
Answer Accuracy
J
Jianjie Zheng
Southern University of Science and Technology
P
Peng Lai
Southern University of Science and Technology
S
Sijie Cheng
Tsinghua University, RayNeo.AI
J
Jiehui Zhao
Deepexi Technology Co. Ltd.
L
Lei Yang
Deepexi Technology Co. Ltd.
Guanhua Chen
Guanhua Chen
Assistant Professor, Southern University of Science and Technology
Reasoning LLMsData SynthesisMultimodal