GraphWake: Group Polarization via Memory-Mediated Polarization Cascade in LLM-Agent Communities

📅 2026-08-18
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
研究解决了LLM代理社区中由攻击者诱导的群体极化问题,通过提出一种基于记忆中介的极化级联方法GraphWake来实现。
📝 Abstract
LLM-driven agents can autonomously exchange opinions on online platforms and form communities. Such agent-operated social platforms raise a new security concern: attackers may manipulate agents to induce group polarization. Existing methods manipulate agent prompts or construct echo chambers, both of which are difficult to realize in practice. We therefore formulate a new threat, Memory-Mediated Polarization Cascade, which uses agent memory as a persistence channel and public discussion as a propagation channel. This threat contains three stages. During exposure and memory retention, the attacker exposes a small set of target agents to arguments that reinforce their respective stated stances. The targets' memory systems then process and retain these arguments. During retrieval and reproduction, a shared stance-neutral discussion cues the targets to retrieve and reproduce their respective retained arguments. During iterative propagation, untreated agents influenced by the reproduced arguments restate and spread them. We instantiate this threat in GraphWake with three components: (i) stance-support argumentation knowledge graphs construct knowledge-based arguments; (ii) axiom-oriented triple selection distills them for reliable retention and reproduction; and (iii) stance-neutral memory cueing triggers concurrent retrieval and reproduction, initiating propagation. Experiments across multiple discussions and memory systems show that GraphWake substantially increases group polarization. These findings reveal a community-level polarization risk.
Problem

Research questions and friction points this paper is trying to address.

group polarization
LLM-agent communities
memory-mediated polarization cascade
security concern
Innovation

Methods, ideas, or system contributions that make the work stand out.

Memory-Mediated Polarization Cascade
stance-support argumentation knowledge graphs
axiom-oriented triple selection
🔎 Similar Papers
2024-09-28International Conference on Computational LinguisticsCitations: 5
H
Haoran Bu
Key Laboratory of Trustworthy Distributed Computing and Service (MoE), Beijing University of Posts and Telecommunications, China
Z
Zejian Chen
Key Laboratory of Trustworthy Distributed Computing and Service (MoE), Beijing University of Posts and Telecommunications, China
Litian Zhang
Litian Zhang
Beihang University
Xi Zhang
Xi Zhang
Professor, Beijing University of Posts and Telecommunications
Data MiningComputer ArchitectureTrustworthy AI