🤖 AI Summary
This study addresses the incompatibility of traditional reputation mechanisms with language model agents, whose “dissociative” identities—characterized by modular variability, discontinuous identity, and limited accountability—undermine the prerequisites of identifiability, predictability, and trustworthiness. Introducing the concept of dissociative identity into AI governance for the first time, the paper draws on legal analogies, multi-agent system analysis, and institutional design theory to expose the fundamental flaws of the “Know Your Agent” paradigm. It demonstrates that reputation systems are structurally ill-suited to agent-based environments and proposes a novel governance paradigm centered on observability and protocol-based, ex ante, constitutive behavioral constraints. This shift offers an innovative pathway toward enabling trustworthy interactions among AI agents.
📝 Abstract
As autonomous language model agents proliferate, forming an emerging agentic web with real-world consequences, what credibility signals can you use to decide whether to trust an unfamiliar agent in the wild and delegate to it? A natural governance intuition is to extend human identity verification and reputation mechanisms, from ``Know Your Customer'' and credit scores to ``Know Your Agent'' regimes. However, we argue that this analogy is fundamentally incomplete. Reputation mechanisms function both as social signals and as corrective feedback that sustain an equilibrium of trustworthy behavior, presuming a persistent identity associated with behavioral continuity, sanction sensitivity, and costly non-fungibility. Yet language model agents are ontologically \emph{dissociative}: they are essentially an assemblage of mutable modules -- foundational models, system prompts, tool-access policies, external memory, and, in some cases, a multi-agent system as a whole -- any of which may change agent behavior -- with a fluid persona that is also vulnerable to adversarial attack and may not internalize sanctions. Drawing on dissociative identity disorder jurisprudence, this dissociativity leaves agents without grounding for identifiability, predictability, credibility, and rehabilitability -- the very properties that reputation mechanisms aim to sustain -- thereby collapsing trust. We argue that identity-based, ex post, regulative, sanction-based governance, such as reputation, is structurally inapplicable to dissociative agents, and we suggest a shift to observability-based, ex ante, constitutive, protocol-based behavioral harnesses.