🤖 AI Summary
This paper addresses the limitations of existing AI agent personalization frameworks in modeling user “personas” and capturing contextual awareness. To this end, we propose a knowledge graph–enhanced, community-aware personalized language modeling framework. Methodologically: (1) We construct a community-aware user knowledge graph by integrating LLM-generated graph indices with community-level behavioral summaries, enabling joint modeling of individual personas and collective knowledge; (2) We design a dynamic context-aware prompt generation mechanism that synergistically leverages Graph RAG, graph neural networks, and community detection algorithms to jointly reason over historical interactions and global interaction patterns. On the LaMP benchmark, our approach achieves +11.1% F1 in news classification, +56.1% F1 in movie tagging, and −10.4% MAE in product rating prediction—substantially outperforming state-of-the-art personalized RAG and fine-tuning baselines. Our core contributions are the first incorporation of community structure into user knowledge graph construction and the unification of persona-driven dynamic graph retrieval and generation.
📝 Abstract
We propose a novel framework for persona-based language model system, motivated by the need for personalized AI agents that adapt to individual user preferences. In our approach, the agent embodies the user's "persona" (e.g. user profile or taste) and is powered by a large language model (LLM). To enable the agent to leverage rich contextual information, we introduce a Knowledge-Graph-enhanced Retrieval-Augmented Generation (Graph RAG) mechanism that constructs an LLM-derived graph index of relevant documents and summarizes communities of related information. Our framework generates personalized prompts by combining: (1) a summary of the user's historical behaviors and preferences extracted from the knowledge graph, and (2) relevant global interaction patterns identified through graph-based community detection. This dynamic prompt engineering approach allows the agent to maintain consistent persona-aligned behaviors while benefiting from collective knowledge. On the LaMP benchmark, our method improves news categorization F1 by 11.1%, movie tagging F1 by 56.1%, and reduces product rating MAE by 10.4% over prior methods. Our code is available at https://anonymous.4open.science/r/PersonaAgentwGraphRAG-DE6F