π€ AI Summary
This work addresses the challenges of fragmented user data in personal artificial intelligence and the inability of existing retrieval-augmented generation (RAG) methods to effectively model semantic topology and temporal dependencies. To this end, we propose EpisTwin, a novel neuro-symbolic architecture that uniquely integrates user-centric personal knowledge graphs with dynamic visual relocalization. Leveraging multimodal large language models, EpisTwin transforms heterogeneous cross-application data into semantic triples and employs an intelligent coordinator to unify graph-based RAG with online visual refinement, enabling verifiable neuro-symbolic reasoning. We also introduce PersonalQA-71-100, a synthetic evaluation benchmark that significantly enhances the trustworthiness and holistic perception capabilities of personal AI systems, as demonstrated across multiple state-of-the-art evaluators.
π Abstract
Personal Artificial Intelligence is currently hindered by the fragmentation of user data across isolated silos. While Retrieval-Augmented Generation offers a partial remedy, its reliance on unstructured vector similarity fails to capture the latent semantic topology and temporal dependencies essential for holistic sensemaking. We introduce EpisTwin, a neuro-symbolic framework that grounds generative reasoning in a verifiable, user-centric Personal Knowledge Graph. EpisTwin leverages Multimodal Language Models to lift heterogeneous, cross-application data into semantic triples. At inference, EpisTwin enables complex reasoning over the personal semantic graph via an agentic coordinator that combines Graph Retrieval-Augmented Generation with Online Deep Visual Refinement, dynamically re-grounding symbolic entities in their raw visual context. We also introduce PersonalQA-71-100, a synthetic benchmark designed to simulate a realistic user's digital footprint and evaluate EpisTwin performance. Our framework demonstrates robust results across a suite of state-of-the-art judge models, offering a promising direction for trustworthy Personal AI.