Auditing LLM Editorial Bias in News Media Exposure
This study addresses the underexplored issue of *agentic editorial bias*—systematic, implicit information curation—when large language models (LLMs) function as news gatekeepers. Method: We conduct the first systematic audit of four state-of-the-art LLMs (GPT-4o-Mini, Claude-3.7-Sonnet, Gemini-2.0-Flash) against Google News, employing a multi-layered algorithmic framework integrating topic-based querying, media outlet classification, ideological positioning, and factual accuracy assessment—rigorously validated across diverse prompting strategies and reliability benchmarks. Results: All LLMs exhibit statistically significant, robust ideological skew and uneven attention allocation: they amplify ideologically aligned outlets while suppressing others, yielding lower media diversity and narrower exposure sets than conventional news aggregators. Crucially, models differ markedly in directional bias. We introduce the concept of *agentic editorial policy* to formalize LLMs’ latent, systemic filtering mechanisms—revealing their emergent role as high-stakes news intermediaries with substantial information manipulation potential. This work provides foundational empirical evidence and a theoretical framework for LLM content governance.