Grokipedia vs Wikipedia: An LLM-Based Audit of Political Neutrality along Ideologies

2026-07-16

AI Summary

This study investigates whether Grokipedia—encyclopedic content generated by large language models (LLMs)—exhibits greater political neutrality than Wikipedia or merely reflects different ideological biases. Employing a novel nine-dimensional ideological framework developed by domain experts, the research presents the first large-scale empirical assessment of political orientation in biographical entries for 1,394 government figures across both encyclopedias. To mitigate annotator bias, the authors innovatively deploy four distinct LLMs—Grok, Claude, Mistral, and DeepSeek—as cross-evaluators. Results consistently demonstrate that Grokipedia is significantly less neutral than Wikipedia, displaying a pronounced tilt toward economic conservatism and a tendency to negatively frame social liberals, whereas Wikipedia leans more toward social liberalism.

Abstract

Online encyclopedias shape political opinion and, through it, democratic discourse. In late 2025, Grokipedia was released, an encyclopedia written entirely by the LLM Grok. One motivation behind the project was to provide an unbiased alternative to Wikipedia, which has faced accusations of "left-wing" and "liberal" bias. But does an encyclopedia written by an LLM deliver greater neutrality, or does it simply embed a different ideology? We conduct a large-scale political bias study on Grokipedia and Wikipedia, analysing 1,394 article pairs describing members of government for neutrality along nine expert-coded ideology dimensions employing four LLM judges, Grok, Claude, Mistral, and DeepSeek. As the LLMs could themselves be biased, we also investigate patterns in their judgments. We find all LLM-judges, including Grok, to rate Grokipedia less neutral than Wikipedia. Both encyclopedias are rated as portraying politicians favourably overall, but towards different ideological groups. Grokipedia particularly favours economically right-wing politicians and penalises socially liberal ones, while Wikipedia is rated as favourably biased towards the latter.

Problem

• political neutrality
• ideological bias
• large language models
• online encyclopedias
• Wikipedia

Innovation

• LLM-generated content
• political bias audit
• ideological neutrality
• comparative encyclopedia analysis
• AI alignment