Grokipedia vs Wikipedia: An LLM-Based Audit of Political Neutrality along Ideologies

arXiv cs.CL · 6 hours ago

Researchers compared Grokipedia, an encyclopedia written entirely by the LLM Grok, against Wikipedia for political bias across 1,394 articles about government members using four different LLM judges. All four judges rated Grokipedia as less neutral than Wikipedia overall, with Grokipedia showing favor toward economically right-wing politicians and disfavor toward socially liberal ones, while Wikipedia displayed the opposite pattern. The study suggests that an LLM-based encyclopedia does not necessarily achieve greater neutrality but instead embeds different ideological biases than traditional encyclopedias.