The Credibility Revolution in Political Science

📅 2025-12-02
🏛️ arXiv.org
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
研究使用大语言模型分析政治学文章,发现基于设计的研究增加,但主要集中在顶级期刊和高排名机构,其他提高可信度的做法仍少见。
📝 Abstract
How has the credibility revolution shaped political science? We address this question by classifying 91,632 articles published between 2003 and 2023 across 156 political science journals using large language models, focusing on research design, credibility-enhancing practices, and citation patterns. We find that design-based studies -- those leveraging plausibly exogenous variation to justify causal claims -- have become increasingly common and receive a citation premium. In contrast, model-based approaches that rely on strong modeling assumptions have declined. Yet the rise of design-based work is uneven: it is concentrated in top journals and among authors at highly ranked institutions, and it is driven primarily by the growth of survey experiments. Other credibility-enhancing practices that help reduce false positives and false negatives, such as placebo tests and power calculations, remain rare. Taken together, our findings point to substantial but selective change, more consistent with a partial reform than a revolution.
Problem

Research questions and friction points this paper is trying to address.

credibility
political science
research design
citation patterns
exogenous variation
Innovation

Methods, ideas, or system contributions that make the work stand out.

large language models
design-based studies
credibility-enhancing practices
citation patterns
🔎 Similar Papers
No similar papers found.
💼 Related Jobs
No related jobs found.