Truth with a Twist: The Rhetoric of Persuasion in Professional vs. Community-Authored Fact-Checks

2026-01-20

AI Summary

This study investigates differences in the use of persuasive rhetoric between community-driven and professional fact-checking and their respective impacts on public judgment. By conducting a large-scale analysis of the Community Notes, EUvsDisinfo, and DBKF datasets—integrating natural language processing with statistical modeling—the research systematically quantifies, for the first time, the types and frequencies of rhetorical strategies employed in both forms of fact-checking texts. The findings reveal that community-authored fact-checks do not employ more persuasive techniques than professional counterparts, yet exhibit systematic differences in rhetorical structure. Institutional norms and topical coverage significantly shape discursive style. Crucially, crowd-review mechanisms effectively identify and mitigate problematic rhetoric, thereby enhancing the perceived credibility of fact-checking interventions.

Technology Category

• Natural Language Processing: Fact-Checking / Misinformation Detection (NLP Focus)
• Application Domains: Humanities & Computational Social Science
• Knowledge Representation and Reasoning: Argumentation

Application Category

• Economics, Online Markets and Human Computation: Trust and reliance of crowd workers and data experts on GenAI
• Web Mining and Content Analysis: Community question answering
• Search and Retrieval-Augmented AI: Web evaluation methodologies and metrics

Abstract

This study presents the first large-scale comparison of persuasion techniques present in crowd- versus professionally-written debunks. Using extensive datasets from Community Notes (CNs), EUvsDisinfo, and the Database of Known Fakes (DBKF), we quantify the prevalence and types of persuasion techniques across these fact-checking ecosystems. Contrary to prior hypothesis that community-produced debunks rely more heavily on subjective or persuasive wording, we find no evidence that CNs contain a higher average number of persuasion techniques than professional fact-checks. We additionally identify systematic rhetorical differences between CNs and professional debunking efforts, reflecting differences in institutional norms and topical coverage. Finally, we examine how the crowd evaluates persuasive language in CNs and show that, although notes with more persuasive elements receive slightly higher overall helpfulness ratings, crowd raters are effective at penalising the use of particular problematic rhetorical means

Problem

• fact-checking
• persuasion techniques
• community-authored
• professional fact-checks
• rhetoric

Innovation

• persuasion techniques
• fact-checking
• crowdsourced moderation
• rhetorical analysis
• Community Notes