Detecting Collusion in Peer Review: Drawing Inspiration from VCG Principle

2026-08-09

AI Summary

This work addresses the critical threat posed by covert collusion among peer reviewers, which undermines the integrity of academic review processes. Traditional approaches relying on explicit social networks often fail to detect collusive groups lacking prior connections. To overcome this limitation, the paper proposes a novel, social-graph-free auditing framework that introduces the Vickrey–Clarke–Groves (VCG) mechanism into collusion detection for the first time. By leveraging semantic embeddings and marginal influence analysis, the method quantifies anomalous reviewer behavior and integrates multi-algorithm decoupled search with consensus fusion strategies to effectively uncover both overt and concealed collusion. Evaluated on the large-scale ICLR 2021 dataset, the approach demonstrates high sensitivity, strong robustness, and privacy preservation, offering conference organizers a scalable, statistically rigorous tool with family-wise error rate (FWER) control.

Abstract

The peer-review process, the bedrock of scientific advancement, is increasingly undermined by sophisticated collusion rings that systematically manipulate review outcomes to favor in-group members. While existing detection methods struggle to untangle obfuscated social ties in explicit co-authorship graphs, we introduce a new direction: Exclusion Based Anomaly Detection. Similar to the way VCG auctions work, we formally measure the marginal influence of suspected reviewer groups, exposing their signature even when explicit social graphs are hidden. To apply this at scale without prior knowledge of colluding groups, we introduce the Embedding Based Discovery Framework, which leverages continuous semantic embeddings to isolate latent collusive communities directly from their semantic profile, bypassing the adversarial limitations of explicit network analysis. Unlike traditional heuristic-based approaches, our framework functions as an automated auditor, requiring no prior knowledge of group membership. It achieves this by executing a decoupled search across independent diagnostic algorithms and combining their findings into distinct consensus formations, allowing organizers to dynamically balance detection precision and recall. Evaluating our technique with large-scale datasets (based on ICLR 2021) shows our method's capacity to identify both overt and subtle adversarial tactics with high sensitivity and strict Family-Wise Error Rate (FWER) control, effectively providing conference organizers with a scalable, robust, and privacy-preserving tool to secure the scientific integrity of academic publishing.

Problem

• collusion detection
• peer review
• adversarial manipulation
• scientific integrity
• anomaly detection

Innovation

• Exclusion Based Anomaly Detection
• VCG Principle
• Embedding Based Discovery Framework
• Collusion Detection
• Peer Review Integrity