Who Pays for Open Review? Visible Author Reputation and Its Effect on Ratings

2026-09-07

AI Summary

研究通过分析ICLR 2026的18,000多篇投稿，探讨了从匿名评审转为开放评审对作者声誉与评分关系的影响，发现开放评审下高声誉作者更受益。

Abstract

An OpenReview bug in November 2025 broke anonymity at several conferences and prompted calls for open review, which motivate us to ask what shifting from blind to open would mean for authors. Analyzing over 18,000 reviewed submissions to ICLR 2026, split into de facto open and blind groups by arXiv preprint timing, we find that ratings rise with author reputation under both mechanisms, with a steeper slope under open review that is statistically significant, and that the open-blind difference is concentrated at the borderline ratings. The pattern holds across five reputation proxies (including institution, h-index, and citation count), three author-aggregation rules, and five definitions of the open window. A controlled simulation with five AI models as reviewers, holding the manuscript fixed and varying the author reputation, reproduces the effect. With claude-opus-5 as the reviewer, for example, rating rises by 0.5 points as the author moves from low to high reputation.

Problem

• Open Review
• Author Reputation
• Ratings

Innovation

• open review
• author reputation
• simulation with AI models