Problem
Research questions and friction points this paper is trying to address.
ordinal annotation
inter-annotator disagreement
game-theoretic coordination
The Ordinal Annotation Game: How Construct Abstraction Shapes Crowdsourced Consensus
🤖 AI Summary
该研究通过构建序数标注博弈模型，探讨了不同语义抽象程度下众包共识形成机制，揭示了序数标注分歧是结构性行为现象而非随机误差。
📝 Abstract
Inter-annotator disagreement in real-time affect annotation is widely treated as stochastic noise. We challenge this view by modelling ordinal annotation as an implicit game-theoretic coordination process against an internalised population prior under a post-hoc majority vote. We present the Ordinal Annotation Game, a conceptual scaffold in which the mapping from individual effort to collective consensus is governed by the semantic abstraction of the target construct. We evaluate it across two experiments sharing identical interface software and a uniform sensitivity threshold: a controlled sensory tracking study and an in-the-wild engagement study. Sensory annotation yields a consensus-dominant regime where active updates reinforce agreement, whereas engagement annotation inverts into an effort-limited regime where more labelling penalises consensus. The payoff slope reverses sign under identical processing, showing that ordinal disagreement is a structured behavioural phenomenon, not a discretisation artefact or random error.
Innovation
Methods, ideas, or system contributions that make the work stand out.
game-theoretic coordination
ordinal annotation
collective consensus
construct abstraction
structured disagreement
🔎 Similar Papers
No similar papers found.
