Organize, Then Vote: Exploring Cognitive Load in Quadratic Survey Interfaces

2025-03-06

AI Summary

This study addresses cognitive overload in quadratic voting (QV) surveys caused by increasing option counts. We propose a two-stage “organize–vote” interface design that decouples the conventional single-step scoring process into preference construction and weight allocation phases. Grounded in human factors engineering and experimental psychology, the design guides users to allocate cognitive resources toward deliberate preference formation rather than mechanical rating, thereby mitigating satisfaction bias. A 2×2 between-subjects lab experiment demonstrates that, under long-list conditions (24 items), users exhibit increased per-item response time and significantly reduced edit distance; qualitative observations confirm heightened cognitive engagement in preference integration. This work is the first to integrate the “preference construction” paradigm into QV interface design, transcending traditional efficiency-centric interaction constraints. It offers a novel pathway to enhance both accuracy and adoption of digital surveys in collective decision-making contexts.

Technology Category

• Knowledge Representation and Reasoning: Preferences
• Humans and AI: Voting
• Machine Learning: Learning Preferences or Rankings

Application Category

• Economics, Online Markets and Human Computation: Data quality aspects of human-annotated datasets
• User Modeling, Personalization and Recommendation: Practical large-scale studies of user experience
• Responsible Web: Human-perceived consequences of algorithmic deployment on the web

Abstract

Quadratic Surveys (QSs) elicit more accurate preferences than traditional methods like Likert-scale surveys. However, the cognitive load associated with QSs has hindered their adoption in digital surveys for collective decision-making. We introduce a two-phase"organize-then-vote'' QS to reduce cognitive load. As interface design significantly impacts survey results and accuracy, our design scaffolds survey takers' decision-making while managing the cognitive load imposed by QS. In a 2x2 between-subject in-lab study on public resource allotment, we compared our interface with a traditional text interface across a QS with 6 (short) and 24 (long) options. Two-phase interface participants spent more time per option and exhibited shorter voting edit distances. We qualitatively observed shifts in cognitive effort from mechanical operations to constructing more comprehensive preferences. We conclude that this interface promoted deeper engagement, potentially reducing satisficing behaviors caused by cognitive overload in longer QSs. This research clarifies how human-centered design improves preference elicitation tools for collective decision-making.

Problem

• Reducing cognitive load in Quadratic Surveys for digital decision-making.
• Improving preference accuracy through a two-phase 'organize-then-vote' interface.
• Enhancing engagement and reducing satisficing in longer survey options.

Innovation

• Two-phase 'organize-then-vote' QS interface
• Reduces cognitive load in digital surveys
• Scaffolds decision-making, improves preference accuracy