Toward Democracy Levels for AI

2024-11-14

arXiv.org

AI Summary

How can democratic governance of AI systems’ systematic decision-making be institutionalized to enhance public participation and societal trust? Method: This study develops the first operational “Democratic Maturity” assessment framework, integrating deliberative democratic theory with empirical AI governance practice to address the absence of quantifiable metrics for democratic engagement in AI. Through theoretical modeling, cross-case comparative analysis, and empirical framework application, we construct a five-tier progressive assessment system that delineates evolutionary pathways toward Democratic AI, Pluralistic AI, and Public AI ecosystems. Contribution/Results: The framework has been deployed in public engagement design at organizations including Meta and Anthropic, strengthening organizational legitimacy and external accountability. It further provides a standardized instrument for policymakers and third-party auditors, advancing AI governance from technocentric paradigms toward institutionalized democratic practice.

Technology Category

• Philosophy and Ethics of AI: Safety, Robustness & Trustworthiness
• Humans and AI: Learning Human Values and Preferences
• Multiagent Systems: Agent/AI Theories and Architectures

Application Category

• Systems and Infrastructure for Web, Mobile and WoT: Applied ML and AI for Web-based mobile applications
• Search and Retrieval-Augmented AI: Web evaluation methodologies and metrics
• Semantics and Knowledge: Data modeling to support human-machine intelligence, including LLMs agents, intelligent system behavior, explanations, and user-friendly interactions

Abstract

There is increasing concern about the unilateral power of the organizations involved in the development, alignment, and governance of AI. Recent pilots - such as Meta's Community Forums and Anthropic's Collective Constitutional AI - have illustrated a promising direction, where democratic processes might be used to meaningfully improve public involvement and trust in critical decisions. However, there is no standard framework for evaluating such processes. In this paper, building on insights from the theory and practice of deliberative democracy, we provide a"Democracy Levels"framework for evaluating the degree to which decisions in a given domain are made democratically. The framework can be used (i) to define milestones in a roadmap for the democratic AI, pluralistic AI, and public AI ecosystems, (ii) to guide organizations that need to increase the legitimacy of their decisions on difficult AI governance questions, and (iii) as a rubric by those aiming to evaluate AI organizations and keep them accountable.

Problem

• Democratizing AI requires democratic governance and alignment
• Democratic processes improve public involvement and trust in AI decisions
• Framework defines milestones for democratic and human-centered AI

Innovation

• Democratic governance for AI alignment
• Community Forums for public involvement
• Democracy Levels framework for evaluation