🤖 AI Summary
Amid accelerating advances toward artificial general intelligence (AGI) and superintelligence, humanity faces an existential crisis of agency and subjectivity. This paper proposes the original ethical governance framework “Closing the AGI Door,” advocating a moratorium on autonomous AGI and superintelligence development in favor of trustworthy, human-centered augmented AI. Methodologically, it integrates philosophy of technology, AI safety theory, and institutional design to construct an interdisciplinary governance model and a human-centric AI capability assessment framework. Its core contribution is the first systematic articulation of the “augmentation-not-substitution” AI paradigm, grounding technological sovereignty firmly in human agency. The framework provides a pivotal conceptual anchor for global AI governance, catalyzing national “Human-Centered AI” strategies across multiple jurisdictions and steering industry R&D toward verifiably reliable, assistive AI systems. (149 words)
📝 Abstract
Dramatic advances in artificial intelligence over the past decade (for narrow-purpose AI) and the last several years (for general-purpose AI) have transformed AI from a niche academic field to the core business strategy of many of the world's largest companies, with hundreds of billions of dollars in annual investment in the techniques and technologies for advancing AI's capabilities. We now come to a critical juncture. As the capabilities of new AI systems begin to match and exceed those of humans across many cognitive domains, humanity must decide: how far do we go, and in what direction? This essay argues that we should keep the future human by closing the"gates"to smarter-than-human, autonomous, general-purpose AI -- sometimes called"AGI"-- and especially to the highly-superhuman version sometimes called"superintelligence."Instead, we should focus on powerful, trustworthy AI tools that can empower individuals and transformatively improve human societies' abilities to do what they do best.
