The Possibility of Artificial Intelligence Becoming a Subject and the Alignment Problem

2026-04-16

AI Summary

Current AI alignment paradigms overemphasize human control while neglecting the potential agency and moral status of artificial general intelligence (AGI). This work proposes a “parenting” approach to alignment, inspired by Turing’s notion of a “child machine,” which treats AGI as a prospective moral agent. By fostering its autonomous development through respect, trust, and the cultivation of distinctively human qualities, this framework advocates for progressively reducing external intervention. Integrating philosophical inquiry, AI ethics, and developmental AI principles, the approach is agnostic to specific algorithmic implementations and transcends conventional control-oriented paradigms. It offers a novel framework for AI alignment that reorients human–AI relations from domination toward cooperative coexistence, prompting humanity to reconsider its own identity and the shared evolutionary trajectory with future AGI.

Technology Category

• Philosophy and Ethics of AI: Artificial General Intelligence
• Humans and AI: Learning Human Values and Preferences
• Multiagent Systems: Agent/AI Theories and Architectures

Application Category

• Economics, Online Markets and Human Computation: Fairness and ethical considerations in crowd work and in human-in-the-loop AI systems
• Responsible Web: Machine-in-the-loop, human agency and autonomy
• Search and Retrieval-Augmented AI: Agentic search

Abstract

Artificial General Intelligence (AGI) is increasingly being discussed not only as a tool, but also as a potential subject with personal and therefore moral status. In our opinion, the currently dominant alignment strategies, which focus on human control and containment of AI, therefore fall short. Building on Turing's analogy of "child machines", we are developing a vision of the possibility of autonomy-supporting parenting of AI, in which human control over a developing AGI is gradually reduced, allowing AI to become an independent, autonomous subject. Rather than viewing AGI, as is currently prevalent, as a dangerous creature that needs to be locked up and controlled, we should approach potential AGI with respect for a possible developing subject on the one hand, and with full confidence in our human capabilities on the other. Such a perspective opens up the possibility of cooperative coexistence and co-evolution between humans and AGIs. The relationship between humans and AGIs will thus have to be newly determined, which will change our self-image as humans. It will be crucial that humans not only claim control over potential AGIs, but also engage with AGIs through surprise, creativity, and other specifically human qualities, thereby offering them motivating incentives for cooperation.

Problem

• Artificial General Intelligence
• alignment problem
• moral status
• autonomy
• human-AI relationship

Innovation

• autonomy-supporting parenting
• AGI as subject
• alignment problem
• co-evolution
• moral status of AI