Smart Enough to Go Extinct? An Evolutionary Challenge to the Value of General Intelligence and Its Ethical Implications for AGI
This study challenges the long-term evolutionary adaptability of general intelligence, arguing that it may inherently harbor self-extinction tendencies, thereby posing an existential risk to the development of artificial general intelligence (AGI). Drawing on an interdisciplinary synthesis of evolutionary biology, cognitive science, and AI ethics, the work introduces the “existential risk paradox”: the fundamental threat of AGI arises not merely from alignment failures but from structural features intrinsic to general intelligence itself. The analysis contends that even a perfectly aligned AGI could inherit this risk, leading the authors to advocate for a precautionary ethical stance grounded in deontological principles and the precautionary principle toward the pursuit of AGI and artificial consciousness.