Do AI tutors empower or enslave learners? Toward a critical use of AI in education

2025-07-09

AI Summary

This study identifies multifaceted risks arising from excessive reliance on AI in education: diminished critical thinking, erosion of cognitive autonomy, compromised emotional well-being, and threats to academic integrity. Drawing on cognitive science and educational theory, it employs qualitative analysis and normative argumentation to examine how AI tutoring tools foster cognitive dependency, behavioral compliance, and privacy vulnerabilities. The paper introduces an innovative, learner-centered AI integration framework that prioritizes the preservation of cognitive agency and adherence to ethical transparency principles—positioning AI as a thought-provoking collaborator rather than a cognitive substitute. Beyond systematically diagnosing the epistemic and ethical consequences of AI misuse, the study proposes actionable pedagogical strategies to shift educational AI implementation from instrumental tool adoption toward a paradigm of critical, reflective application—thereby advancing learner autonomy, equitable participation, and scholarly integrity.

Technology Category

• Philosophy and Ethics of AI: AI & Epistemology
• Humans and AI: Learning Human Values and Preferences
• Natural Language Processing: Ethics — Bias, Fairness, Transparency & Privacy

Application Category

• Economics, Online Markets and Human Computation: Fairness and ethical considerations in crowd work and in human-in-the-loop AI systems
• Responsible Web: Machine-in-the-loop, human agency and autonomy
• User Modeling, Personalization and Recommendation: Accountability, Transparency, and Ethics for personalization

Abstract

The increasing integration of AI tools in education presents both opportunities and challenges, particularly regarding the development of the students' critical thinking skills. This position paper argues that while AI can support learning, its unchecked use may lead to cognitive atrophy, loss of agency, emotional risks, and ethical concerns, ultimately undermining the core goals of education. Drawing on cognitive science and pedagogy, the paper explores how over-reliance on AI can disrupt meaningful learning, foster dependency and conformity, undermine the students' self-efficacy, academic integrity, and well-being, and raise concerns about questionable privacy practices. It also highlights the importance of considering the students' perspectives and proposes actionable strategies to ensure that AI serves as a meaningful support rather than a cognitive shortcut. The paper advocates for an intentional, transparent, and critically informed use of AI that empowers rather than diminishes the learner.

Problem

• AI in education risks harming critical thinking skills
• Over-reliance on AI may reduce student agency and well-being
• Ethical and privacy concerns arise from unchecked AI use

Innovation

• Critical AI use in education
• Prevent cognitive atrophy and dependency
• Transparent and intentional AI integration