Designing AI Systems that Augment Human Performed vs. Demonstrated Critical Thinking

2025-04-20

AI Summary

This study addresses the profound impact of generative AI on human critical thinking, identifying a critical distinction between “demonstrated” and “performed” critical thinking and exposing cognitive offloading risks in AI-augmented reasoning. Method: Employing conceptual analysis and interdisciplinary integration—drawing on cognitive science, educational theory, and psychology—the work constructs, without reliance on empirical data or model training, the first human-cognitive-development-centered AI design framework. Contribution/Results: It establishes a novel evaluative standard to determine whether AI genuinely augments—not displaces—human critical thinking; shifts the AI development paradigm from output optimization toward cognitive empowerment; and provides foundational theory and design principles for human-centered, human-AI collaborative cognitive systems. The framework prioritizes metacognitive scaffolding, epistemic agency, and developmental fidelity, thereby advancing responsible AI design that sustains and cultivates higher-order human cognition.

Technology Category

• Philosophy and Ethics of AI: Artificial General Intelligence
• Humans and AI: Game Design — Procedural Content Generation & Storytelling
• Cognitive Modeling & Cognitive Systems: Conceptual Inference and Reasoning

Application Category

• Economics, Online Markets and Human Computation: Economic ramifications for generative AI infrastructure and applications
• Semantics and Knowledge: Data modeling to support human-machine intelligence, including LLMs agents, intelligent system behavior, explanations, and user-friendly interactions
• Responsible Web: Machine-in-the-loop, human agency and autonomy

Abstract

The recent rapid advancement of LLM-based AI systems has accelerated our search and production of information. While the advantages brought by these systems seemingly improve the performance or efficiency of human activities, they do not necessarily enhance human capabilities. Recent research has started to examine the impact of generative AI on individuals' cognitive abilities, especially critical thinking. Based on definitions of critical thinking across psychology and education, this position paper proposes the distinction between demonstrated and performed critical thinking in the era of generative AI and discusses the implication of this distinction in research and development of AI systems that aim to augment human critical thinking.

Problem

• Distinguishing demonstrated vs performed critical thinking with AI
• Examining AI's impact on human cognitive abilities
• Designing AI systems to augment human critical thinking

Innovation

• AI systems augment human critical thinking
• Distinguish demonstrated vs performed thinking
• Generative AI impacts cognitive abilities