Critical AI Tutors: Empower or Enslave?

Critical AI Tutors: Empower or Enslave? — A position paper presented at the AIED 2025 workshop that issues a stark warning: unchecked use of AI tutors risks creating a generation of cognitively atrophied learners who have traded genuine understanding for the illusion of competence. Drawing on cognitive science and pedagogical theory, the authors argue that AI tutors without intentional guardrails lead to cognitive atrophy, loss of agency, emotional risks, and serious ethical concerns around privacy and academic integrity. The paper advocates for critically informed, transparent AI use that empowers rather than diminishes the learner, and calls for student perspectives to be centered in the design and deployment of AI tutoring systems.

Key Findings

This position paper occupies a critical counterpoint in the Intelligent Tutoring literature. While much of the field focuses on optimizing AI tutor performance and learning gains, the authors argue that effectiveness metrics alone are dangerously insufficient — what matters equally are the cognitive and developmental costs that AI tutors may impose on learners.

Cognitive atrophy and the shortcut problem. The central argument draws on Cognitive Load Theory and the well-established finding that effortful cognitive processing is essential for durable learning. When Intelligent Tutoring systems provide immediate, high-quality answers and solutions, they effectively short-circuit the very cognitive processes — struggling with problems, retrieving from memory, constructing explanations — that produce deep understanding. This phenomenon, which the authors term cognitive atrophy, mirrors concerns raised in the Efficiency Gain Illusion AI Overreliance and Cognitive Offloading literatures: learners may feel more productive while learning less.

Loss of agency and dependency. Beyond cognitive effects, the paper identifies a broader threat to learner agency. Prolonged reliance on AI tutors can produce Over Reliance — a state where students lose confidence in their own reasoning abilities and become dependent on AI assistance even for tasks they could complete independently. This dependency dynamic connects to the Correct Answer Trap AI Tutor problem and the finding that Over Reliance — students give up more quickly when AI help is available.

Emotional and well-being risks. The authors highlight underexplored emotional dimensions: AI tutor interactions can erode self-efficacy when students compare themselves unfavorably to flawless AI outputs, contribute to AI Fatigue Academic Contexts, and diminish the relational aspects of learning that Teacher Role frameworks seek to preserve.

Ethical concerns. The paper catalogs significant ethical risks including Academic Integrity erosion, questionable Privacy practices in educational AI systems, and the broader societal implications of AI Making Us Stupid — a provocative framing that challenges the edtech optimism narrative.

Implications

The paper's most important contribution is its call for critical AI literacy as a prerequisite for AI tutor deployment. Rather than banning AI tutors, the authors argue for what they call "critically informed use" — a framework where students, educators, and institutions actively interrogate AI tools rather than passively accepting them. This aligns with the Critical Thinking tradition in education and extends it to the domain of AI Literacy Power Knowledge.

For system designers, the paper implies that AI Tutor Safety Harms frameworks must expand beyond immediate harm prevention to include long-term developmental impacts. An AI tutor that never harms a student in the moment but gradually erodes their cognitive independence should be considered unsafe. This reframes Pedagogical Safety as encompassing not just what the tutor does but what kind of learner it produces.

The authors' emphasis on student voice — centering learner perspectives in design decisions — connects to the Student Experience literature and the growing recognition that Generative AI Guardrails Harm Learning must be co-designed with the very populations they aim to protect.

For educators and policymakers, this paper provides intellectual ammunition for resisting uncritical AI adoption. It suggests that Regulation of educational AI should consider not just data privacy and bias but also cognitive and developmental outcomes — a position that resonates with calls in the AI Governance Education community for holistic evaluation frameworks.

Connected Concepts

Connected Articles

Citation

Favero, L., Pérez-Ortiz, J.-A., Käser, T., & Oliver, N. (2025). Critical AI Tutors: Empower or Enslave?. arXiv:2507.06878.