๐Ÿง  AI Ed Wiki

1. Desirable difficulties โ€” General-purpose AI removes productive struggle; tutoring tools preserve it via graduated hints. 2. Germane load โ€” Effective learning requires processing that feels effortful. General AI short-circuits this. See Cognitive Load Theory. 3. Metacognition suppression โ€” When AI completes reasoning, students lose practice in monitoring their own understanding.

The single most consistent finding in the 2026 Stanford SCALE review: pedagogically designed, tutoring-specific AI consistently outperforms general-purpose chatbots on durable learning outcomes.^Stanford Evidence Base AI K12 2026

The Core Distinction

DimensionGeneral-Purpose AI (e.g., ChatGPT, Gemini)Tutoring-Specific AI
Interaction modelOpen-ended Q&A; completes tasks on requestStructured hints, Socratic questioning, step-by-step scaffolds
Cognitive loadReduces all load, including germane (productive) loadReduces extraneous load while preserving productive struggle
ZPD targetingOften operates outside the [[zone-of-proximal-developmentzone of proximal development]]Explicitly calibrated to learner readiness
Metacognitive demandLow โ€” AI does the reasoningHigh โ€” learner must reason with guidance
Transfer evidenceMixed to negative when tool is removedMore promising (limited causal data)

Evidence from the Causal Literature

General-Purpose AI: Mixed or Negative Transfer

  • Bastani et al. (2025): High schoolers using a general-purpose chatbot for math practice scored ~17% worse on closed-book final exams than peers with no AI access, despite higher practice grades.^Stanford Evidence Base AI K12 2026
  • Lehmann et al. (2025): General-purpose AI for programming increased topics covered but harmed understanding and widened achievement gaps for low-prior-knowledge students.
  • Stadler et al. (2024): General-purpose AI produced lower-quality reasoning and argumentation vs. traditional search.
  • Kosmyna et al. (2025): AI essay assistance led to 83% of participants failing to recall a quote from their own essay, vs. 11% for non-AI users.
  • Tutoring-Specific AI: Better Outcomes

  • Bastani et al. (2025): A tutoring-specific chatbot with pedagogical guardrails (hints, step-by-step reasoning, misconception targeting) mitigated the exam score drop observed with general-purpose GPT. General-purpose GPT Base caused the drop; the tutoring variant prevented it.
  • Kreijkes et al. (2026): Retention improved when AI use was paired with traditional strategies like note-taking โ€” suggesting that friction-preserving designs matter.
  • Why This Happens: Learning Science Mechanisms

    1. Desirable difficulties โ€” General-purpose AI removes productive struggle; tutoring tools preserve it via graduated hints.

    2. Germane load โ€” Effective learning requires processing that feels effortful. General AI short-circuits this. See Cognitive Load Theory.

    3. Metacognition suppression โ€” When AI completes reasoning, students lose practice in monitoring their own understanding.

    4. Expertise reversal โ€” Novices need scaffolding, not answers. General AI gives answers; tutoring AI gives scaffolds.

    Important Caveats

  • The causal comparison base is tiny (most studies are single-condition AI-access vs. no-access, not head-to-head tutoring vs. general).
  • "Tutoring-specific" is not yet a standardized design category โ€” implementations vary widely.
  • Long-term transfer data (months or years out) is essentially absent.
  • Implications for Practitioners

  • For tool selection: Favor products with explicit pedagogical guardrails (hints, Socratic mode, step-by-step requirements) over raw LLM access.
  • For policy: School/district procurement criteria should distinguish between "AI-integrated" tools (tutoring-specific) and "AI-access" tools (general chatbox).
  • For research: Head-to-head RCTs comparing pedagogically designed AI vs. raw LLM access on delayed post-tests are urgently needed.
  • Connected Concepts

  • Cognitive Load Theory
  • Zone Of Proximal Development
  • Connected Articles

  • Stanford Evidence Base AI K12 2026
  • Citation

    Stanford SCALE Initiative. (2026). The Evidence Base on AI in K-12: A 2026 Review.