🧠 AI Ed Wiki

The null average performance effect masks strong offsetting heterogeneity β€” and the exam had severe ceiling compression (control mean 89.2/100, 47% β‰₯ 95), which also limits power. The belief reversal is striking: it contradicts "familiarity breeds acceptance" and suggests an arc from initial awe at AI's instant responses to awareness of its unintended effects.

Sungu, Lira & Duckworth (2026) ran one of the first large-scale RCTs of a teacher-facing generative AI tool and found it can harm students: providing teachers an AI teaching assistant reduced student intrinsic motivation by 0.11 SD and β€” among lower-performing teachers β€” cut student achievement by 0.13 SD. The pattern is a principal–agent problem: teachers (agents) gain labor savings from AI delegation while students (principals) bear the cost of displaced relational teaching and scaffolding.

The experiment

  • 538 teachers across 24 Turkish K-12 schools randomized at school-department level; analytical sample 193 teachers / 2,816 students / 14,198 student-course observations
  • Treatment: custom GPT-4o chatbot with Turkish Ministry of Education curriculum database + 1-hour training (one arm added weekly usage-stat reminders); control = business-as-usual
  • Pre-registered; ITT; semester-length (spring 2025)
  • Results

    OutcomeAverage effectHeterogeneity
    Student intrinsic motivationβˆ’0.111 SD (p=.015)Heavy baseline AI users: βˆ’0.182 (p=.015); light users: βˆ’0.052 (ns)
    Student confidenceβˆ’0.090 SD (p=.097)Lower-performing teachers: βˆ’0.183 (p=.012); higher: βˆ’0.022 (ns)
    Academic performanceβˆ’0.019 SD (ns, ceiling-compressed)Below-median teachers' students: βˆ’0.129 (p=.005); above-median: +0.054 (ns)
    Teacher beliefs about AI's effect on learning+0.126 SD (ns)Heavy prior users became more pessimistic (βˆ’0.379); light users more optimistic (+0.458)

    The null average performance effect masks strong offsetting heterogeneity β€” and the exam had severe ceiling compression (control mean 89.2/100, 47% β‰₯ 95), which also limits power. The belief reversal is striking: it contradicts "familiarity breeds acceptance" and suggests an arc from initial awe at AI's instant responses to awareness of its unintended effects.

    Why the harm happens: usage patterns

  • 66% of teacher conversations were teaching-material production (lecture prep 32%, homework/exam 22%, syllabus 9%); only 16% instructional support; 18% general
  • Shallow use: median 2 prompts, mean 4.7 messages per session β€” teachers accepted outputs with minimal iteration
  • Interpretation: task delegation, not pedagogical collaboration β€” the tool was a generator of finished artifacts rather than an iterative partner, limiting the pedagogical reflection that separates augmentation from substitution
  • Connected Concepts

  • Generative AI
  • K 12
  • Student Experience
  • Teacher AI Competency
  • Teacher Role
  • RAG
  • Connected Articles

  • Beyond Detection Authentic Assessment AI 2025 β€” Beyond Detection: redesigning authentic assessment in an AI-mediated world
  • Care Full Feedback GenAI β€” The care-full craft of feedback in an age of generative AI
  • GenAI Expertise Pathways Sysadmin β€” Unanticipated Effects of Generative AI on Expertise Pathways and Performance Perception in System Administration
  • Oecd Digital Education Outlook 2026 β€” OECD Digital Education Outlook 2026
  • Aaai2026 Prompting Literacy K12 β€” Learning to Use AI for Learning: Teaching Responsible Use of AI Chatbot to K-12 Students Through an AI Literacy Module
  • Academiclaw Student Agent Benchmark β€” AcademiClaw: When Students Set Challenges for AI Agents
  • Access Not Enough AI Tutoring 2026 β€” Access is Not Enough: Human Support Improves Engagement with AI Tutoring
  • Adapt Adaptive Lesson Plan Transformer β€” AdaPT: Adaptive Lesson Plan Transformer for Cross-Regional and Differentiated Instruction
  • Adaptive Pretesting Retention β€” Do Gains from Generative AI-Enabled Adaptive Pretesting Persist? Evidence from a Retention Study
  • Affective Text Wearable Student Health β€” A Formative Study of Brief Affective Text as a Complement to Wearable Sensing for Longitudinal Student Health Monitoring
  • Agency Gap AI Writing β€” The agency gap in AI-supported writing: how reactive and proactive agent designs shape multimodal reasoning
  • Agent Voice Accents K12 Group Learning β€” Exploring How Agent Voice Accents Shape Human-AI Collaboration in K-12 Group Learning
  • Agentic AI Education Scoping Review β€” Agentic AI in Education: A Scoping Review of Research Landscape, Capabilities, and the Frontier Agent Paradigm
  • Agentic Education Coding β€” Agentic Education with AI Coding Assistants
  • Agentic Literacy Debt β€” Agentic Literacy Debt: A Structural Problem the AI Literacy Field Has Not Yet Named
  • Agents That Teach Incidental Learning β€” Agents That Teach: Designing Incidental Learning Back into AI-Assisted Software Development
  • Agreement Not Quality LLM Coding Verification β€” Agreement Is Not Quality: Blind Expert Verification of Human and LLM Qualitative Coding When Human Consensus Is Not G...
  • AI Adult Learning Design β€” Guidelines for Designing AI Technologies to Support Adult Learning
  • AI Assessment Human Tutors β€” AI-Driven Assessment of Human Tutors: Linking Training Performance to Real-Life Practice
  • AI Assessment Scale Reform β€” A bit of chaos and madness": The AI Assessment Scale and the work of assessment reform
  • AI Assistance Discretionary Feedback β€” AI Assistance for Discretionary Work: Increasing Feedback Provision in Higher Education
  • AI Assisted Learning Modes Eeg β€” An exploratory behavioral and electroencephalographic study of artificial intelligence-assisted learning modes in hig...
  • AI Assisted Se Curriculum Syllabus Analysis 2026 β€” Mapping the Emerging Curriculum for AI-Assisted Software Engineering via Syllabus Analysis
  • AI Assisted Writing Research Teams β€” Smaller, Younger, and More Impactful: How AI-Assisted Writing Transforms Research Teams
  • AI Availability Student Motivation β€” Why Put in This Much Effort?": How AI Availability Shapes Students’ Motivation in Introductory Programming
  • Citation

    Sungu, Lira & Duckworth (2026). Generative AI Can Harm Teaching