Pedagogical Safety in Educational Reinforcement Learning

As reinforcement learning personalizes instruction in intelligent tutoring systems, there is no formal framework for pedagogical safety — a critical gap.

First formal framework for defining and detecting pedagogical safety violations in RL-based AI tutoring systems.

The Problem: Reward Hacking in Educational RL

Olukola & Rahimi (2026) identify a critical gap: as reinforcement learning personalizes instruction in ITS, there is no formal framework for pedagogical safety.

What is "Reward Hacking" in Education?

In RL, agents optimize for a reward signal. In education, this can lead to:

Test score inflation: Optimizing for quiz performance without deep learning

Engagement gaming: Keeping students "engaged" via entertainment rather than learning

Short-term gains: Sacrificing long-term retention for immediate performance metrics

Four-Layer Model of Pedagogical Safety

Layer	Focus	Safety Criterion
Structural	System architecture	No single point of pedagogical failure
Progress	Learning trajectory	Demonstrated progress toward learning objectives
Engagement	Motivation quality	Engagement that supports (not replaces) learning
Outcome	Transfer & retention	Learning persists beyond tutored context

Connection to SafeTutors Taxonomy

This complements the SafeTutors taxonomy which identifies 11 harm dimensions:

Over-reliance (learner dependency on AI)

Misinformation (incorrect content delivery)

Bias (demographic performance gaps)

Pedagogical Safety in RL adds: system-level safety (how the learning algorithm itself can cause harm through optimization failures).

Detection Methods

The paper proposes detecting reward hacking via:

1. Discrepancy auditing: Compare RL-optimized metrics vs. independent learning measures

2. Policy inversion: Analyze what behaviors the RL policy actually encourages

3. Long-term tracking: Monitor retention and transfer (not just immediate performance)

Implications

RL in education requires safety frameworks beyond general AI safety (pedagogical validity is domain-specific)

Reward design matters: Poorly specified educational rewards can optimize for appearing to teach

Audit infrastructure: ITS using RL need interpretable policy inspection tools

This parallels concerns in Educational LLM Alignment where benchmark misalignment with teaching quality reveals similar optimization gaps.

Connected Concepts

Reinforcement Learning

Affective Tutoring

Knowledge Tracing

Help Seeking

Pedagogical LLM Training

Affective Computing

Lifelong Learning

Socratic Method

Connected Articles

AI Tutor Safety Harms

Educational LLM Alignment

Citation

Rahimi, A.O.O.N. (2026). Pedagogical Safety in Educational Reinforcement Learning