📄 Full text: arXiv:2604.08947 · local
Human-in-the-loop evaluation framework for text simplification in ITS, addressing LLM output variability across prompting strategies.
The Challenge of Text Simplification in Education
MuTSE (Roscan et al., 2026) addresses a critical need in Intelligent Tutoring Systems (ITS): delivering content at the right reading level for each learner.
Why Text Simplification Matters for ITS
- Adaptive content: Match reading complexity to learner's current level
- Scaffolding: Progressive complexity increase (zone-of-proximal-development)
- Accessibility: Make domain content accessible to diverse learners
MuTSE: Multi-use Text Simplification Evaluator
Human-in-the-Loop Design
| Component | Function | Pedagogical Value |
|---|---|---|
| LLM generation | Multiple prompting strategies for simplification | Compare approaches for different learner needs |
| Human evaluation | Educator/expert quality ratings | Ensure pedagogical (not just linguistic) quality |
| Meta-evaluation | Framework for comparing simplification approaches | Systematic improvement of content adaptation |
Connection to LLMs in Education
As LLMs become prevalent in ITS (cf. ai-tutor-effectiveness-review), text simplification faces:
- Prompting strategy variability: Same LLM, different prompts → different simplifications
- Architecture differences: GPT vs. Claude vs. specialized models
- Evaluation challenge: Linguistic metrics (BLEU, SARI) don't capture pedagogical quality
MuTSE fills this gap: pedagogical evaluation of simplification, not just linguistic metrics.
Implications for Adaptive Learning
For ITS Design
- Content adaptation layer: Dynamic text simplification as part of adaptive-learning-systems
- Learner model integration: Simplify based on real-time reading level assessment
- Multi-modal extension: Could extend to diagram/math notation simplification
For Educator Workflows
- Human-in-the-loop: Teachers validate automated simplifications (cf. human-in-the-loop-ai)
- Quality assurance: Prevent oversimplification (losing key concepts) or undersimplification (frustrating learners)
Related Pages
- adaptive-learning-systems — Content adaptation as core ITS function
- human-in-the-loop-ai — Strategic interleaving of AI generation + human judgment
- ai-tutor-effectiveness-review — LLM integration challenges in ITS
- formative-assessment — Content must be assessable at simplified level
- ai-literacy — Simplified content for building AI literacy
Sources
- Roscan et al. (2026). MuTSE: A Human-in-the-Loop Multi-use Text Simplification Evaluator. arXiv:2604.08947. PDF