🏷️ evaluation
9 pages tagged with evaluation(8 articles, 1 concepts)
🏷️ Research Methods in AIED
> **Research methods in AIED** — the set of empirical designs, data-collection strategies, and analytic techniques researchers use to study AI in education: whether and how AI tools support (or harm) …
📄 Towards Valid Student Simulation with Large Language Models
> Yuan et al. (2026) present a conceptual and methodological framework for valid LLM-based [[simulating-students|student simulation]]. They identify the **competence paradox** — broadly capable LLMs a…
📄 From Evaluated Models to Evaluation Aids: A Multi-Evidence Study of LLM-Based Difficulty Calibration for Programming Examinations
> **Synthesis:** Yan, Xiong, Li & Chen (2026) reposition LLMs from benchmark targets to auxiliary evidence sources for interpreting programming-exam difficulty, showing that AI difficulty estimates co…
2026-08-11 · computing-education, programming-education, assessment, automated-assessment, llm-evaluation
📄 A framework for characterising and capturing the quality of digital interactions and experiences in early childhood education
> **Synthesis:** This study introduces a Digital Interactions Quality (DigIQ) framework and scale as a protocol to observe and index the quality of interactions and experiences involving digital techn…
📄 Beyond MOOCs: How technical and structural factors shape learner engagement, retention and inclusivity across online learning platforms
> **Synthesis:** This study examines the critical influence of technical and structural factors on learner Engagement, Retention and Inclusivity (ERI) in MOOCs and other large-scale online learning pl…
📄 From emotion regulation to academic success: A self-determination theory-based emotional agent-mediated approach
> **Synthesis:** Emotion regulation has been recognized as a key factor affecting students' academic success. This study proposed a self-determination theory (SDT)-based emotional agent framework, imp…
2026-08-10 · affective-computing, ai-education, ai-tutoring, educational-technology, edtech-platform
📄 The synergy of pedagogical agents and metaphorical design: Reducing psychological distance to enhance video learning
> **Synthesis:** This study examined the effects of pedagogical agents (real vs. virtual) and metaphorical design on learners' performance, attention, comprehension, and psychological distance in a 2x…
📄 Adversarial Stress Testing of Role-Playing Language Agents using Multi-Agent Evaluation
> **Synthesis:** This paper presents a modular multi-agent platform for adversarially stress-testing [[agentic-ai|role-playing language agents]] through structured multi-turn dialogue. With three coor…
📄 Once a Response, Always a Response: Detecting LLM-generated Text via Latent Prompt Restoration
> **Synthesis:** EchoPrompt introduces a training-free zero-shot detector for [[plagiarism-detection|LLM-generated text]] that exploits the latent prompt dependency inherent in machine-generated conte…