🏷️ automated-assessment
11 pages tagged with automated-assessment(10 articles, 1 concepts)
📄 Knowledge, Skills, Attitudes, Production: Competency-Based Education After Generative AI
> **Synthesis:** This conceptual paper proposes adding *production* — the capability to deliver professional-standard work by directing tools and other people — as a fourth attribute of competency-bas…
📄 Multimodal Item Parameter Estimation using Simulated Response Probabilities
> **Synthesis:** This paper fine-tunes a multimodal large language model (Qwen3.5-based) to reconstruct multiple-choice model (MCM) and three-parameter logistic (3PL) item characteristic curves. By le…
📄 From Evaluated Models to Evaluation Aids: A Multi-Evidence Study of LLM-Based Difficulty Calibration for Programming Examinations
> **Synthesis:** Yan, Xiong, Li & Chen (2026) reposition LLMs from benchmark targets to auxiliary evidence sources for interpreting programming-exam difficulty, showing that AI difficulty estimates co…
🏷️ Automated Essay Scoring
> **Automated Essay Scoring (AES)** — the use of AI to evaluate and score written essays, spanning traditional statistical approaches, fine-tuned language models, and increasingly accessible LLM-based…
📄 CODE-GEN: A Human-in-the-Loop RAG-Based Agentic AI System for Multiple-Choice Question Generation
> **A dual-agent RAG-based system for generating and validating coding comprehension MCQs**, evaluated by 6 SMEs across 7 pedagogical dimensions (N=288 questions, 2,016 rating pairs). AI excels at cri…
📄 The Theoretical Foundation of Socratic Tests: Dynamic, Multimodal, Conversational Examinations
> **Ilya Mikhelson** — Submitted to Computers and Education: Artificial Intelligence (2026).…
📄 Comparing human and LLM ordered coding of qualitative data: How coding differences cascade through temporal analysis
> **Authors:** Kamila Misiejuk, Sonsoles López-Pernas, Eduardo Araujo Oliveira, Brendan Eagan, Mohammed Saqr **Source:** Computers and Education: AI, Vol 11 — Open Access (CC BY 4.0)…
📄 AI-based scoring systematically underestimates conceptual understanding of linguistically weak students' explanations in physics
> **Authors:** Markus S. Feser, Paul L. Tschisgale (Leibniz Institute for Science and Mathematics Education, Kiel, Germany)…
📄 AiAWE: An Open-Source LLM Automated Writing Evaluation System Using LoRA-Adapted Instruction-Tuned Models
Gayed presents **AiAWE**, an open-source [[automated-grading|automated writing evaluation]] (AWE) system that scores argumentative essays using a LoRA-adapted instruction-tuned [[llm|large language mo…
📄 Generate-Then-Validate: Question Generation for Education
> **Synthesis:** A novel generate-then-validate pipeline for educational question generation that reduces LLM hallucination by 62% compared to direct generation, validated on STEM datasets with 89% ac…
📄 Automatic Short Answer Grading with LLMs
> Automatic Short Answer Grading (ASAG) is never perfect. Upper bounds on accuracy arise from: > Zero-shot LLMs perform strongly on ASAG without task-specific fine-tuning, but **model-based confidence…