๐Ÿง  AI Ed Wiki

Generative AI has not created the need for authentic assessment โ€” it has made weaknesses in assessment design harder to ignore. Polished products can now be generated or substantially mediated by tools, so product resemblance is an increasingly unreliable signal of capability. Tsiligkiris calls this risk construct substitution: an AI-generated or AI-mediated product is attributed to the st

Tsiligkiris (2026) reframes authentic assessment as an evidential and validity-oriented design problem in AI-rich higher education. His central distinction โ€” authentic products vs. authenticated processes โ€” argues that assessment validity under generative AI depends not on realistic outputs alone but on architectures that make human judgement, verification, and responsibility visible. A systematic conceptual review of 37 sources yields a six-dimension framework for redesigning assessment briefs at module and programme level.

The core argument

Generative AI has not created the need for authentic assessment โ€” it has made weaknesses in assessment design harder to ignore. Polished products can now be generated or substantially mediated by tools, so product resemblance is an increasingly unreliable signal of capability. Tsiligkiris calls this risk construct substitution: an AI-generated or AI-mediated product is attributed to the student, producing an inference about capability that reflects the tool's performance rather than the student's learning. The evidence is concrete: fully AI-generated submissions passed through a live university examination system largely undetected (Scarfe et al., 2024), and experienced markers do not reliably detect GenAI-authored work (Kofinas, Tsay & Pike, 2025).

Crucially, the evidential question survives any AI policy: whether AI use is prohibited, permitted, or required, the assessment must still generate evidence that warrants the inference being drawn โ€” either about unaided capability, or about the capacity to direct, critique, and take responsibility for AI-supported work.

Six-dimension framework

1. Contextual fidelity and consequential relevance โ€” realistic problems, roles, constraints, audiences, artefacts; credibility to disciplinary or civic practice plus an intelligible reason to care (stakeholder, public output, policy brief), not surface imitation.

2. Cognitive demand and evaluative judgement โ€” analyse, evaluate, synthesise, interpret ambiguity, make defensible trade-offs. Evaluative judgement (Sadler 1989; Tai et al. 2018) matters more when machines can generate plausible first drafts.

3. Process transparency and assessment integrity โ€” reasoning, iteration, feedback use, and verification visible enough to support warranted inference (Boud 2000; Kane 2013). Architectures: staged submissions, annotated decision rationales, oral defence, feedback-use statements, process records.

4. Student agency and bounded choice โ€” topic/modality/case/medium choice within a common architecture, bounded by clear standards to preserve comparability and fairness.

5. Inclusivity and representational fairness โ€” realism can privilege particular communication styles, professional norms, and cultural capital; needs transparent criteria, scaffolding, equivalent routes to demonstrate achievement, and attention to whose realities are represented.

6. AI-aware validity and ethical practice โ€” specify how AI relates to intended outcomes, permitted uses, and the evidence supporting defensible attribution of capability; evidential requirement (does the task still capture the construct?) plus ethical requirement (disclose, critique, verify, take responsibility).

Operational tool

The framework becomes a review instrument for assessment briefs: teams examine each dimension for evidence generated, validity risks, and redesign priorities โ€” using a 4-point indicative alignment scale (weak โ†’ partial โ†’ substantial โ†’ strong). Not every assessment must maximise all six dimensions; across a programme, tasks may emphasise different ones. It complements (rather than replaces) the AI Assessment Scale by treating AI permissions as part of a defensible assessment argument, alongside fairness, agency, cognitive demand, and process evidence.

Connected Concepts

  • AI Ed Evaluation
  • AI Literacy
  • Assessment Validity
  • Formative Assessment
  • Generative AI
  • Higher Ed
  • LLM
  • Connected Articles

  • Authentic Assessment โ€” Authentic Assessment
  • Beyond Detection Authentic Assessment AI 2025 โ€” Beyond Detection: redesigning authentic assessment in an AI-mediated world
  • Care Full Feedback GenAI โ€” The care-full craft of feedback in an age of generative AI
  • LLM Fallacy Misattribution โ€” The LLM Fallacy and Misattribution of Competence
  • Tool Invariant Framework Agentic AI โ€” A Tool-Invariant Framework for Teaching and Assessing Computational Methods in the Age of Agentic AI
  • A4l Analytics Pipeline โ€” Generalizing a Highly Configurable Analytics Pipeline to Replicate and Support Educational Research Across Multiple D...
  • Aaai2026 Prompting Literacy K12 โ€” Learning to Use AI for Learning: Teaching Responsible Use of AI Chatbot to K-12 Students Through an AI Literacy Module
  • Academiclaw Student Agent Benchmark โ€” AcademiClaw: When Students Set Challenges for AI Agents
  • Access Not Enough AI Tutoring 2026 โ€” Access is Not Enough: Human Support Improves Engagement with AI Tutoring
  • Adapt Adaptive Lesson Plan Transformer โ€” AdaPT: Adaptive Lesson Plan Transformer for Cross-Regional and Differentiated Instruction
  • Adaptive Pretesting Retention โ€” Do Gains from Generative AI-Enabled Adaptive Pretesting Persist? Evidence from a Retention Study
  • Affective Text Wearable Student Health โ€” A Formative Study of Brief Affective Text as a Complement to Wearable Sensing for Longitudinal Student Health Monitoring
  • Agency Gap AI Writing โ€” The agency gap in AI-supported writing: how reactive and proactive agent designs shape multimodal reasoning
  • Agent Voice Accents K12 Group Learning โ€” Exploring How Agent Voice Accents Shape Human-AI Collaboration in K-12 Group Learning
  • Agentic AI Education Scoping Review โ€” Agentic AI in Education: A Scoping Review of Research Landscape, Capabilities, and the Frontier Agent Paradigm
  • Agentic AI Pedagogical Best Practice 2026 โ€” Agentic AI and Pedagogical Best Practice: The Tension Between Automation and Learning
  • Agentic Education Coding โ€” Agentic Education with AI Coding Assistants
  • Agentic Literacy Debt โ€” Agentic Literacy Debt: A Structural Problem the AI Literacy Field Has Not Yet Named
  • Agents That Teach Incidental Learning โ€” Agents That Teach: Designing Incidental Learning Back into AI-Assisted Software Development
  • Agreement Not Quality LLM Coding Verification โ€” Agreement Is Not Quality: Blind Expert Verification of Human and LLM Qualitative Coding When Human Consensus Is Not G...
  • AI Adoption Training Public Sector โ€” The Main Barrier to AI Adoption in the Public Sector is Lack of Training
  • AI Adult Learning Guidelines Dis2026 โ€” Guidelines for Designing AI Technologies to Support Adult Learning
  • AI Agents Constructive Conflict Design Education 2026 โ€” Enacting Constructive Conflicts with AI Agents to Enhance Reconsideration among Novice Interaction Designers
  • AI Agents Peer Learning Discourse โ€” When AI Agents Teach Each Other: Discourse Patterns Resembling Peer Learning in the Moltbook Community
  • AI Assessment Scale Reform โ€” A bit of chaos and madness": The AI Assessment Scale and the work of assessment reform
  • Citation

    Tsiligkiris, V. (2026). From authentic products to authenticated processes: a systematic conceptual review of authentic assessment in AI-rich higher education. Assessment & Evaluation in Higher Education.