The End of Assessment? Disruption and Transformation in the Age of AI

Core Finding

Generative AI is collapsing the long-standing boundaries between learner, test, and assessor — an epistemic disruption in what counts as evidence of learning. These systems can be test-takers, test-makers, test-raters, and analysts/reporters simultaneously. Rather than merely adding a tool, AI dissolves the field's traditional representational-measurement paradigm. The authors argue assessment must transform from static measurement into an evidence ecosystem centered on meaning-making, justice, and AI literacy, led by a "cyborg" assessment professional fluent in both disciplinary assessment expertise and AI.

Key Findings

AI as test-taker, test-maker, test-rater, and analyst. LLMs (ChatGPT, Claude, Gemini) can complete the same tasks used to evaluate students (essays, quantitative problems, code, data analysis) and have excelled on the bar, medical licensing, and SAT. They can also generate items, rubrics, and validity documentation in seconds; score written work with speed and consistency; and synthesize institutional findings for accreditation — redistributing the interpretive authority once reserved for assessment professionals.
Validity is thrown into question. The authors anchor on Messick's (1989) integrative-judgment definition of validity. When AI designs the very measures from which evidence is derived, the interpretive chain becomes opaque: are we assessing a construct grounded in human theory, or one generated from statistical patterns in training data?
Justice is a validity question. Validity is inseparable from value implications. AI can encode dominant linguistic patterns and rhetorical styles as quality markers — e.g., privileging standardized academic English and misclassifying equally sophisticated reasoning from multilingual or culturally marginalized learners — and AI image generators represent White individuals more accurately than people of color (Yang, 2025). These biases are not just ethical concerns but direct threats to validity, connecting to Bias Mitigation and Equity In AI Education.
AI literacy becomes assessment literacy. Where traditional assessment literacy involved rubrics, reliability, and validity, AI literacy extends this to prompting, data interpretation, and understanding how generative systems produce evidence. Without it, practitioners, faculty, and students risk becoming passive consumers of algorithmic judgments (AI Literacy).

The "cyborg" assessment professional. The field's future is a hybrid worker who combines high AI literacy with high disciplinary/assessment expertise — designing prompts with intention, creating human-machine partnerships, auditing outputs for bias, shaping data pipelines, and stewarding institutional meaning-making. A two-axis framework (AI literacy × disciplinary/content expertise) yields four quadrants, and the authors outline a pathway from traditional assessment specialist (low AI literacy) through "AI Explorer" to the cyborg/Futurist Assessment Professional.
A national Community of Practice as a case in transition. The Generative AI in Assessment CoP, launched by the Assessment Institute in 2025 with ~80 members (plus ~130 affiliates), reflects themes of urgency, desire, variation, constraint, and community — evidence that the field is actively negotiating new professional identities around AI-mediated evidence.

Assessment as meaning-making rather than measurement

A central transformation claim is that assessment shifts from extracting scores to constructing meaning from complex, hybridized systems. AI can surface relationships too complex for humans to detect alone, but it cannot generate the "why" — the moral and contextual lens through which meaning is co-constructed. The assessment professional becomes "sensemaker-in-chief," a translator between algorithmic data and human understanding, and dashboards become evolving evidence narratives rather than snapshots.

Practical Implications

Redesign what is assessed, not just how. If AI participation in assessment is inevitable, the object of measurement must evolve from testing isolated knowledge to assessing how effectively students work with AI to interpret, apply, and evaluate knowledge. AI literacy becomes a foundational learning outcome for students and faculty.
Treat AI equity audits as validity work. As psychometrically aware AI is adopted, the field should audit training data, prompts, and results for representational bias — and resist treating dominant norms (e.g., standardized academic English) as neutral quality standards.
Reconceive the assessor's role as auditor/translator. Rather than guarding the purity of measurement, assessment professionals should position themselves as curators and stewards of algorithmic evidence — verifying, interpreting, and explaining AI-augmented results, and teaching others to question model reasoning.
Pair AI scoring with human judgment. While automated scoring offers speed and consistency, the authors emphasize unresolved questions of bias, fairness, and transparency — pointing to hybrid human-plus-AI scoring that keeps humans in the interpretive loop.
Build the "cyborg" pathway deliberately. Institutions should offer structured professional development (prompting, algorithmic auditing, data stewardship) to move the workforce from low-AI-literacy quadrants toward fluent, justice-oriented assessment practice, in line with the CoP model.

Connected Concepts

Connected Articles

Beyond Detection Authentic Assessment AI 2025 — Beyond detection: redesigning authentic assessment in an AI-mediated world
AI Assessment Scale Reform — AI Assessment Scale and reform
Coauthorship Integrity Reconceptualising Assessment Validity For The Age Of Gene — Reconceptualising assessment validity for the age of generative AI

Citation

Hathcoat, J. D., Slotnick, R., & Miller, W. (2026). The End of Assessment? Disruption and Transformation in the Age of AI. Research & Practice in Assessment, 21(3).

View Source View Changes Edit