Heads We Win, Tails You Lose: AI Detectors in Education

Synthesis: Bassett et al. (2026) argue that generative AI detection should not be used in education, on three grounds: methodological imperfection (unverifiable probabilistic estimates), violation of procedural fairness, and unverifiable outputs. Unlike Plagiarism Detection, AI detection cannot be validated in real-world conditions where text origin is unknown; categorising text as human- or AI-generated imposes a false dichotomy that ignores work created with, not by, AI. They conclude that AI detection "does not safeguard academic integrity; it undermines it" — and call for a shift from detection and enforcement toward assessment design that recognises AI's role in learning.

Key Findings

1. AI detection relies on unverifiable probabilistic estimates. Detectors output a probability that text was AI-generated based on linguistic markers (perplexity, burstiness), but unlike spam filters or medical diagnostics, their results cannot be independently verified — real-world text origin is unknown, so validation relies on circular reasoning.
2. The false dichotomy. Categorising text as human- or AI-generated ignores the reality of contemporary writing, where student work is frequently created with, not by, AI — a hybrid process that makes the binary approach meaningless.
3. Detection scores fail the evidentiary standard. Academic integrity investigations require evidence meeting the balance-of-probabilities standard; AI detector scores, linguistic markers, style comparisons, and related indicators do not meet it.
4. AI detection undermines rather than safeguards integrity. Reliance on detectors and surveillance fosters a climate of suspicion, eroding student Trust and the integrity of assessment itself.
5. Assessment boundaries are undefined. Policies restricting AI use "in assessment" fail to specify when an assessment begins, creating ambiguity that forces inconsistent enforcement and student self-regulation.

Unverifiable probabilistic estimates

Generative AI detectors analyse a text's statistical and linguistic features and output a probability-based estimate of whether it was AI-generated. Unlike other probabilistic detection methods (spam filters, medical diagnostics) that achieve practical reliability, AI detector results cannot be independently verified: in real-world conditions, no external evidence can conclusively confirm whether a flagged text was AI-generated. Without known ground truth, validation relies on subjective interpretation or circular reasoning. Signal-detection metrics (FPR, FNR, TPR, TNR) only apply under controlled testing; real-world applications lack ground truth. Furthermore, detectors are trained and tested on pre-generative-AI human writing (e.g., Turnitin tested on 700,000 pre-2019 papers), assuming such text reflects contemporary student writing influenced by AI — an unverified assumption, especially given performance varies with underlying models, prompts, and platforms.

The false dichotomy and the boundaries of assessment

The paper argues that the binary human-or-AI classification is conceptually flawed: students' work is frequently created with, not by, AI, via a hybrid process in which AI assistance is incorporated in various ways and at various stages. It also examines the undefined boundaries of assessment — policies using phrases like "in assessment" fail to specify when an assessment begins, so AI-assisted research, planning, or editing may or may not be a violation depending on interpretation. AI use exists along a continuum (citing Molenaar's hybrid human–AI intelligence model), making enforcement dependent on subjective judgement rather than principled criteria.

Procedural fairness and security

AI detection raises security concerns around data storage and retention (including overseas servers with varying Privacy standards), data breaches, and potential commercial exploitation of student work. It also violates procedural fairness: academic integrity investigations require evidence meeting the balance-of-probabilities standard, which AI detector scores — alone or in combination with linguistic markers, style comparisons, LLM claims, or student silence — do not satisfy. Students under investigation must be afforded the right to silence; a refusal to respond does not tip the scales against them, and only requesting an oral response to verify learning outcomes is a legitimate (grading) question.

Implications for AI in education

This paper is a strong argument in the wiki's Plagiarism Detection and Academic Integrity thread for retiring AI-detection tools, positioning them as methodologically and procedurally unsound. It connects to beyond-detection work on authentic assessment and to assessment validity — if AI detectors cannot be validated, their use undermines rather than protects Assessment. It also speaks to policy and Governance in higher education, and to Writing Education by recognising AI-assisted writing as a legitimate, hybrid practice. Its emphasis on moving from surveillance toward assessment design that recognises AI's role aligns with AI Literacy and human-centred GenAI integration.

Connected Concepts

• Plagiarism Detection
• Academic Integrity
• Generative AI
• Higher Ed
• Assessment
• Assessment Validity
• Authentic Assessment
• Trust
• Privacy
• Writing Education
• Student Experience
• AI Education
• Educational Policy AI
• Governance

Connected Articles

• Beyond Detection Authentic Assessment AI 2025 — Beyond detection: authentic assessment in the age of AI
• Detecting LLM Generated Text Latent Prompt — Detecting LLM-generated text via latent prompts
• LLM Detecting LLM Generated Content Education — LLMs detecting LLM-generated content in education
• AI Assessment Scale Reform — The AI Assessment Scale and the work of assessment reform

Citation

Bassett, M. A., Bradshaw, W., Bornsztejn, H., Hogg, A., Murdoch, K., Pearce, B., & Webber, C. (2026). Heads we win, tails you lose: AI detectors in education. Journal of Higher Education Policy and Management.