AIEd Knowledge BaseAIEd KB
On this page

Concept

Self-Assessment

created 2026-09-21 · updated 2026-09-21

Self-assessment — judging your own work, competence, or progress against criteria, and the practices and instruments built on that act. The term carries two faces that are easy to collapse into one. As an instructional technique it is self-grading, rubric-based self-review, self-checking, and guided reflection: activities meant to develop the monitoring and judgment that Self-Regulated Learning runs on. As an educational measure it is a self-report instrument, in which a learner's estimate of their own skill, confidence, or learning stands in for an observation nobody made. It sits beside Peer Assessment as the other half of students-as-assessors, and inherits the same dependence on Scaffolding and explicit criteria. Both faces turn on the same faculty and both fail in the same direction: the estimate is systematically generous, and the more a learner's submitted work can be produced by a generative AI tool, the less that work says about whether the faculty is there at all.

Questions to Consider

  • When you finish a piece of your own work, what tells you whether it is good: the criteria you were handed, the criteria you have internalized, or how it feels? Could you tell which one you actually used?
  • In a study of 288 K-12 teachers, a self-reported measure of AI literacy correlated with an objective measure of the same skill at only r = 0.07 to r = 0.24. Where in your own practice would a self-estimate most likely diverge from a test of the same skill, and why there rather than somewhere else?
  • Self-grading can save instructor time and build judgment, and it can also hand out a mark the student has not earned. What would have to be true about the task, the rubric, and the training for a self-grade to carry credit?
  • If a tool can produce the essay, what is left for a student to assess about their own learning? What would you ask them to estimate instead?
  • Students who assess a peer's work and students who assess their own are doing different things. Which one transfers better to the next task, and what evidence would settle it?

Introduction

Self-assessment is one of the older ideas in education and one of the more confused ones in practice, because two distinct things travel under the name. The first is a technique: students reviewing their own work against criteria, grading it, checking it, reflecting on it. The second is a measurement: the learner's own rating of their skill, confidence, or learning, used as data. The technique is judged by what it develops in the learner; the measurement is judged by whether the number can be trusted.

Both matter in an AI-era assessment design, and they matter for different reasons. The technique is where evaluative judgment is trained, and evaluative judgment is exactly the capability that becomes scarce when a language model can produce competent-looking work on demand. The measurement is where the field routinely overstates what it knows, because a self-report cannot measure learning: it can only record what someone says about it.

Self-assessment as an instructional technique

The practices that fall under this heading are familiar: self-grading against a rubric, self-review of a draft before submission, self-checking of problem solutions, reflective prompts asking what a learner would do differently, and prediction tasks where a student estimates their performance and then compares. Their purpose is developmental. A student who reviews their own draft against criteria is rehearsing the appraisal that peer review and instructor feedback also train, and is building the internal standard they will use when nobody is watching.

Evidence that the technique works, and about which version works, comes mainly from writing and from self-regulated learning research. In a comparative study of feedback literacy, first-year undergraduates (N = 118 in China, 56 in a GenAI group and 62 in a peer group) worked through three self-assessment cycles across one semester. The GenAI group's advantage over the peer group was small, only 0.17 scale points (partial eta squared = 0.03), and the study's practical conclusion is the one that recurs: self-assessment needs scaffolding. Pre-trained rubrics, prompt guidelines, and worksheets are what separate a self-assessment cycle that builds Feedback Literacy from one that produces offloading.

Self-assessment is also where the cycle of Self-Regulated Learning becomes visible as a skill rather than a disposition. In an undergraduate statistics study, students who received explicit training in reasoning-focused scaffolding (stepwise hints and verification prompts) performed better on a later task attempted with no model assistance and showed better self-assessment calibration than students who leaned on the model uncritically. The interesting part is the second measure: the trained group's estimates of their own understanding aligned better with what they could actually do. A technique aimed at reflection changed a measurement property of the learner.

Calibration training

The most direct technique is calibration training, where a student predicts their score or confidence before seeing a result and then compares the prediction with the outcome. In an AI-assisted writing study, a feedback literacy script improved writing quality, feedback uptake, and deep revision, while an Assessment-Performance Calibration Activity primarily improved the accuracy of students' self-assessment and reduced overconfidence. Combining the two produced the largest writing gains and the strongest retention after AI support was withdrawn, though the calibration activity alone remained the better route to accurate self-estimates. That division of labor is the practical point: feedback literacy improves what a student does with comments, calibration improves how well they know their own standing, and they are not the same intervention.

An essay-level paper on ethical AI use at one Australian university treated guided self-assessment as the vehicle rather than the subject: across commencing nursing, health sciences, engineering, and science students from 2021 to 2025, pre- and post-semester self-assessments combined Likert confidence items with an open reflection prompt, and the authors argued that ethical practice is a developmental capability to be built through reflection rather than a compliance rule to be enforced.

What AI adds to the technique

AI changes three things about the technique. It can generate the items and rubrics, which makes repeated self-assessment cycles cheap. It can be the thing assessed, which is how evaluative judgment gets trained: a student judging an AI draft is practicing appraisal with an unlimited supply of material. And it can make the learner's judgment visible as process evidence. In interactive learning dashboards, a conventional analytics dashboard was extended with a Judgment of Learning self-assessment feature and a conversational agent, on the argument that eliciting a learner's own judgment does more for engagement than telling them what the data shows. Institutional frameworks have started to treat the same process traces, including structured self-assessments and metacognitive prompts, as evidence of adaptive capabilities that a transcript cannot show.

Self-assessment as a measure

Used as a measure, self-assessment usually arrives dressed as something else: a confidence rating on a Likert scale, a predicted score, a Judgment of Learning item, or a taxonomy-based inventory of perceived skill. It is one family within the wider set of Self-Report Measures, and it inherits that family's categorical limit. A self-report cannot measure learning or behavior; it can measure only what a person is willing to say about their learning or behavior, and those two things come apart often enough in this research base to be a finding in its own right.

How accurate the estimates are

Accuracy is the headline problem, and the direction is consistent. The cleanest evidence comes from a study that built parallel self-report and objective measures of teacher AI literacy inside a single framework. Across 288 K-12 teachers, correlations between the objective and self-reported factors ranged from r = 0.07 to r = 0.24, and latent profile analysis found six profiles: 43 teachers rated themselves consistently high while scoring lower on the objective measure, 59 showed the reverse pattern, and the remaining profiles clustered near the mean or split by prior AI literacy experience. Two measures of one skill, built by the same team on the same construct, share almost nothing.

The field-level picture matches that single study. Zainal, Mohd Matore and Maat's 2026 review of teacher AI literacy measurement tools appraised 33 instruments published between 2019 and 2025 and found that 31 (93.9%) were self-report scales of perceived confidence, only two (6.1%) tested knowledge objectively, and none used performance-based tasks. The authors' reading is the one this page's measurement face turns on: a self-report score records reported confidence rather than capability, so it cannot stand in for competence, and they argue for performance tasks and item-response-theory analysis alongside self-assessment to separate validated capability from reported confidence.

Accuracy also depends on what is being estimated. A psychometric analysis of a taxonomy-based GenAI literacy self-assessment with 158 university staff and students found an inverted profile, with respondents claiming mastery of creation before the conceptual foundations underneath it, and only a weak correlation (r = 0.188) between student and academic profiles. A survey of teacher-education students found the same shape from the other side: nearly all (97.8%) rated critical media analysis important while only 13.8% said their coursework addressed it, and fewer than half (44.9%) believed they had the skills to analyze media information critically. Self-assessed media competence lagged self-assessed importance.

Two mechanisms explain the generosity. The first is motivational and well documented outside this literature: people rate themselves generously, and the least competent overestimate most. The second is specific to AI-native cohorts. A 2026 theoretical paper on the absent cognitive baseline argues that sustained substitutive AI use during the formative secondary and high-school years reduces the independent cognitive encounters that any academic self-assessment depends on. The claim is structural rather than individual: self-assessment works by comparing a current performance with a record of previous ones, and where the record was never built, the estimate has nothing to be calibrated against. That is presented as distinct from offloading and surrender, which describe processes during AI use, because the gap persists when the tool is absent.

Developmental stage sets one boundary on accuracy, and the youngest learners are where a validated self-assessment instrument is scarcest. Thianwan and Srikoon's 2025 validation study of an AI literacy self-assessment questionnaire for upper primary students built a 15-item measure for Grades 4 to 6 across Learning About AI, Learning About How AI Works, and Learning for Life with AI, confirming a three-factor structure in samples of 335 and 579 students with an overall Cronbach's alpha of .934. The authors are explicit about the genre's limit: self-assessment accuracy depends on metacognitive ability that is still maturing in children, so scores index perceived understanding rather than demonstrated competence, and the instrument is intended for formative diagnosis.

Self-assessment as an outcome variable

The measurement face also shows up in evaluation design, where self-assessment instruments are used as outcome measures. One study of AI-assisted assessment of complex reports in higher education explicitly evaluates learning with validated feedback literacy and self-assessment instruments alongside subsequent performance and comparison with a control group. That is defensible when the instrument measures a belief the study is actually about, such as Self-Efficacy or perceived competence, and misleading when it is treated as a stand-in for achievement. The recurring critique of AI intervention studies applies with full force here.

What generative AI changes

The two faces converge under generative AI, because the tool attacks the link both of them rely on: that a learner's submitted work is evidence about the learner.

Where the work can be produced on demand, a sound essay no longer demonstrates the judgment behind it, and asking a student to assess a draft they did not write is a different task from assessing one they did. This is why assessment validity arguments have moved from detection toward redesign, and why self-assessment moves from a study aid to a component of the assessment design itself: the judgment a student makes about a piece of AI output, on the record and with reasons, is evidence in a way that the output is not.

It also introduces a naming hazard worth stating plainly. AI self-evaluation is not this concept. When a paper reports that a model assesses its own reasoning or grades its own output, that is model evaluation and belongs with Automated Assessment and the study of model training and simulated learners; one tutoring study makes the practical version of the point, arguing that feedback should be conditioned on a separate diagnostic classifier rather than on the model's self-assessed reasoning validity. Learner self-assessment and model self-assessment share a vocabulary and nothing else.

Implications for practice

  • Scaffold the technique. Rubrics, prompt guidelines, and worksheets are what make a self-assessment cycle developmental. Bare self-assessment, like bare AI feedback, tends to produce reassurance rather than judgment.
  • Train calibration separately from feedback use. Prediction-and-compare activities change the accuracy of self-estimates; feedback-literacy work changes what students do with comments. If accuracy is the goal, run the calibration activity.
  • Keep self-grades low-stakes unless the training is real. A self-grade is a claim about learning made by the person it benefits, and the overestimation profiles in the AI-literacy study are not a small bias to absorb in a summative mark.
  • Use self-report where it is honest. Confidence, perceived competence, and willingness to disclose AI use are legitimate things to measure by asking. Achievement is not.
  • Ask for judgment, not opinion. The most defensible AI-era self-assessment asks a student to appraise a specific piece of work against criteria and justify the call, which is trainable, inspectable, and connected to Evaluative Judgment.
  • Watch the cohort effect. For students whose formative years included substitutive AI use, an accurate self-estimate may be unavailable rather than merely optimistic, which shifts the instructional task from correcting overconfidence to rebuilding the experiential record it needs.

Connected Concepts

Connected Articles

Connected FAQs

Metadata

LevelHigher Ed
Intended audienceLearners, Instructors
Learning and instructionMetacognition, Self-Regulated Learning, Scaffolding
Assessment and measurementAssessment Validity, Evaluative Judgment, Feedback Literacy, Formative Assessment, Peer Assessment, Self-Report Measures
Equity, ethics, and responsible useTrust Calibration
Foundations of AI in educationAI Literacy
SourceHistoryEditChat

Embed this page

Copy the code below to embed a chromeless version of this page in a learning management system or other website. The embedded view hides the site header, navigation, and footer.