Knowledge Tracing

Knowledge tracing — modeling what learners know over time by tracking their performance on exercises and predicting future mastery. It is the knowledge base's richest modeling thread, spanning Bayesian, deep learning, and LLM-enhanced approaches to tracking student knowledge as it evolves.

Questions to Consider

• Knowledge tracing models what you know over time from your performance on exercises, tracking when knowledge is gained and when it decays. What can your answers reveal about whether you truly 'know' something versus just got it right this time?
• The page warns that 'mastery is not correctness' — a learner can appear mastered yet systematically misapply a skill when a hidden condition is violated. When have you seen someone (or yourself) look like they understood something but actually hadn't?
• If knowledge tracing feeds adaptive systems that decide what to teach next, what goes wrong when the model mistakes correct answers for true mastery and moves a student on too early?
• Knowledge tracing comes in many forms — Bayesian, neural, hypergraph, dialogue-based, LLM-enhanced. What trade-offs would you expect between a transparent model you can explain and a powerful but opaque one?
• The page connects knowledge tracing to simulated students — generating the knowledge states tracing normally infers from real data. How might simulating learners help test a tutor before it meets real students?
• Since knowledge decays over time, what should an adaptive system do with a student's past 'mastery' once they've forgotten? How would you design for forgetting rather than assuming knowledge persists?

Introduction

Knowledge tracing transforms raw exercise responses into estimates of what a student has mastered and what they still need to learn. Unlike simple correctness tracking, knowledge tracing models the temporal dynamics of learning — when knowledge is gained, when it decays, and how concepts relate to each other.

Approaches represented in the knowledge base

• Bayesian approaches: StanBKT: Rethinking Parameter Estimation in Bayesian Knowledge Tracing standardizes BKT implementations, while MBP-KT: Learning Global Collaborative Information from Meta-Behavioral Pattern for Enhanced Knowledge Tracing incorporates meta-behavioral signals
• Soft-evidence BKT with an LLM observation function: CoLearn (He et al., 2026) keeps the BKT structure but replaces the binary correct/incorrect observation — standard BKT's input — with a continuous one: an Large Language Models (LLMs) grader emits graded mastery evidence plus a confidence weight, blended into a confidence-shrunk posterior and gated so that a clearly wrong answer cannot raise the estimate, which makes the update a variant that generalizes standard BKT rather than a strict reduction of it. Whether that observation function is trustworthy depends on the learner: mean evidence separated ability tiers cleanly (0.25 weak / 0.67 mixed / 0.77 strong) while within-tier correlation with true mastery was only r ≈ 0.15 / 0.48 / 0.41, leaving the traced state an agent's belief about the learner rather than a calibrated measurement.
• Neural and hybrid models: Neural-Symbolic Knowledge Tracing: Injecting Educational Knowledge into Deep Learning for Responsible Learner Modelling combines symbolic reasoning with neural networks; Explainable Knowledge Tracing via Probabilistic Embeddings and Pattern-based Reasoning advances interpretable probabilistic models
• Hypergraph memory networks: THyMeN augments memory-based tracing (DKVMN) with temporal hypergraph reasoning, modeling dynamic higher-order interactions among concepts that co-occur within multi-skill questions
• Dialogue-based KT: Interpretable Knowledge Tracing adapts knowledge tracing for conversational tutoring
• LLM-enhanced: HiLLM-CD uses LLMs for automated concept tree construction and hierarchical proficiency inference
• Semantic, recommendation-oriented KT: ExRec (Ozyurt, Almaci, Feuerriegel and Sachan, 2025) grounds the input rather than the architecture: an LLM annotates each question with solution steps and knowledge concepts aligned to the Common Core State Standards for Mathematics, contrastive learning aligns question, solution-step and concept embeddings (with false negatives removed by pre-clustering concept variants such as "interpreting a bar chart" and "reading information from a bar graph"), and a KC-calibration loss lets the tracer predict a concept-level knowledge state directly instead of inferring one by running the model over every question in that concept. The calibrated tracer then serves as the reinforcement-learning environment for exercise recommendation, where a model-based value estimation initialises the critic from the tracer itself. Across four tasks on XES3G5M averaged over 2,048 test students, non-RL baselines gave marginal or negative knowledge gains, value-based continuous methods beat policy-based ones, and the model-based value estimate improved them consistently — most sharply on the weakest-concept task, where the target changes at every step. Reported gains are percentage-of-maximum knowledge improvement, not learning outcomes, and the pipeline depends on generated solution steps whose quality the tracer inherits.
• Outcome-based knowledge tracing (OKT): Pradeesh et al. (2026) trace student knowledge within Outcome-Based Education systems by treating course outcomes as the knowledge concepts themselves, and substitute expert-validated OBE "affinity mappings" between course and program outcomes for attention- or graph-derived concept relations. A Memory Augmented Neural Network (MANN) models how each outcome's attainment impacts others, and domain-adaptive BERT fine-tuning enriches the outcome embeddings (with a GRU backbone beating LSTM). On live engineering-program LMS data (2,416 students, 966 outcomes) OKT reached 89.81% AUC — outperforming DKT, DKVMN, EKT, and SimpleKT — while giving only competitive results on ASSISTments, confirming the advantage is tied to OBE-specific curriculum structure.

Relationship to other concepts

Knowledge tracing is closely related to Learner Modeling and Adaptive Instruction — while knowledge tracing specifically models cognitive knowledge over time, student modeling is the broader practice of representing all aspects of a learner (affective state, engagement, preferences). Knowledge tracing feeds into Adaptive Learning and Personalized Learning systems that need to know what to teach next, and into Intelligent Tutoring platforms that use mastery estimates to select appropriate problems. It connects to Learning Analytics for dashboard and intervention design, and to Cognitive Diagnosis for fine-grained skill Assessment. Knowledge-tracing constructs also inform simulated students — a simulated learner's cognitive state is often formalized with the same mastery/decay dynamics that knowledge tracing models, so Simulation is a way to generate the knowledge states that tracing methods normally infer from real response data.

A caveat: mastery is not correctness. An, McLaren, and Stamper (2026) show that BKT's two-state (learned/unlearned) assumption can be violated by deceptive overgeneralization — learners can appear mastered yet systematically misapply a skill when a hidden application constraint is violated. This argues for tracing conditional understanding (knowing when to withhold an action), not only action correctness, when mastery estimates drive adaptive stopping rules.

A related caveat concerns how tracing models are validated versus deployed. Schuetze, Yan, and Carvalho (2025) fit BKT, BKT-with-Forgetting, and the Additive Factors Model to a multi-session successive-relearning dataset and found they reproduce learning trends when fit retroactively to all sessions (acceptable AUC ≈ 0.74–0.79); but under time-based cross-validation — training on one session to predict the next, the realistic applied setting — all three overestimate future performance by roughly 47–58%, fail to capture the spacing effect, and can even predict the wrong ordinal ordering across practice conditions. Tellingly, models without an explicit forgetting mechanism performed about as well as the forgetting-augmented versions as sessions accumulated, suggesting forgetting was partly absorbed into other parameters (e.g., per-student intercepts in AFM) rather than genuinely modeled. The authors tie this to the learning-versus-performance distinction: popular models conflate high in-the-moment performance with high likelihood of long-term retention. The practical implication is that a tracer that looks good on retrospective fit can mislead the adaptive systems consuming its mastery estimates, arguing for walk-forward evaluation and models that account for retention interval, spacing, and between-session forgetting.

A further caveat concerns the evidence rule that feeds the update. Srivastava (2026) ran four update rules over identical ASSISTments 2012–13 event sequences, differing only in how they score rows completed with help, on a confirmatory half of 12,716 students and 985,813 scored events. Reading a hinted or retried row as a failed first attempt predicted later unaided performance best (pooled AUC 0.658); crediting any completion predicted it worst (0.604), barely above a constant that knows only skill difficulty (0.595). The same choice governs the mastery count: crediting completions declared 93.9% of 113,428 student–skill pairs mastered against 72.8% under the strict rule, and the pairs the lenient rule declared ahead of strict went on to 70.9% unaided accuracy against 85.7% where the two agreed, below the 0.744 base rate. A traced state is therefore partly a function of the scoring convention rather than of the learner alone, so a mastery estimate consumed by an adaptive gate should carry the rule that produced it.

Connected Concepts

• Learners — Learners: the umbrella for the learner-side concepts
• Learner Modeling and Adaptive Instruction
• Knowledge Graph
• Adaptive Learning
• Personalized Learning
• Intelligent Tutoring
• Learning Analytics
• Formative Assessment
• AI in Education
• AI Ed Evaluation
• Multimodal AI
• Teaching
• Cognitive Offloading
• Large Language Models (LLMs)
• Simulating Students
• Recommender Systems and Learning Paths

Connected Articles

• Deceptive Overgeneralization: When Adaptive Learning Enables Systematic Misapplication — Deceptive overgeneralization: adaptive mastery can stop practice before learners know when to withhold an action (An, McLaren & Stamper 2026)
• Multimodal Item Parameter Estimation using Simulated Response Probabilities
• EduClaw-Bench: A Long-Horizon Benchmark for Pedagogical LLM Agents with Simulated Learners
• Interpretable Knowledge Tracing
• Augmenting Knowledge Tracing Through Modeling Dynamic Higher-Order Concept Interactions: A Temporal Hypergraph Memory Network
• Learning Engagement Assistant (LEA): Cross-Course Scalability and Classroom Evaluation of an Agentic AI Tutoring System
• Benchmarking Large Language Models for Diagnosing Students' Cognitive Skills from Handwritten Math Work
• Evidence-Grounded Multimodal Knowledge Graph Construction for Multi-Lecture Educational Reasoning
• Automated Recommendation of Programming Learning Content Using Pattern-based Knowledge Components
• ProPRL: Property-Aware Prerequisite Relation Learning in Educational Knowledge Graphs
• Reinforcement Learning Measurement Model
• Estimating Learners' Skill Acquisition Without Temporal Information
• HiLLM-CD: LLM-Enhanced Hierarchical Cognitive Diagnosis
• Comprehensive Review of Intelligent Tutoring Systems
• Jointly Predicting Courses and Grades Using a Transformer-Based Model (TRACE)
• Intelligent tutoring in dynamic domains: a graph-based system for comparative analysis of adaptive algorithms — Graph-Based Intelligent Tutoring for Dynamic Domains (2026)
• CogEvolution: A Human-like Generative Educational Agent to Simulate Student's Cognitive Evolution — CogEvolution: generative agent simulating students' cognitive evolution
• Adaptive Scaffolding for Cognitive Engagement in an Intelligent Tutoring System — Adaptive ICAP scaffolding in an ITS (BKT vs DRL)
• Outcome-based knowledge tracing with affinity mapping and memory augmented outcome impact — Outcome-based knowledge tracing with affinity mapping
• Capturing Session-to-Session Dynamics of Learning and Forgetting: Testing the Limits of Knowledge Tracing Models
• Simulating Learners' Task-Selection Strategies and System Constraints in Mastery Learning — Simulating learners' task-selection strategies and system constraints in mastery learning (Noh, Chowdhary, Ooge, Aleven & Borchers 2026)
• Personalized Exercise Recommendation with Semantically-Grounded Knowledge Tracing — semantically grounded tracing with KC-calibrated states, used as an RL environment for recommendation
• CoLearn: An Agentic Tutor that Learns its Learner in a Human-AI Co-Learning Loop — CoLearn: An Agentic Tutor that Learns its Learner in a Human-AI Co-Learning Loop
• Crediting assisted work inflates mastery: a preregistered comparison of evidence rules in intelligent tutoring logs — Which evidence rule decides a mastery claim (Srivastava 2026)