Bayesian cognitive diagnosis optimizes personalized learning paths via mediation of cognitive load and Hidden Markov Model state transitions

On this page

Synthesis: Feng and Huang (2026) proposed and validated a personalized learning path optimization framework that integrates Bayesian cognitive diagnosis, knowledge space theory, and cognitive load theory to address the sparsity of large-scale educational data and the lack of empirical testing of the psychological mechanism behind personalized paths. In the first phase, a Bayesian DINA model was trained on the EdNet public dataset (N=5,000) with a shortest remediation path algorithm; in the second phase, a dataset of 120 students validated the algorithm's effectiveness, with Bootstrap mediation testing of cognitive load and a Hidden Markov Model (HMM) analyzing knowledge-state dynamics. The framework demonstrates how Bayesian cognitive diagnosis can optimize adaptive learning paths while making the underlying cognitive-load mechanism empirically testable — identifying cognitive load as the primary mediator (indirect effect 0.28) and Analytical Thinking (A5) as the key learning bottleneck.

Solving the sparsity problem with Bayesian DINA

Traditional DINA cognitive-diagnosis models struggle to converge on large-scale, sparse educational data where most learner–item responses are missing. The paper's first methodological contribution is a Bayesian DINA model that converged successfully on EdNet data with 91.3% sparsity (R-hat 1.002–1.008, below the 1.01 threshold, with adequate effective sample sizes), producing attribute mastery probability estimates of 0.280–0.368. This provides a viable route for applying cognitive diagnosis to real-world online learning platforms where complete response matrices are rarely available. The Q-matrix was validated with the δ-method: 14 of 918 A5-related items had q-entries statistically rejected, and correcting these reduced an otherwise theoretically anomalous knowledge-state pattern ("00001" — mastering only Analytical Thinking, which should require lower prerequisites) from 14.2% to 3.8%, confirming the original prerequisite hierarchy had superior predictive efficiency.

Personalized paths improve efficiency

Using the diagnosed knowledge states, a shortest remediation path algorithm (grounded in knowledge space theory) produced personalized paths averaging 3.82 steps. These were 22.4% more efficient than random paths (d = 0.96) and 23.6% more efficient than full-coverage fixed-order paths (d = 0.98). This efficiency gain cross-validated in a separate randomized probability-learning experiment involving 120 students: personalized-path learners took 57.6 minutes versus 73.8 minutes for controls — a 22.0% time saving (d = 1.52) — and, controlling for pre-test in an ANCOVA, significantly outperformed controls on the post-test (η² = 0.065). In other words, personalized paths were not only shorter but also produced better learning outcomes.

The mediating role of cognitive load

The study empirically tests the psychological mechanism that had previously been assumed: why personalized paths improve learning. Personalized paths significantly reduced cognitive load on all six adapted NASA-TLX dimensions (large effect sizes, d = 1.12–1.80, largest for learning clarity at d = 1.80). Bootstrap mediation analysis showed cognitive load was the primary mediator between intervention type and post-test performance (indirect effect 0.36, 53.7% of total effect; in the multiple-mediation model 0.28), with learning Motivation (0.18) and Self Efficacy (0.12) as complementary mediators — the three pathways together explaining 86.6% of the total effect. This positions cognitive load as a key psychological pathway linking path design to outcomes, aligning with cognitive load theory's prediction that prerequisite-aligned sequences reduce extraneous load and free resources for schema construction.

Identifying the learning bottleneck with an HMM

A Hidden Markov Model tracked the dynamic evolution of knowledge states, computing forward and backward transition probabilities for each cognitive attribute. Forward transition probabilities decreased monotonically with hierarchy position — A1 Foundation Concepts 0.67 down to A5 Analytical Thinking 0.31 — identifying A5 as the learning bottleneck. Notably, A5 also had the highest backward transition probability (0.22–0.23), meaning learners prone to regression even after mastering analytical thinking, and the highest guessing parameter (g=0.28), which helped reconcile why A5 showed the "highest" mastery in the multiple-choice-heavy EdNet data yet was the hardest to genuinely acquire. This yields a precise target for bottleneck-attribute intervention in intelligent tutoring systems.

Connected Concepts

Connected Articles

LLM Cognitive Diagnosis Handwritten Math — LLM cognitive diagnosis of handwritten math
Xie Hillm Cd 2026 — HI-LLM for cognitive diagnosis
Adaptive Pretesting Retention — Adaptive pretesting and retention

Citation

Feng, Z., & Huang, K. (2026). Bayesian cognitive diagnosis optimizes personalized learning paths via mediation of cognitive load and Hidden Markov Model state transitions. Frontiers in Psychology, 17, 1879982.

Source History Edit Chat