Neural-Symbolic Knowledge Tracing

Key limitations exist in both LLM-based tutoring and conventional Deep Knowledge Tracing (DKT):

Combining neural networks with symbolic educational knowledge for interpretable, data-efficient, and temporally reliable learner modeling in intelligent tutoring systems.

The Problem with Pure Neural Approaches

Hooshyar et al. (2026) identify key limitations in both LLM-based tutoring and conventional Deep Knowledge Tracing (DKT):

Limited adaptivity: LLMs struggle to model learners' evolving knowledge over time — they respond to individual turns rather than tracking skill mastery across sessions.

Black-box opacity: Deep learning models (LSTM/Transformer-based DKT) lack interpretable learner state representations, making it impossible to audit why a student is flagged as struggling.

Spurious correlations: Purely data-driven models can latch onto surface patterns (session length, interaction frequency) rather than genuine learning signals.

Temporal instability: Conventional DKT produces prediction inconsistency rates of 0.075–0.138, meaning predictions frequently "flip-flop" between correct/incorrect as new responses arrive — undermining trust.

The Responsible-DKT Model

Hooshyar et al. propose Responsible-DKT, a neural-symbolic architecture built on the Lifted Relational Neural Networks (LRNN) paradigm using PyNeuraLogic. The key innovation: symbolic educational knowledge is injected as learnable weighted rules that modulate (not override) neural predictions.

Architecture

Component	Detail
Embeddings	Learnable vectors for quiz, skill, correctness (dim=16)
Combined rep	Weighted sum of embeddings + sigmoid activation
Recurrent core	Two-layer RNN with temporal shift (prediction at t uses only past interactions)
Symbolic rules	Three rules with learnable weights, wired into the computation graph
Output	Sigmoid over hidden state + target embedding → ŷ_{t+1}

Injected Educational Knowledge (Symbolic Rules)

1. mastered rule: Two consecutive correct responses on the same skill/quiz → increases prediction confidence. Encodes the pedagogical assumption that sustained correctness signals mastery.

2. not_mastered rule: Three incorrect responses on the same skill/quiz → decreases prediction confidence. Encodes the assumption that repeated failure is a stronger signal — the paper found this rule dominates prediction updates.

3. avg_embed rule: Historical aggregation of past embeddings for the same skill/quiz — provides a long-run average representation of the student's relationship to a knowledge component.

Baselines

BaseNS-DKT: Identical neural-symbolic architecture but without the educational knowledge rules — isolates the value of symbolic injection.

PyTorch DKT: Fully data-driven DKT — represents the conventional black-box approach.

Key Findings

Data Efficiency (RQ1)

>0.80 AUC with only 10% of training data — practically useful for cold-start and sparse-data settings.

Up to 0.90 AUC with full training data.

Up to 13% improvement over both baselines.

Temporal Reliability (RQ2)

Lowest prediction inconsistency rates across all sequence lengths (10, 50, 100, 475):

Responsible-DKT: 0.013–0.039

PyTorch DKT: 0.075–0.138

Lower early- and mid-sequence prediction errors.

Prediction updates remain directionally aligned with observed responses — the model doesn't contradict itself as new data arrives.

Interpretability (RQ3)

Grounded computation graph exposes the logic behind each prediction — inherently interpretable, not post-hoc explained.

Supports both local (per-prediction) and global explanations.

Empirical evaluation of pedagogical assumptions revealed that non-mastery rules (repeated incorrect responses) have a stronger influence on prediction updates than mastery rules — an insight that would be invisible in black-box models.

Dataset

Real-world 6th-grade Maths from Opiq: 167 students, 21,471 interactions, 13 skills, 1,058 quizzes. Scores binarized at first-quartile threshold (37/100).

Connection to Knowledge Tracing Landscape

Traditional Knowledge Tracing (KT) methods:

IRT-based (Item Response Theory): Knowledge Tracing IRT — interpretable difficulty parameters but limited sequential modeling.

BKT (Bayesian Knowledge Tracing): Explicit prerequisite structures; interpretable but rigid.

DeepKT (LSTM/Transformer): High predictive capacity but opaque.

Neural-symbolic KT bridges the gap: retains interpretability of symbolic approaches while leveraging neural networks' representational power.

Implications for Responsible AI in Education

The paper positions this under responsible AI (Goellner et al., 2024: "human-centred approach fostering user trust through ethical decision-making, explainable outcomes, and privacy-preserving implementation"):

1. Transparency: Symbolic components make learner state auditable — critical for safety auditing.

2. Pedagogical validity: Updates follow educational theory (mastery learning, repeated-failure signals), not just data patterns.

3. Data efficiency: Practical in real educational settings where large labeled datasets are rare.

4. Temporal trustworthiness: Predictions don't oscillate wildly — a key requirement for student trust and instructor decision-making.

This contrasts with opaque LLM-based approaches in tutoring alignment and demonstrates a path toward principled AI in education — augment, don't displace, pedagogical reasoning.

Open Questions

How does Responsible-DKT scale to larger skill graphs (hundreds of knowledge components)?

Can the symbolic rule set be extended with domain-specific pedagogical knowledge (e.g., common misconceptions)?

How does this compare to LLM-based longitudinal student modeling in both accuracy and interpretability?

Is the 13% improvement maintained with more diverse student populations and subject domains?

Connected Concepts

Student Experience

Pedagogical LLM Training

Connected Articles

Knowledge Tracing IRT

AI Tutor Safety Harms

Principled AI Education

LLM Student Modeling Memory

Citation

Hooshyar, D., Šír, G., Yang, Y., Kärkkäinen, T., Hämäläinen, R., Krivich, E., Cukurova, M., Gašević, D., & Azevedo, R. (2026). Neural-Symbolic Knowledge Tracing: Injecting Educational Knowledge into Deep Learning for Responsible Learner Modelling. arXiv:2604.08263.