Codify: Socratic Programming Tutor

📄 DOI: 10.32473/flairs.39.1.141554

Codify (also called AI Tutor) is an Intelligent Tutoring system that leverages LLMs, competency tracking, and adaptive assessment to provide Socratic, discovery-based programming education. Rather than giving direct answers, it guides students through dialogue designed to elicit their own reasoning.

System Architecture

The platform includes:

Conversational tutoring using Socratic methodology

Automated practice generation adapting to student needs

Competency modeling with topic-level mastery tracking

Code analysis for evaluating student submissions

Gamified engagement mechanisms for motivation

Students interact through a chat-based interface, and the system dynamically adjusts question difficulty and Scaffolding based on real-time competency estimates. This approach aligns with research on knowledge tracing and Adaptive Learning, though as a conference poster, empirical evaluation of learning outcomes is preliminary.

Positioning in the ITS Landscape

Codify represents the trend toward LLM-powered tutoring systems that combine conversational AI with structured pedagogical frameworks. Unlike AI feedback systems that provide targeted critique, Codify emphasizes discovery learning — a Socratic approach that connects to questions about Metacognition and Self Regulated Learning. Future work could benefit from incorporating findings from research on reasoning traces and metacognitive calibration, as the Socratic dialogue format may face similar challenges of inflating student confidence without improving performance.

Connected Concepts

Self Regulated Learning

Higher Ed

RAG

Connected Articles

AI Peer Feedback Systems — AI Peer Feedback Systems

Correct Answer Trap AI Tutor — Catching The Correct Answer Trap: Characterising AI Tutor Blind Spots When Analysing Student Reasoning

Knowledge Tracing IRT — Interpretable Knowledge Tracing via IRT

LLM Reasoning Traces Metacognition — Explaining Too Much? Understanding How Large Language Model Reasoning Traces Influence Performance and Metacognition

A4l Analytics Pipeline — Generalizing a Highly Configurable Analytics Pipeline to Replicate and Support Educational Research Across Multiple D...

Aaai2026 Prompting Literacy K12 — Learning to Use AI for Learning: Teaching Responsible Use of AI Chatbot to K-12 Students Through an AI Literacy Module

Academiclaw Student Agent Benchmark — AcademiClaw: When Students Set Challenges for AI Agents

Access Not Enough AI Tutoring 2026 — Access is Not Enough: Human Support Improves Engagement with AI Tutoring

Adapt Adaptive Lesson Plan Transformer — AdaPT: Adaptive Lesson Plan Transformer for Cross-Regional and Differentiated Instruction

Adaptive Pretesting Retention — Do Gains from Generative AI-Enabled Adaptive Pretesting Persist? Evidence from a Retention Study

Affective Text Wearable Student Health — A Formative Study of Brief Affective Text as a Complement to Wearable Sensing for Longitudinal Student Health Monitoring

Agency Gap AI Writing — The agency gap in AI-supported writing: how reactive and proactive agent designs shape multimodal reasoning

Agent Voice Accents K12 Group Learning — Exploring How Agent Voice Accents Shape Human-AI Collaboration in K-12 Group Learning

Agentic AI Education Scoping Review — Agentic AI in Education: A Scoping Review of Research Landscape, Capabilities, and the Frontier Agent Paradigm

Agentic AI Pedagogical Best Practice 2026 — Agentic AI and Pedagogical Best Practice: The Tension Between Automation and Learning

Agentic Education Coding — Agentic Education with AI Coding Assistants

Agentic Literacy Debt — Agentic Literacy Debt: A Structural Problem the AI Literacy Field Has Not Yet Named

Agentic Workflows Education — Agentic Workflows in Education

Agents That Teach Incidental Learning — Agents That Teach: Designing Incidental Learning Back into AI-Assisted Software Development

Agreement Not Quality LLM Coding Verification — Agreement Is Not Quality: Blind Expert Verification of Human and LLM Qualitative Coding When Human Consensus Is Not G...

AI Adult Learning Design — Guidelines for Designing AI Technologies to Support Adult Learning

AI Adult Learning Guidelines Dis2026 — Guidelines for Designing AI Technologies to Support Adult Learning

AI Agents Constructive Conflict Design Education 2026 — Enacting Constructive Conflicts with AI Agents to Enhance Reconsideration among Novice Interaction Designers

AI Agents Peer Learning Discourse — When AI Agents Teach Each Other: Discourse Patterns Resembling Peer Learning in the Moltbook Community

AI Assessment Human Tutors — AI-Driven Assessment of Human Tutors: Linking Training Performance to Real-Life Practice

Citation