๐Ÿง  AI Ed Wiki

Vendrell & Johnston (2026) propose a design-oriented framework for LLM use in higher education that strengthens rather than displaces Critical Thinking, countering Cognitive Offloading and metacognitive disengagement (Metacognition, Scaffolding).

Vendrell & Johnston (2026) propose a design-oriented pedagogical framework for integrating LLMs into higher education in ways that strengthen rather than displace critical thinking. Drawing from cognitive psychology, educational theory, and AI ethics, the framework addresses the risk that unstructured LLM use leads to cognitive offloading, metacognitive disengagement, and reduced epistemic agency.

The Problem: Unstructured LLM Use

A global survey reports 86% of university students now use AI in their studies, with over half engaging weekly โ€” primarily for summarization, grammar checking, and drafting (Digital Education Council, 2024). However, LLMs are not designed with educational goals in mind; they simulate understanding via probabilistic language modeling without intentionality or comprehension.

Research shows that unguided AI use correlates with:

  • Weaker arguments and lower cognitive engagement (Stadler et al., 2024)
  • Diminished attentional modulation (Kosmyna et al., 2025)
  • Reduced independent evaluation, especially among younger students (Gerlich, 2025)
  • Decreased scrutiny of outputs, increasing susceptibility to misinformation (Yatani et al., 2024)
  • Shifted attitudes toward AI biases even when recognized (Fisher et al., 2025)
  • Overall erosion of critical thinking, decision-making, and analytical reasoning (Zhai et al., 2024)
  • However, when students first engage independently before consulting AI, their outputs are significantly stronger (Kosmyna et al., 2025). This mirrors earlier technology integrations โ€” calculators, search engines โ€” where effects depend on pedagogical design, not the tool itself.

    Six Essential Processes

    The framework identifies six interconnected cognitive and metacognitive processes that must be deliberately supported in AI-enhanced learning environments:

    ProcessDefinition
    1. Conceptual interpretationActively constructing meaning by selecting, organizing, and integrating information; distinguishing core ideas from peripheral details. Aligned with Bloom's "Understand" and "Analyse" levels.
    2. Inferential reasoningGenerating warranted conclusions from evidence; identifying assumptions, discerning logical relationships, and predicting implications. The cognitive bridge between information and action.
    3. Evaluative judgementAssessing credibility, coherence, and evidentiary support of claims. What Bielik & Krell (2025) call epistemic vigilance โ€” the capacity to critically assess both source credibility and claim validity.
    4. Metacognitive regulationMonitoring, evaluating, and strategically controlling one's cognitive processes. Transforms critical thinking from episodic acts into sustained, self-directed practice.
    5. Intellectual curiosityThe motivational disposition to explore ideas, ask questions, and pursue knowledge beyond instrumental goals. Fuels cognitive persistence and epistemic openness.
    6. Epistemic integrityThe ethical orientation to seek truth, evaluate claims fairly, and engage with complexity conscientiously. Combines intellectual honesty with critical reflexivity.

    Eight Design Principles

    PrincipleCore MechanismSupported Processes
    P1. Preserve cognitive frictionRequire independent thinking before AI; use AI to generate counterargumentsConceptual interpretation, Inferential reasoning
    P2. Scaffold LLMs as thinking partnersPosition LLMs as provisional collaborators, not authoritative sourcesInferential reasoning, Curiosity, Epistemic integrity
    P3. Embed evaluation as standard practiceStructured checkpoints for cross-referencing and criteria-based assessmentInferential reasoning, Evaluative judgement
    P4. Activate metacognitive self-regulationPlanning templates, reflective journals, AI prompt logsMetacognitive regulation
    P5. Encourage intellectual humility and curiosityExamine AI limitations, explore alternative perspectives, identify omissionsCuriosity, Epistemic integrity
    P6. Foster epistemic integrityRequire justification of claims, multiple perspectives, reasoning under uncertaintyEpistemic integrity
    P7. Align assessment with intended cognitionReward reasoning quality over surface fluency; assess how students interpret, question, and integrate AI contentEvaluative judgement, Metacognitive regulation
    P8. Balance AI-mediated and AI-free phasesSequence pre-AI, during-AI, and post-AI activities; deliberate AI-free zonesConceptual interpretation, Metacognitive regulation

    Connection to Existing Frameworks

    This model aligns with the Principled AI Education principle of augmenting rather than displacing human cognition. The emphasis on sequencing echoes findings in Tutoring Specific Vs General AI that pedagogically-designed AI outperforms raw LLM chatbots on learning outcomes. The metacognitive focus connects to Self Regulated Learning cycles of planning, monitoring, and evaluation, while drawing on feedback literacy principles (Carless & Boud, 2018).

    P1's use of counterarguments as cognitive stimuli parallels the Socratic AI Dialogue approach of using questions to foster expert-like reasoning. P7's assessment alignment extends Formative Assessment principles into AI-mediated contexts, and the emphasis on preserving learner agency connects to AI Learning Companions Framework which prioritizes learning over performance. The focus on epistemic integrity and the risk of over-reliance also speaks to Transfer Of Learning โ€” the central question of whether AI-assisted gains persist when tools are removed.

    P2's scaffolded positioning of LLMs aligns with AI Literacy frameworks that progress from understanding to critical engagement to creative application, and the framework's overall design-based research methodology parallels the evidence standards discussed in Stanford Evidence Base AI K12 2026.

    Practical Application

    Two illustrative scenarios demonstrate implementation:

    Scenario A: Prompt Crafting and Critique. Students draft prompts individually without AI access, predict possible responses and limitations, analyze outputs using structured criteria (Which perspectives are prioritized? What is absent? What claims lack justification?), revise prompts with reflection, and identify ethical implications of prompt framing.

    Scenario B: AI-Mediated Debate and Synthesis. Students engage in structured debate with AI as a provisional interlocutor, followed by independent written synthesis requiring assumption identification, counterargument consideration, and integration of AI-generated content with original reasoning.

    Both scenarios emphasize the critical sequence: independent thinking first, AI interaction second, reflective integration third.

    Open Questions

  • How do these principles scale across class sizes, disciplines, and institutional contexts?
  • What is the minimum threshold of AI literacy needed for students to benefit from scaffolded integration?
  • How should faculty development programs train instructors to implement these principles at scale?
  • What empirical evidence is needed to validate the framework's efficacy claims?
  • Connected Concepts

  • AI Literacy
  • Faculty Development
  • Formative Assessment
  • Metacognition
  • Self Regulated Learning
  • Socratic AI Dialogue
  • Generative AI
  • Higher Ed
  • Scaffolding
  • Connected Articles

  • Stanford Evidence Base AI K12 2026 โ€” AI in K-12 Evidence Base
  • AI Learning Companions Framework โ€” Building AI Companions that Prioritise Learning over Performance
  • Transfer Of Learning โ€” AI Learning Transfer
  • Chatgpt Critical Creative Thinking Review โ€” ChatGPT Critical and Creative Thinking: Systematic Review
  • Data Annotations Pedagogical Hints โ€” Data Annotations as Pedagogical Hints: From Subjective Labels to Critical Thinking
  • Principled AI Education โ€” Principled AI in Education
  • Scaffolding Critical Engagement GenAI Minority Students โ€” Scaffolding Critical Engagement with GenAI: Transforming Ethnic Minority Preparatory Students' Collaborative Discours...
  • Sequenced AI Feedback Learning โ€” Assessing the Impact and Underlying Pathways of Sequenced AI Feedback on Student Learning
  • Students LLM Usage Critical Thinking โ€” Characterizing Students' LLM Usage Behaviors and Their Association with Learning in Critical Thinking Tasks
  • Tutoring Specific Vs General AI โ€” Tutoring-Specific vs. General-Purpose AI in Education
  • A4l Analytics Pipeline โ€” Generalizing a Highly Configurable Analytics Pipeline to Replicate and Support Educational Research Across Multiple D...
  • Aaai2026 Prompting Literacy K12 โ€” Learning to Use AI for Learning: Teaching Responsible Use of AI Chatbot to K-12 Students Through an AI Literacy Module
  • Academiclaw Student Agent Benchmark โ€” AcademiClaw: When Students Set Challenges for AI Agents
  • Access Not Enough AI Tutoring 2026 โ€” Access is Not Enough: Human Support Improves Engagement with AI Tutoring
  • Adapt Adaptive Lesson Plan Transformer โ€” AdaPT: Adaptive Lesson Plan Transformer for Cross-Regional and Differentiated Instruction
  • Adaptive Pretesting Retention โ€” Do Gains from Generative AI-Enabled Adaptive Pretesting Persist? Evidence from a Retention Study
  • Affective Text Wearable Student Health โ€” A Formative Study of Brief Affective Text as a Complement to Wearable Sensing for Longitudinal Student Health Monitoring
  • Agency Gap AI Writing โ€” The agency gap in AI-supported writing: how reactive and proactive agent designs shape multimodal reasoning
  • Agent Voice Accents K12 Group Learning โ€” Exploring How Agent Voice Accents Shape Human-AI Collaboration in K-12 Group Learning
  • Agentic AI Education Scoping Review โ€” Agentic AI in Education: A Scoping Review of Research Landscape, Capabilities, and the Frontier Agent Paradigm
  • Agentic AI Pedagogical Best Practice 2026 โ€” Agentic AI and Pedagogical Best Practice: The Tension Between Automation and Learning
  • Agentic Education Coding โ€” Agentic Education with AI Coding Assistants
  • Agentic Literacy Debt โ€” Agentic Literacy Debt: A Structural Problem the AI Literacy Field Has Not Yet Named
  • Agents That Teach Incidental Learning โ€” Agents That Teach: Designing Incidental Learning Back into AI-Assisted Software Development
  • AI Adoption Training Public Sector โ€” The Main Barrier to AI Adoption in the Public Sector is Lack of Training
  • Citation

    Vendrell, M., & Johnston, S.-K. (2026). Scaffolding critical thinking with generative AI: Design principles for integrating large language models in higher education.