AI as a Partner in Learning about, Doing, and Engaging with Science: Vigilance as the Key to Productive Augmentation

Argues that epistemic vigilance — the human evaluation of AI output calibrated to how far a fallible source can be trusted — is the binding constraint on productive augmentation. AI's fluent, confident prose reads as trustworthy whether or not it is, making evaluation harder. Vigilance sets how deeply a claim is processed and is thus the precondition for learning with AI. Design factors (prompts, feedback, scaffolding) matter only through whether they engage the learner's evaluation. Because vigilance is unevenly distributed, uniform AI integration risks widening achievement gaps.

Key Findings

The paper identifies epistemic vigilance — the human evaluation of AI output calibrated to how far a fallible source can be trusted — as, given adequate prior knowledge, the binding constraint on productive augmentation in learning with AI.

The AI partnership takes three forms — the scientist working with a co-scientist, a member of the public checking a claim such as whether a diet works or whether to fit solar panels, and a student taking up an inquiry with AI inside a science class — and in all three the deciding factor is whether the human evaluates what the AI returns or takes it on trust.

Vigilance is what licenses augmentation: because the human stays vigilant, generation, retrieval, and drafting can be delegated safely, so vigilance expands rather than restricts what can be handed to the AI.

The AI case is distinctive because the machine's fluent, confident prose reads as trustworthy whether or not it is, so the default surface of the output works against the human doing the evaluating.

Vigilance sets how deeply a claim is processed, making calibrated vigilance the precondition for productive learning with AI; design factors such as prompts, feedback, and scaffolding matter through whether they engage the learner's evaluation, and none works around it.

Candidates that might seem to make vigilance dispensable — the learner's own content knowledge, a neighboring competence, or a more trustworthy AI — do not remove the need for it.

Because the disposition to evaluate is unevenly distributed, integrating AI uniformly across a classroom is likely to widen achievement gaps.

The Argument

The paper specifies the components of vigilance, the mechanism that ties it to learning, and a way to measure it without soliciting the very evaluation it is meant to detect. It also distinguishes judging from producing: each capacity is built by exercising it, so what is handed over to the AI is never the exercise the lesson exists to provide — a learner who evaluates a derivation deeply is practicing judgment, not derivation. Existing evidence anchors the processing-depth half of the claim; what remains untested is vigilance as a measured disposition, above all in the regime where the AI is confidently wrong.

Implications for AI in Education

For science education, the argument reorients design: the many factors reported as shaping AI's effect — prompts, feedback, scaffolding — succeed only insofar as they engage the learner's evaluation of AI output, making Critical Thinking and Hallucination Risk awareness central to instructional design rather than peripheral. The equity warning is direct: since vigilance is unevenly distributed, uniform AI integration risks widening achievement gaps, so Scaffolding and differentiated support must target the disposition to evaluate, not just tool access, and this bears on Equity in who benefits from AI-augmented learning. Finally, the judging-versus-producing distinction gives educators a principled rule for dividing labor between learner and AI: whatever the lesson exists to teach must stay with the learner.

Connected Concepts

Pedagogical Agent

Affective Computing

Self Regulated Learning

Personalized Learning

Affective Tutoring

Administrator

Hallucination Risk

Teacher AI Competency

Connected Articles

AI Learning Assistants Higher Ed Large Scale — Using AI-based Learning Assistants in Higher Education: A Large-Scale Descriptive Analysis

Edtech Design Time Generative UI — The Missing Layer: Why EdTech Needs Design-Time Generative UI, Not Just Runtime Personalization

Edumirror Educational Social Dynamics — EduMirror: Modeling Educational Social Dynamics with Value-driven Multi-agent Simulation

Shame Guilt AI Regulation Computing Education — Stuck in a Spiral": Shame and Guilt as Social Regulators of AI Use in Computing Education

AI LMS Middle School Longitudinal — AI-Integrated Learning Management System for Middle School: A Longitudinal Study of Learning Outcomes

Measuring LLM Tutors Teach Vs Solve — Measuring Whether LLM Tutors Teach or Solve: A Diagnostic for Educational Impact

Citation

Marcus Kubsch (2026). AI as a Partner in Learning about, Doing, and Engaging with Science: Vigilance as the Key to Productive Augmentation. arXiv:2606.16822. arXiv preprint (physics.ed-ph).