When AI Does the Work, What Is Learning For? Post-Instrumental Learning and the Risk of Capacity Dissolution

Argues that as AI systems become capable of producing the artifacts through which institutions recognize competence, existing ethical frameworks centered on AI failures become insufficient. Develops the concept of "post-instrumental learning" and warns that each technical improvement appears to weaken the case for human learning itself, risking "capacity dissolution."

Key Findings

If the case for learning rests only on current AI failures — bias, opacity, hallucination, labor extraction, privacy risk, and weak accountability — then each technical improvement appears to weaken it.

The article develops an idealization of AI that executes specified tasks flawlessly while lacking authority over purposes, legitimacy, and responsibility, and argues for post-instrumental learning that preserves the capacities people and institutions need when many useful outputs can be delegated.

Five capacities are analyzed — end-setting, reason-giving, contestability, refusal/revision, and participation — and their erosion is named capacity dissolution.

The central case is Assessment under generative AI: when a polished artifact no longer reliably evidences understanding, institutions must assess the learner's accountable relation to AI-mediated work rather than the artifact alone.

The takeaway is practical: AI governance should evaluate not only whether systems perform well, but also whether their deployment leaves people able to understand, challenge, revise, and share responsibility for the practices those systems mediate.

The Central Case: Assessment under Generative AI

The argument opens with a recognizable scene: a student submits a fluent essay and cannot explain its central claim; a manager approves an elegant market analysis without knowing which assumptions make it plausible. In each case the output looks successful, but the relation between the person, the institution, and the reasons behind the work has become thin. Existing criticisms of large-scale AI systems — that they reproduce inequality, hide responsibility, depend on invisible labor, and deepen relational injustice — remain indispensable, but they do not fully answer the educational question. Treating learning merely as preparation for producing outputs makes AI improvement a reason to produce those outputs with less human effort, a conclusion the author argues is too quick.

Implications for AI Governance

The article translates the argument into a deployment-review question: what will people stop learning if this system works? Losing obsolete routines may be harmless, but losing the ability to set goals, give reasons, contest, and participate is not. The practical right of contestability is not a demand that everyone master every technical detail: a student need not reproduce every step of a model's generation to defend a claim made in a paper. Rather, each person needs a path from a problem they experience to reasons they can understand and, where appropriate, to a process that can revise the decision — a path that depends on trained intermediaries, accessible records, meaningful appeal, and public settings where reasons can be tested. The article warns that when privileged users can contest AI while marginalized users receive automated completion or automated suspicion, the institution has changed the distribution of expertise while calling the result access. For AI Governance Education and Over Reliance debates, this reframes the goal of schooling: preserving capacities such as Ethics-inflected judgment and accountable participation rather than maximizing efficient output generation.

Connected Concepts

Student Misconceptions AI

Cognitive Offloading

Prompt Engineering

Affective Tutoring

Connected Articles

Code Review GenAI Cs1 — Combating Harms of Generative AI in CS1 with Code Review Interviews and a Flipped Classroom

Learning By Chatting GenAI Impact — Learning by Chatting? Investigating the Impact of Generative AI on Information Seeking and Learning

Efficiency Gain Illusion AI Overreliance — The efficiency-gain illusion: People underestimate the rate of AI use and overestimate its benefits on simple tasks

GenAI Reliance Types Scale — Measuring How Students Rely on Generative AI in Academic Writing: Development and Multi-Source Validation of the Generative AI Reliance Types Scale (GenAI-RTS)

Repeated AI Writing Feedback Semester — Student Evaluation of Repeated AI Feedback Across a Semester of Writing

Buggy GenAI Code Student Responses — When AI Is Wrong on Purpose: How Students Respond to Buggy GenAI Code

Citation

Kai Yao (2026). When AI Does the Work, What Is Learning For? Post-Instrumental Learning and the Risk of Capacity Dissolution. arXiv:2607.28041. cs.CY.