๐Ÿง  AI Ed Wiki

Based on a questionnaire of 100 higher-education engineering students and a critical literature review, examines how students use and perceive LLMs. Students value LLMs for writing support, conceptual clarification, coding assistance, and brainstorming, but express concerns about inaccuracies, bias, overreliance, and academic integrity. Analyzes two dominant metaphors โ€” LLM as 'oracle' and 'tutor' โ€” showing they cultivate expectations exceeding actual capabilities. Argues students' attachment to LLM efficiency reflects 'cruel optimism' โ€” benefits depend on skills still being developed.

Key Findings

  • In a questionnaire of 100 higher-education students, predominantly from engineering-related fields, LLMs were most valued for writing support, conceptual clarification, coding assistance, and brainstorming.
  • Students simultaneously expressed concerns about inaccuracies, bias, overreliance, academic integrity, and the burden of verification imposed by AI-generated output.
  • Two dominant metaphors โ€” the LLM as "oracle" and as "tutor" โ€” cultivate expectations of authority, expertise, and personalized learning that exceed what probabilistic text generators can actually deliver.
  • Students' attachment to the promises of efficiency and personalized support reflects a form of "cruel optimism": the perceived benefits depend on the very skills, vigilance, and expertise that students are still developing.
  • Student respondents who offered suggestions (N=27) called for assessment redesign โ€” in-person essays, grading shifted from memorization to analysis, oral exams, and presentations with personalized questions โ€” pointing beyond the reproducibility of knowledge.
  • The chapter argues for a purpose-driven, context-sensitive approach to AI integration in engineering education, emphasizing critical AI literacy, reflective assessment design, pedagogical caution, and consideration of broader ethical and environmental impacts.
  • Assessment Design

    The chapter treats assessment as a key lever, reviewing frameworks such as the AAA (Against, Avoid, Adopt) approach, which keeps lower-order assessment tasks supervised when AI can complete them (e.g., recalling facts, explaining concepts) and relies on contextualization in current affairs, personal experiences, and in-class engagement for higher-order skills. These recommendations align with the students' own suggestions for closed, supervised, or oral formats, and signal a shift in the instructor's role from policing AI use toward reflectively adapting assessment for AI's possible (mis)use.

    Implications for AI in Education

    The "cruel optimism" argument has direct consequences for pedagogy: the efficiency gains of AI are only realized when learners already possess the Critical Thinking and domain expertise needed to judge AI output โ€” precisely the skills that education is supposed to build. This makes AI Literacy and verification capacity prerequisites rather than optional extras, and cautions against framing AI tools as substitutes for expertise. For engineering education specifically, the balancing act lies in leveraging LLM support for writing, coding, and brainstorming while designing assessments and curricula that keep the burden of verification and the development of judgment inside the learning process, guarding against Over Reliance.

    Connected Concepts

  • AI Literacy
  • Administrator
  • Teacher AI Competency
  • Bias Mitigation
  • Agentic AI
  • K 12 AI Education
  • AI Tutoring
  • Affective Tutoring
  • Connected Articles

  • Bridging Instructional Design Framework Math โ€” WIP: Bridging the Gap Between Instructional Design and Pedagogical Use: A Framework for Mathematics Educators
  • Trio Ethnography LLM Programming Education โ€” Beyond Perspectives: A Trio-Ethnography of Interpretation Evolution in LLM-Supported Programming Education
  • Edumirror Educational Social Dynamics โ€” EduMirror: Modeling Educational Social Dynamics with Value-driven Multi-agent Simulation
  • AI Team Teaching Talk Analytics โ€” AI-Driven Analytics of Team-Teaching Talk: Acoustic Patterns across Experience, Cohorts and the Learning Design
  • LLM Misconception Difficulty Easy Trap โ€” The Easy Trap: Why LLMs Underestimate Misconception-Driven Difficulty
  • Mind The Trust Gap Teacher Student Views Control Agency K12 Classroom AI โ€” Mind the Trust Gap: Identifying (Mis)alignments in Teacher-Student Views Toward Control and Agency in K-12 Classroom AI
  • Citation

    Olya Kudina (2026). Using AI in engineering education: a balancing act, driven by clear purpose. arXiv:2606.16626. The Routledge Handbook of the Philosophy of Engineering, 2nd ed..