🧠 AI Ed Wiki

📄 Research Article

Engagement Intensity as a Learner-Modeling Signal for Adaptive AI Ethics Instruction

◐ medium · 2026-06-18personalized-learning, adaptive-learning, ai-literacy, higher-ed, engagement-metrics, student-experience, adaptive-learning-systems, ethics, llm

Engagement intensity during AI ethics instruction serves as an effective learner-modeling signal for adaptive instruction; prior LLM experience influences engagement patterns.

Synthesis

This study investigates whether simple intake measures can serve as learner-modeling signals for adaptive AI ethics instruction. Drawing on data from 93 bioscience graduate and postdoctoral trainees enrolled in a required research ethics course, the authors compare three candidate intake features — self-reported LLM usage frequency, self-rated LLM familiarity, and prior AI education — against five baseline perception outcomes: accuracy trust, evaluation capability, complex-task trust, over-reliance risk, and training interest. The results position simple behavioral engagement measures as promising, lightweight inputs for profiling learners before instruction begins, with direct relevance for Personalized Learning and Adaptive Learning design.

Key Findings

  • Usage frequency showed Holm-corrected associations with all five baseline perception outcomes, making it the most consistent intake signal of the three tested.
  • Self-rated LLM familiarity was associated with three of the five outcomes, serving as a secondary indicator.
  • Prior AI education (coursework or workshop attendance) was associated with none of the five outcomes, questioning its value as an intake measure.
  • The association pattern was threshold-like at the lower end of the scale rather than a uniform gradient across all five outcomes, and was most visible for training interest and accuracy trust.
  • The authors conclude that simple pre-instruction behavioral signals can inform lightweight intake profiling for adaptive AI ethics education, supporting AI Literacy development in graduate research training.

    • Study Design & Method

    The study surveyed 93 bioscience graduate students and postdoctoral trainees enrolled in a required research ethics course before instruction began. Three candidate intake features were compared across five baseline perception outcomes using statistical models with Holm correction for multiple comparisons. The five outcomes were treated as facets of distinct constructs from prior work on trust calibration and AI literacy — accuracy trust, evaluation capability, complex-task trust, over-reliance risk, and training interest — rather than as indicators of a single latent dimension.

    Limitations

    The cross-sectional design does not establish directionality: engagement may shape perceptions, perceptions may shape engagement, or both may reflect upstream factors such as disciplinary norms or dispositional openness. Usage frequency was self-reported on a Never-to-Daily scale rather than observed behavior, and both predictors and outcomes relied on self-report, so response styles such as acquiescence or extremity bias could contribute to the associations. The authors also caution that the null result for prior AI education should be read carefully, since AI literacy spans multiple competencies and the coding of prior education was relatively coarse.

    Connected Concepts

  • Personalized Learning
  • AI Literacy
  • Adaptive Learning
  • Affective Tutoring
  • Bias Mitigation
  • Affective Computing
  • Prompt Engineering
  • Knowledge Tracing

    • Connected Articles

  • LLM Misconception Difficulty Easy Trap — The Easy Trap: Why LLMs Underestimate Misconception-Driven Difficulty
  • LLM Psychometric Calibration Cdp — Aligning LLM-Simulated and Human Examinees for Psychometric Calibration: A Cognitive Diagnostic Profiling Approach
  • AI Learning Tools Engineering Education Needs — Designing Needs- and Attention-Aware AI Learning Tools for Engineering Education: Insights from Psychological Outcomes
  • Vibe Coding Programming Process Visualizer — From Idea to Classroom in Days: Using "Vibe Coding" to Create a Programming Process Visualizer from IDE Activity Logs
  • Student Math Competence Clustering — Archetypes or ability? Clustering for modelling student mathematical competence
  • LLM Student Misconception Identification — What Don't You Understand? Using Large Language Models to Identify and Characterize Student Misconceptions About Challenging Topics

    • Citation

    Yongkyung Oh, Lynn Talton, Alex Bui (2026). Engagement Intensity as a Learner-Modeling Signal for Adaptive AI Ethics Instruction. arXiv:2606.18548.