🧠 AI Ed Wiki

📄 Research Article

Guidelines for Designing AI Technologies to Support Adult Learning

● high · 2026-08-06adult-learning, design-guidelines, andragogy, ai-education, human-computer-interaction, educational-technology, higher-ed, professional-training, heuristic-evaluation, rag

Synthesis: Drawing on longitudinal deployment data from the National AI Institute for Adult Learning and Online Education (AI-ALOE), this DIS 2026 paper synthesizes 19 empirically grounded design guidelines for AI-powered adult learning technologies. The guidelines span cognitive, social, and teaching presence dimensions and are derived from reflexive thematic analysis of ~1,600 stakeholder statements across seven deployed systems. The work also provides a heuristic evaluation method and an interactive guideline exploration tool.

Context and Motivation

AI-powered educational technologies have demonstrated benefits but are predominantly designed and evaluated in K-12 contexts. Adult learners differ motivationally and contextually: they are often self-directed, goal-oriented (career advancement, reskilling), and must balance education with employment and family responsibilities. Existing systems inherit design patterns from K-12 that are poorly aligned with adult learning constraints.

This paper examines seven AI-powered technologies deployed within AI-ALOE, a US National AI Institute:

  • Apprentice Tutors — web-based ITS for adult math/STEM practice
  • iTELL — Intelligent Texts for Enhanced Lifelong Learning
  • Ivy — interactive video-based AI coaching for procedural skills
  • Jill Watson — RAG-powered Q&A agent for online courses
  • SAMI — social agent for online discussion forums
  • SMART — Student Mental Model Analyzer for Research and Teaching
  • VERA — conceptual modeling tool for guided inquiry

    • Methodology

    Using reflexive thematic analysis, the team analyzed approximately 1,600 stakeholder statements from focus groups with learners and instructors, technical artifacts, and progress reports. Statements were organized through affinity diagramming into sub-themes, needs statements, and finally 19 design guidelines framed as "AI tools should..." Each guideline is labeled by Community of Inquiry dimension (cognitive/social/teaching presence) and most-impacted stakeholder.

    The 19 Design Guidelines

    The guidelines span four categories:

    Cognitive Presence

  • G2: AI tools should be accessible and fit into the busy lives of adult learners (mobile-friendly, offline-capable, affordable)
  • G3: AI tools should be informed by learning science and learning theories
  • G4: AI tools should be easy to understand and frictionless to use

    • Teaching Presence

  • G7: AI tools should support learner motivation and engagement
  • G8: AI tools should align with established instructional best practices
  • G9: AI tools should support diverse pedagogical strategies
  • G11: AI tools should personalize the learning experience
  • G13: AI tools should provide substantive educational support (not just surface-level assistance)
  • G16: AI tools should align with instructors' personal instructional approach
  • G17: AI tools should provide meaningful feedback and explanations

    • Social Presence

  • G18: AI tools should scaffold and support learners in developing their social competencies
  • G19: AI tools should foster social connection and community

    • Cross-Cutting

  • G1: AI tools should be transparent about data practices (collection, storage, access)
  • G6: AI tools should provide scaffolded support that adapts as learners progress
  • G12: AI tools should connect content to real-world problems that matter to adult learners
  • G14: AI tools should support learning engineering through actionable data
  • G15: AI tools should integrate easily with existing educational ecosystems

    • Key Findings

  • Stakeholder priorities diverge: Instructors focused on usability (G4) and instructional alignment (G16); students emphasized educational support (G13) and community-building (G18, G19); researchers prioritized learning theories (G3) and best practices (G8-G10).
  • No single technology satisfied all 19 guidelines — but the broader AI-ALOE ecosystem collectively covered the full set.
  • Personalization (G11) had low satisfaction across systems: most deployed surface-level personalization (adapting examples, knowledge checks) rather than deeper adaptations like task sequencing or difficulty calibration.
  • Data transparency (G1) and social/community features (G18, G19) consistently scored lowest across the heuristic evaluation.

    • Design Implications

    1. Design for adult life constraints — mobile access, offline support, and asynchronous availability are not nice-to-haves; they are prerequisites for adult learners balancing work, family, and education.

    2. Ground AI tools in andragogy, not just pedagogy — adult learners are self-directed, problem-oriented, and bring life experience that shapes how they engage with technology.

    3. Heuristic evaluation using these 19 guidelines provides a structured method for assessing adult learning technologies against empirically grounded criteria.

    4. The guideline exploration tool connects abstract design principles to concrete stakeholder quotes, supporting ideation and technology refinement.

    Connected Concepts

  • Adult Learning
  • AI Education
  • Adult Learning
  • design-guidelines
  • educational-technology
  • Higher Ed
  • human-computer-interaction
  • Professional Training
  • RAG

    • Connected Articles

  • A4l Analytics Pipeline — Generalizing a Highly Configurable Analytics Pipeline to Replicate and Support Educational Research Across Multiple D...
  • Aaai2026 Prompting Literacy K12 — Learning to Use AI for Learning: Teaching Responsible Use of AI Chatbot to K-12 Students Through an AI Literacy Module
  • Academiclaw Student Agent Benchmark — AcademiClaw: When Students Set Challenges for AI Agents
  • Adaptive Pretesting Retention — Do Gains from Generative AI-Enabled Adaptive Pretesting Persist? Evidence from a Retention Study
  • Affective Text Wearable Student Health — A Formative Study of Brief Affective Text as a Complement to Wearable Sensing for Longitudinal Student Health Monitoring
  • Agency Gap AI Writing — The agency gap in AI-supported writing: how reactive and proactive agent designs shape multimodal reasoning
  • Agentic AI Education Scoping Review — Agentic AI in Education: A Scoping Review of Research Landscape, Capabilities, and the Frontier Agent Paradigm
  • Agentic Education Coding — Agentic Education with AI Coding Assistants
  • Agentic Literacy Debt — Agentic Literacy Debt: A Structural Problem the AI Literacy Field Has Not Yet Named
  • Agentic Workflows Education — Agentic Workflows in Education
  • Agents That Teach Incidental Learning — Agents That Teach: Designing Incidental Learning Back into AI-Assisted Software Development
  • AI Agents Constructive Conflict Design Education 2026 — Enacting Constructive Conflicts with AI Agents to Enhance Reconsideration among Novice Interaction Designers
  • AI Assessment Scale Reform — A bit of chaos and madness": The AI Assessment Scale and the work of assessment reform
  • AI Assistance Discretionary Feedback — AI Assistance for Discretionary Work: Increasing Feedback Provision in Higher Education
  • AI Assisted Se Curriculum Syllabus Analysis 2026 — Mapping the Emerging Curriculum for AI-Assisted Software Engineering via Syllabus Analysis
  • AI Assisted Writing Research Teams — Smaller, Younger, and More Impactful: How AI-Assisted Writing Transforms Research Teams
  • AI Availability Student Motivation — Why Put in This Much Effort?": How AI Availability Shapes Students’ Motivation in Introductory Programming
  • AI Campus Wellbeing Tools — AI-Driven Tools for Enhancing Campus Well-being: Prevention and Intervention
  • AI Changing Teaching Workflows — How AI Is Changing Teaching Workflows
  • AI Coaching RL Skill Development — AI Coaching for Accelerating Human Skill Development with Reinforcement Learning
  • AI Enabled Serious Games — AI-Enabled Serious Games: Integrating Intelligence and Adaptivity in Training Systems
  • AI Engineering Education Balancing Act — Using AI in engineering education: a balancing act, driven by clear purpose
  • AI Ethics Education Public Discourse — A Longitudinal Analysis of Public Discourse on AI Ethics in Education Using Twitter Data
  • AI Fatigue Academic Contexts — Defining AI Fatigue in Academic Contexts: Dimensions, Indicators, and a Stage-Based Model Using Grounded Theory
  • AI Generated Feedback Higher Ed — Artificial intelligence and feedback in university education: effectiveness and student perceptions

    • Citation

    13-17, V.D.J., Adult, G.F.D.A.T.T.S., Reddig∗, J., Computing, I., Georgia, A., & Morris, W.G. (2026). Guidelines for Designing AI Technologies to Support Adult Learning. Designing Interactive Systems Conference (DIS ’26), June 13–17