AI Ed Wiki logoAI Ed Wiki
Use with AI

📄 Research Article

Conversational AI Agents in Education: An Umbrella Review

● high · 2026-08-22 · conversational-ai, chatbot, intelligent-tutoring, generative-ai, ai-literacy, academic-integrity, ethics, umbrella-review, pedagogical-agent, human-ai-interaction

Synthesis: This umbrella review (34 review articles, PRISMA 2020) maps how conversational AI (CAI) agents are used across education — concentrated in teaching, psychological, and metacognitive support while administrative and research functions lag — and documents that human–AI relationship concerns persist across all CAI generations while Academic Integrity and data Privacy emerge as newer ethical issues. It surfaces gaps in CAI frameworks (no end-to-end design guidance, weak CAI-specific usability, unclear classroom implementation) and proposes an ethical-and-responsible-use roadmap grounded in AI Literacy, participatory design, and continuous evaluation.

Key Findings

  1. A synthesis across a fragmented field. The umbrella review systematically integrates 34 prior review articles on conversational AI agents in education across five databases, bridging older rule-based chatbot research with the newer GenAI/LLM literature to form a cohesive state-of-the-art.
  2. Utilization is heavily pedagogical. Teaching and learning support (97.1%), psychological/motivational support (91.2%), and metacognitive and personal development (88.2%) dominate, while administrative support (50%), research and information management (52.9%), and healthcare/medical support (41.2%) remain underexplored — pointing to opportunities beyond instructional contexts.
  3. Technical and cognitive concerns dominate. The most-discussed challenges are technical limitations (97.1%), educational impact and cognitive concerns (91.2%), and interaction/usability challenges (85.3%). As agents shift to GenAI/LLM-based, emphasis moves toward hallucination, bias, privacy, and plagiarism — with accessibility and cultural inclusivity staying secondary.
  4. Human–AI relationship is the persistent ethical thread. Human–AI relationship concerns (over-reliance, social isolation, depersonalization, transparency, accountability) are the most frequently discussed ethical concern across all CAI generations. Academic Integrity is discussed in only 35.3% of articles, signaling it as a comparatively newer concern.
  5. Framework gaps and a roadmap. Reviews lack end-to-end design guidance, CAI-specific usability methods, clear classroom implementation and Teacher Role strategies, and AI-literacy support. The proposed roadmap centers foundational AI literacy assessment, participatory (HCI-grounded) design, ethical-use guidelines, and continuous evaluation of cognitive impact.

Implications

For Intelligent Tutoring and pedagogical agents, this review reinforces the finding that conversational agents are valued for teaching and metacognitive support, and that design must be grounded in HCI and empirical evidence rather than fragmented technical implementation. The persistence of over-reliance concerns as the leading ethical issue connects directly to the wiki's over-reliance and human-AI-collaboration threads, and the call for stronger AI-literacy support aligns with AI Literacy frameworks and Reducing AI Misuse.

The roadmap's emphasis on participatory design, ethical Governance, and continuous cognitive-impact evaluation offers a practical scaffolding for policy and course/module design. The identified gaps — notably weak CAI-specific usability and unclear classroom orchestration — point to design opportunities for tutors, Feedback systems, and teacher-role integration.

Connected Concepts

Connected Articles

Citation

Ganguly, A., Mehjabin, N., Malik, A., & Johri, A. (2025). Conversational AI agents in education: an umbrella review of current utilization, challenges, and future directions for ethical and responsible use. AI and Ethics, 6, 72.