π Full text: arXiv:2508.15111 Β· local Β· Liverpool Repository Β· local
AI literacy β the knowledge and skills needed to understand, evaluate, and effectively use AI technologies β is increasingly recognized as a core competency. Collaborative learning approaches show consistent effectiveness across activities, settings, and learner groups, and the ICAP framework helps explain why.^hingle-collaborative-ai-literacy-2025
The ICAP Framework
Chi & Wylie (2014) propose that learning activities can be ordered by depth of cognitive engagement:
| Mode | Student behavior | AI literacy example |
|---|---|---|
| Passive | Receiving information | Watching a video about how LLMs work |
| Active | Manipulating information | Running prompt experiments, observing outputs |
| Constructive | Generating new ideas | Designing a prompt engineering task for peers |
| Interactive | Co-constructing with others | Debating AI ethics in a group, building a shared policy |
Hingle & Johri's systematic review (9 studies, 2015β2023) found that collaborative learning activities for AI literacy included all four ICAP modes. This suggests that effective AI literacy programs should span the full engagement spectrum, not just information delivery.
Collaborative Learning for AI Literacy
Settings and Participants
- Most studies: traditional classroom settings
- Some broadened participation via:
Key Insight
Collaborative learning was effective across diverse contexts, but the mechanism was not uniform collaboration per se β it was the ICAP depth of the collaborative activity. Interactive (co-constructive) activities produced stronger literacy outcomes than Active or Passive ones.Relationship to AI-in-Ed Research
| AI literacy application | Wiki connection |
|---|---|
| Understanding how tutoring AI works | tutoring-specific-vs-general-ai β students should know whether they're interacting with a general LLM or pedagogically optimized system |
| Evaluating AI feedback quality | ai-peer-feedback-systems, formative-assessment β literacy to assess whether AI-generated feedback is useful |
| Prompt engineering as constructive activity | pedagogical-llm-training β reverse-engineering effective tutoring behavior |
| AI ethics and policy co-construction | faculty-development-genai, authentic-assessment β institutional literacy for governance |
Multimodal AI Literacy Levels (Varga-Atkins et al., 2025)
The Educators' Guide distinguishes three operational levels of multimodal GenAI literacy:
| Level | Capabilities | Example Activities |
|---|---|---|
| Basic | Awareness of multimodal GenAI platforms, capabilities, and appropriate uses | Creating prompts; generating visual outputs; understanding platform limitations |
| Intermediate | Co-create multimodal content; critically evaluate outputs; scaffold uses for peers | Transforming lecture notes into visuals or podcasts; annotating AI-generated essays or images for bias |
| Advanced | Design activities/assessments incorporating multimodal GenAI; lead ethical/philosophical discussions | Redesigning a module to include GenAI co-creation; institutional policy drafting; graduate attribute alignment |
These levels operate across four scales:
- Individual (student workshops, reflective assignments)
- Module (embedded learning outcomes, optional tasks with rubrics)
- Programme (cross-module policies, consistent guidance, alignment with graduate attributes)
- Institutional (clear policies, vetted tools, data privacy protocols)
This framework complements the ICAP engagement hierarchy by adding institutional scaling and multimodal specificity. Where ICAP asks how deeply students engage, the multimodal literacy framework asks at what level and at what scale.
Implications for Curriculum Design
1. Start passive, move to interactive β Begin with conceptual foundations, progress to co-construction 2. Use AI agents as collaborative partners β Not just tools to learn about, but teammates to learn with 3. Embed assessment in co-construction β AI literacy assessment can itself be an interactive activity (e.g., group policy debates) 4. Foster critical evaluation β Students must be able to detect pedagogical harms, bias, and misinformation in AI outputs
Open Questions
1. Does AI literacy transfer across domains (e.g., from chatbot evaluation to algorithmic bias detection)? 2. How does AI literacy interact with SRL β does knowing how AI works change self-regulation strategies? 3. Can affective AI support or undermine AI literacy development?
Related Pages
- trust-reliance-ai-education-2026 β AI literacy moderates trust-to-reliance
- access-not-enough-ai-tutoring-2026 β AI literacy platform engagement RCTs
- beyond-detection-authentic-assessment-ai-2025 β Digital discernment in an AI-mediated world
- critical-genai-use-predictors β Knowledge + critical-thinking disposition predict critical GenAI use
- agency-gap-ai-writing β GLAT literacy predicts independent writing after support removal
- feedback-futures-genai β GenAI feedback-literacy capacities across the special issue
- chatgpt-feedback-engagement-genai β Five GenAI feedback-literacy capacities from student engagement data
- post-covid-ict-career-aspirations β 5 of 8 papers in May 28 scan
- agentic-literacy-debt β 4 of 8 papers in May 28 scan
- llm-sentiment-analysis-education-research β 1 of 8 papers in May 28 scan
- socially-fluent-ai-identity-detection β Humans cannot detect AI teammates above chance; literacy must include identity recognition
- ai-fatigue-academic-contexts β AI fatigue dimensions reveal gaps in current AI literacy interventions
- efficiency-gain-illusion-ai-overreliance β Metacognitive calibration gap: people underestimate AI use, overestimate benefits (2026)
- cognitive-shift-ai-education β 471 students surveyed 2020β2026 show shift from AI preference to human intellige
- contextual-sycophancy-ai-literacy β The Hidden Cost of Contextual Sycophancy: an AI Literacy Intervention in Human-AI Collaboration
- ai-pedagogical-orientation β AI pedagogical orientation drives faculty AI adoption more than institutional factors
- students-llm-usage-critical-thinking β Student initiative dimension maps to AI literacy development
- computational-thinking-ai-agent-creation β AI agent creation as pathway to AI literacy in K-12
- institutional-change-framework-ai β Six-dimension framework for adapting institutional change models in STEM to generative AI
- ai-powered-materials-discovery-ai-literacy β Preparing Students for AI-Powered Materials Discovery: A Wor...
- cost-of-ethics-crisis-cs-ethics-education β Cost-of-Ethics Crisis: Beliefs, Decisions, and Justification...
- critical-thinking-genai-scaffolding β Vendrell & Johnston (2026): eight design principles for scaffolding critical thinking with LLMs in higher education.
- civic-education-ai-lesson-plans β AI-generated lesson plans overwhelmingly produce lower-order thinking; teachers need AI literacy to critically evaluate
- state-policy-teacher-ai β NASBE/CRPE: five state policy recommendations for teacher AI adoption
- ai-higher-ed-bridge-gap β Science editorial: three-pillar AI literacy framework for higher education
- ai-higher-ed-workforce-survey β EDUCAUSE survey: 94% use AI, 54% policy awareness, 56% shadow AI in higher ed
- ai-education-global-capacity β global perspective: human/institutional capacity as AI-in-education bottleneck
- pedagogy-ai-mistakes β deliberately leveraging AI errors to foster higher-order thinking
- multimodal-learning-genai β Multimodal AI literacy levels (basic/intermediate/advanced) and institutional scaling
- tutoring-specific-vs-general-ai β Understanding tool properties as a literacy skill
- faculty-development-genai β Professional AI literacy for educators
- ai-tutor-safety-harms β Recognizing pedagogical harms as a literacy competency
- self-regulated-learning β AI literacy as a regulatory resource
- formative-assessment β Evaluating AI-generated assessment as literacy practice
- agentic-workflows-education β Understanding agent architectures as literacy content
- human-in-the-loop-ai β Human oversight as a literacy-enabling design
- collaborative-ai-tutoring β Collaborative learning with AI partners
- educational-llm-alignment β Alignment awareness as component of AI literacy
- genai-policy-prompting-rct β RCT on teacher prompting instruction
- ai-literacy-assessment-misalignment β Self-report vs performance gap
- k-12-ai-education β K-12 as primary context for AI literacy development
- teacher-ai-competency β AI literacy as core teacher competency
- assessment-validity β Valid assessment of AI literacy
- equity-in-ai-education β Equitable AI literacy for all
- agentic-education-coding β Learning to use AI coding assistants effectively
- teachbench-llm-teaching-evaluation β Teaching ability as advanced AI literacy skill
- multi-agent-instructional-design β Helping K-12 educators use AI tools effectively (60% adoption)
- ai-metacognition-stem-review β Critical finding: AI literacy must be integrated into teacher preparation
- student-rationalization-ai-writing β Taxonomy of 20+ student rationalizations for AI use in academic writing
- awareness-technological-isomorphism β Technological Isomorphism as an AI literacy framework for elementary students
- culturally-aware-aied-community-learning β Culturally-aware AI literacy through community-based learning- genai-declaration-frameworks-higher-education β Declaration frameworks as a form of AI literacy in higher education
- generativism-learning-theory β Generative literacy as a core principle of Generativism
- student-regulatory-awareness-genai β Regulatory awareness as a dimension of AI literacy
- agent-voice-accents-k12-group-learning β Understanding how sociolinguistic design features shape perceptions of AI
- gender-differences-ai-literacy-deepfake -- Single-day AI literacy workshops partially narrow gender STEM gaps; males need targeted deepfake safety education
- ai-engineering-education-balancing-act -- Students attachment to LLM efficiency reflects 'cruel optimism' - benefits depend on critical thinking skills they are still developing
- engagement-intensity-learner-modeling -- Engagement intensity during AI ethics instruction serves as an effective learner...
- computing-students-cybersecurity-attitudes -- Computing students show inconsistencies between confidence in cybersecurity know...
- ai-assisted-learning-modes-eeg β AI-Assisted Learning Modes (EEG Study)
- ai-assessment-scale-reform β AI Assessment Scale (AIAS) Reform
- community-centered-ai-education-adults β Community AI Education for Adults
- dyslexlens-dyslexic-learners-ai β Analyzing dyslexic learners' AI experiences via social media
- automated-presentation-coaching β AI-based presentation coaching systems
- prompt-based-programming-lesson β prompt-based programming teaching intervention
- ai-in-the-wild-college β large-scale analysis of student-GenAI interactions
- llm-reliance-types-undergrad β four types of LLM reliance among undergrad writers
- epistemic-proactivity-math β epistemic proactivity in student-AI math interactions
- concept-catalyst-k12-teacher β scrutable interfaces for K-12 teacher-AI interaction
- genai-literacy-image-discrimination β GenAI literacy training for image discrimination
- dura-llm-cs2 β AI literacy in higher education
- tactile-statistical-graphs-accessibility β AI literacy through accessibility
- data-comics-for-education-evaluating-effectiveness-benefits-ethics β Data Comics for Education: Evaluating Effectiveness, Benefits, and the Ethics of
- mind-the-trust-gap-teacher-student-views-control-agency-k12-classroom-ai β Mind the Trust Gap: Identifying (Mis)alignments in Teacher-Student Views Toward
- constructing-epistemic-ai-literacy-student-ai-co-programming β Constructing Epistemic AI Literacy: Detecting Epistemic Aims and Processes in St
- buggy-genai-code-student-responses β When AI Is Wrong on Purpose: How Students Respond to Buggy GenAI Code
- prompt-problems-nl-programming-mistakes β Understanding Student Perceptions, Mistakes, and Debugging Approaches when Solving Natural Language Programming Tasks
- genai-skill-bypass-literacy β The GenAI Skill Bypass
- gaide-vibe-coding-k12-teachers β GAIDE vibe-coding framework for K-12 teachers
- ai-tools-arab-english-classrooms β AI tools in Arab University English classrooms
- ai-learning-assistants-higher-ed-large-scale β Presents a large-scale descriptive analysis of an AI learning assistant (Syntea) using objβ¦
- youtube-frames-chatgpt-education β Uses epistemic network analysis of multimodal YouTube metadata (transcripts, titles, thumbβ¦
- student-mental-models-genai β Students' mental models of GenAI (2026-07-14)
- ai-literacy-equity-programming-policy β AI literacy as equity problem (2026-07-14)
- genai-policies-higher-ed-computing - student/educator AI literacy underlies policy
- ai-ethics-education-public-discourse - public misconceptions about AI in education
- genai-reliance-types-scale β GenAI-RTS 'Critical Evaluation' facet operationalizes AI literacy in writing
- mllm-scientific-visualization-literacy β benchmarks MLLMs on scientific visualization literacy vs 485 humans
- repeated-ai-writing-feedback-semester β Argues learning to use AI selectively and critically is the key mediator of benefit.
- informal-learning-everyday-human-llm-interaction β Informal Learning Emerges in Everyday Human-LLM Interaction
- genai-usage-design-students-survey β A study of GenAI usage by Design Students: Analysis of Survey Results and Journals of AI practices at the Politecnico di Milano in 2025/2026
- data-annotations-pedagogical-hints β Data Annotations as Pedagogical Hints: From Subjective Labels to Critical Thinki
- trio-ethnography-llm-programming-education β supports framing students as reflective agents in AI use
- ai-generated-slides-student-perception β Student inability to identify AI-generated content
- teacher-ai-adoption-confidence β Teacher AI confidence as adoption mediator
- llm-children-reading-story-generation β AI-generated reading materials for children- digital-literacy-illusion β European secondary students overestimate AI critical awareness
- genai-assessment-governance β ECD framework for teaching AI interaction as assessable competency
- ai-literacy-continuum-higher-education β Liu & Levy (2026)
- ai-generated-traces-novice-programmers β Noviello et al. (2026)
- turtleai-visual-programming-benchmark β Wen et al. (2026)
- guided-llm-scaffolding-statistics β Amanlou et al. (2026)
- ai-fallibility-warning-help-seeking β Nagashima et al. (2026)
- voice-text-prompt-problems-computing-education β Prompting literacy across modalities
- responsible-assessment-ai-era-stanford-2026 β Responsible-assessment report; AI literacy as an underdefined emerging construct
- rail-ed-genai-literacy-teacher-education β RAIL-Ed: an integrative, developmental framework for GenAI literacy in K-12 teacher education
π 107 other pages tagged ai-literacy
- A bit of chaos and madness": The AI Assessment Scale and the work of assessment reform
- It's OK Because...": The Wild West of Student Rationalization of AI Use in Academic Writing
- A Comparative Analysis of Institutional and Course Generative AI Policies within Higher Education: Implications for Instruction in Computing Education
- A Guiding Framework for K-12 Teachers in Creating AI-powered Learning Technologies through Vibe Coding
- A Longitudinal Analysis of Public Discourse on AI Ethics in Education Using Twitter Data
- A New Direction for Students in an AI World: Prosper, Prepare, Protect
- A study of GenAI usage by Design Students: Analysis of Survey Results and Journals of AI practices at the Politecnico di Milano in 2025/2026
- A Tool-Invariant Framework for Teaching and Assessing Computational Methods in the Age of Agentic AI
- Access is Not Enough: Human Support Improves Engagement with AI Tutoring
- Agentic AI in Education: A Scoping Review of Research Landscape, Capabilities, and the Frontier Agent Paradigm
- Agentic Literacy Debt: A Structural Problem the AI Literacy Field Has Not Yet Named
- AI Adoption Among Teachers: Insights on Concerns, Support, Confidence, and Attitudes
- AI in Writing Education
- AI Literacy Assessment: Self-Reported vs Performance Misalignment
- AI literacy-related domains and AI-TPACK readiness among preservice mathematics teachers: A factor-informed structural equation modelling study
- AI Literacy: An Exercise in Power-Knowledge
- AI tools in Arab University English classrooms: Looking back and forward
- AI Tools Scaffolding Metacognition in STEM
- AI-Generated Lesson Plans in Civic Education
- AI-Generated Slides: Are They Good? Can Students Tell?
- Artificial intelligence and feedback in university education: effectiveness and student perceptions
- Artificial Intelligence in Lifelong Learning: Opportunities and Challenges in Adult Education Policy
- ASE-26: A Curriculum for Agentic Software Engineering as a Discipline
- Assessment Validity in AI Education
- Awareness of Technological Isomorphism: AI in Elementary Math
- Benchmarking Multimodal Large Language Models for Scientific Visualization Literacy
- Beyond Tool Adoption: A Practical Five-Stage Developmental Continuum for AI Literacy in Higher Education
- Characterizing Students' LLM Usage Behaviors and Their Association with Learning in Critical Thinking Tasks
- ChatGPT Critical and Creative Thinking: Systematic Review
- Children's English Reading Story Generation via Supervised Fine-Tuning of Compact LLMs with Controllable Difficulty and Safety
- Co-Designing Community-Centered AI Education for Adults: A Midwestern Case Study
- Collaborative AI Literacy Framework
- Comparing Generative AI and teacher feedback: student perceptions of usefulness and trustworthiness
- Computational Thinking Development in AI Agent Creation: A Mixed-Methods Study
- Concept Catalyst: Exploring Scrutable Interfaces to Structure K-12 Teacher Interactions with Generative AI
- Confident yet Concerned: Inconsistencies in Computing Students' Attitudes on Cybersecurity
- Constructing Epistemic AI Literacy: Detecting Epistemic Aims and Processes in Student-AI Co-Programming
- Culturally-Aware AI for Cross-Boundary Community Learning
- Data Annotations as Pedagogical Hints: From Subjective Labels to Critical Thinking
- Data Comics for Education: Evaluating Effectiveness, Benefits, and the Ethics of AI-Assisted Creation
- Defining AI Fatigue in Academic Contexts: Dimensions, Indicators, and a Stage-Based Model Using Grounded Theory
- Design Principles and Observable Indicators for AI-Enabled Pedagogical Accompaniment: Evidence from the Amico Dual-Mode Prototype in Italy and China
- DOT Framework Survey: Practitioner Beliefs and Behaviors in AI-Enhanced Education
- DysLexLens: A Low-Resource LLM Framework for Analysing Dyslexic Learners Insights from Online Forums
- Effects of an AI-supported inquiry model on AI literacy and authentic performance: A quasi-experimental study with preservice teachers
- Engagement Intensity as a Learner-Modeling Signal for Adaptive AI Ethics Instruction
- Evidence of a Cognitive Shift in AI Education: How Students Are Rethinking Human Intelligence?
- Expert Cognition Dashboard: From Learning Analytics to Cognition Intelligence in AI-Driven Education
- Explainable Artificial Intelligence in Education (XAI-ED)
- Faculty Development and GenAI
- Faculty Orientations Shape Adoption of AI in Research and Teaching
- Feedback futures: beyond the limits of human and GenAI capacities
- Fostering machine learning literacy in senior primary education: Evaluating a structured pedagogical course design
- Four Types of LLM Reliance and Their Predictors Among Undergraduate Writers: A Mixed-Methods Study at a Minority-Serving R1 University
- From Prompting to Epistemic Proactivity: Temporal Trajectories of Student-AI Interaction in Mathematics Learning
- Gen-AI-tecture: using generative AI to support architectural students in design tasks
- GenAI Knowledge, Epistemic Orientation, and Intellectual Values Predict Undergraduate Students' Critical GenAI Use
- Gender Differences in AI Literacy Workshop Outcomes and Deepfake Engagement
- Generative AI Literacy Training Improves Intelligence Analystsβ Discrimination of Real and AI-Generated Images
- Higher Education Must Bridge the AI Gap
- How AI Is Changing Teaching Workflows
- How YouTube Frames ChatGPT Use in Education: An Epistemic Network Analysis with Supporting Multimodal Metadata
- Informal Learning Emerges in Everyday Human-LLM Interaction
- Is AI making us stupid?
- K-12 AI Education
- Learning after COVID-19 and the ICT career aspirations: Are students entering the AI era with weaker skills?
- LLM Fallacy Misattribution in Education
- Mind the Trust Gap: Identifying (Mis)alignments in Teacher-Student Views Toward Control and Agency in K-12 Classroom AI
- Modeling AI-TPACK in Practice: Insights from Teachers' Multi-Agent Workflow Design
- Multi-Agent Systems for Instructional Design
- Navigating the moral panic: encouraging appropriate use of GenAI in the classroom rather than condemning innovation as disruption
- Preparing Students for AI-Powered Materials Discovery: A Workflow-Aligned Framework for AI Literacy, Equity, and Scientific Judgment
- Principled AI Education Framework
- Prober.ai: Gated Inquiry-Based Feedback via LLM-Constrained Personas for Argumentative Writing
- Profiling cognitive offloading in LLM-mediated synthesis writing: Volume vs. content
- Programming Language Policy as an AI Literacy Equity Problem: A 15-Nation Comparative Analysis
- PromptDecipher: Supporting AI Tutor Authoring Through Editable Simulated Interactions
- Report on CHIIR 2026 Workshop on Generative AI and Academic Search (GAI&AS)
- Rethinking Generative AI Literacy: An Integrative, Developmental, and Dialectical Framework for K-12 Teacher Education
- Same AI, different pathways: Unpacking mechanisms of AI-mediated learning across discipline-institution contexts
- Say What? Examining Text and Voice Input Modalities for Prompt-Based Programming in Computing Education
- Scaffolding Critical Engagement with GenAI: Transforming Ethnic Minority Preparatory Students' Collaborative Discourse in Prompt Engineering Tasks
- Socially fluent AI decouples conversational signals from source identity in online interaction
- Stanford Evidence Base: AI in K-12 Education
- Structuring Transparency: Developing Domain-Specific Generative AI Declaration Frameworks in Higher Education
- Student Evaluation of Repeated AI Feedback Across a Semester of Writing
- Students' engagement with ChatGPT feedback: implications for student feedback literacy in the context of generative artificial intelligence
- Students' multimodal prompting practices as epistemic work in AI literacy development
- Surfacing Isolated Learners with Outcome-Independent Mediation of Feedback between Teachers and Students Using AI
- Teacher AI Competency
- The agency gap in AI-supported writing: how reactive and proactive agent designs shape multimodal reasoning
- The efficiency-gain illusion: People underestimate the rate of AI use and overestimate its benefits on simple tasks
- The GenAI Skill Bypass: Mapping Divergent Pathways of University Students and Staff AI Literacy
- The Hidden Cost of Contextual Sycophancy: an AI Literacy Intervention in Human-AI Collaboration
- The Illusion of Competence: Self-Perceived Digital Literacy and AI Readiness Among European Secondary Students
- The impact of generative artificial intelligence on academic development of Chinese students in humanities and social sciences
- The Main Barrier to AI Adoption in the Public Sector is Lack of Training
- The Pedagogy of AI Mistakes: Fostering Higher-Order Thinking
- Tracing GenAI Literacy: Student-AI Interaction Patterns in Academic Writing
- Transforming GenAI Policy to Prompting Instruction (RCT)
- Trust and Reliance on AI in Education: AI Literacy and Need for Cognition as Moderators
- Uncovering Students' Mental Models of Generative Artificial Intelligence
- Understanding Student Perceptions, Mistakes, and Debugging Approaches when Solving Natural Language Programming Tasks
- Using AI in engineering education: a balancing act, driven by clear purpose
- What AI in Education Needs Next: Lessons from Youth Leaders Across Five Countries
- When AI Is Wrong on Purpose: How Students Respond to Buggy GenAI Code
- WIP: Bridging the Gap Between Instructional Design and Pedagogical Use: A Framework for Mathematics Educators