On this page

These should be treated as design requirements and evaluation outcomes from the beginning — not as limitations added to the discussion section after an efficacy study is complete.

Equity

For equity, examine not only who has access to AI but also who has the skills to use it effectively and who ultimately receives its benefits. The knowledge base's Digital Divide concept distinguishes access, skills, and outcome divides, which means equal access to a chatbot is not equivalent to equitable educational benefit. Researchers should therefore report relevant subgroup outcomes and investigate differential effectiveness rather than relying only on overall averages (see Differential Effects Across Learner Groups).

Newly added research shows how structural inequities accumulate. A comparative study of 45 Nigerian universities (15 federal, 15 state, 15 private) found only moderate AI integration (M = 4.79 on a 10-point scale, range 1.83–7.83), and AI Governance type did not predict it (F(2,42) = 1.01, p = 0.372); institution age (β = 0.43, p = 0.016) and South-West location (β = 0.31, p = 0.029) did. Internal capabilities were mutually reinforcing (r = 0.79–0.80), and international collaborations and industry partnerships compounded one another (r = 0.74)—"connections beget connections." Policy frameworks were the weakest dimension (M = 4.09; only 27% of institutions scored 6 or higher), exposing a gap between formal strategy and operational curriculum activity. Equity interventions should therefore target newer institutions and underserved regions rather than assume that institutional category determines capacity, and should account for the Global South contexts from which much of the evidence base is still missing.

Accessibility

For accessibility, include learners with disabilities in design and evaluation, test actual interfaces against accessibility requirements, provide equivalent ways of participating and demonstrating learning, and distinguish technical accessibility from genuinely inclusive pedagogy. See Accessibility. A value-sensitive design study with community college students, instructors, and developers shows what this looks like in practice: it produced 16 value-aligned features spanning explainability (E1–E5), human-in-the-loop control (H1–H9), and Privacy (P1–P4)—and surfaced value tensions rather than tidy solutions, including transparency versus interpretability, privacy versus instructional insight, and learner Learner Agency versus system-guided Scaffolding.

Privacy and ethics

For privacy and ethics, collect only data needed for the educational purpose, make data use and system limitations transparent, maintain meaningful human accountability, and examine fairness, consent, bias, explainability, learner autonomy, and the consequences of AI-mediated decisions. These are core dimensions of Ethics. The design study above shows these are trade-offs to be managed, not independent requirements to be checked off: students wanted control over learning analytics and affective data while instructors wanted visibility to support learning. As systems gain Learner Agency of their own, the governance question sharpens. A critical review of agentic AI governance argues that autonomy should not exceed the maturity of the evidence or the strength of accountable human control, and proposes a shared reporting language—autonomy levels A0–A4, oversight levels O0–O4, and evidence-maturity stages M0–M5—so that consequential uses (A4: admissions, grading, progression) require replicated, context-relevant validation and continuous human authority rather than a high benchmark score.

Pedagogical safety

For pedagogical safety, measure harms that conventional AI benchmarks miss: overreliance, answer over-disclosure, misconception reinforcement, loss of agency, suppression of Metacognition, inequitable treatment, motivational harm, and instructional misalignment. Safety testing should include realistic multi-turn interactions and discipline-specific scenarios rather than only single prompts. The Pedagogical Safety synthesis and the SafeTutors benchmark show why technically "helpful" or accurate systems can still undermine learning. Practitioners converge on a compatible design answer: in a participatory design study with six secondary teachers, teachers independently designed "bounded experts" rather than autonomous agents—systems with a narrowly scoped domain operating under human supervision, with domain boundaries, content filtering, and teacher override forming three protective layers. They welcomed AI for presenting content, supplying practice, and giving formative Feedback, but refused to delegate objective-setting or summative assessment, framing oversight as professional responsibility rather than distrust of the technology.

Methodological triangulation

Finally, combine quantitative and qualitative evidence. Disaggregated quantitative outcomes can reveal differential effects; interviews, observations, focus groups, and participatory or co-design methods can surface barriers, harms, cultural assumptions, and learner experiences that aggregate scores miss. The Research Methods in AIED synthesis explicitly treats methodological triangulation as important because no single method simultaneously maximizes causal inference, ecological validity, contextual understanding, and generalizability.

Transparency about how AI-assisted analysis itself produced its findings is part of that obligation. The warrantability proposal argues that an AI-assisted interpretation should remain inspectable, contestable, and revisable, supported by artifacts such as source-linked topic tables, lens stacks, and evidence rivers—so that a fluent summary cannot conceal the analytical pathway that produced it. The agentic-AI review adds a discipline of separating outcome levels: artifact outcomes (accuracy, feedback quality) can be necessary for a learner benefit but are never sufficient evidence of one, and equity and institutional outcomes are precisely where the evidence is thinnest.

Where this fits in the knowledge base

These requirements connect directly to the flagship Top 10 Findings for Instructors (findings 9 and 10), to the stakeholder refutations in Addressing Common Misconceptions About AI in Education?, and to the unmet-evidence agenda in Research Gaps in AIED. For methods that take these constraints seriously, see Evaluating AI Interventions: Methods.

Connected FAQs

Embed this page

Copy the code below to embed this page in a learning management system or other website. The embedded version shows only the page content — it hides the site header, navigation, and footer.