AI Ed Wiki logoAI Ed Wiki
Use with AI

🏷️ Concept

Usability Research

● high · created 2026-08-24 · updated 2026-08-24 · usability-research, hci, user-experience, user-study, think-aloud, educational-software-evaluation

Usability research — the empirical study of how users interact with a software system, and of its usability, usefulness, and user experience (UX). Drawn from human–computer interaction (HCI), usability research evaluates whether an AI educational tool is usable, learnable, efficient, and satisfying — the qualities that determine whether learners actually adopt and benefit from it. It is distinct from, but complementary to, qualitative inquiry into learning phenomena and quantitative efficacy: usability research focuses on the interaction between person and system, not on learning outcomes per se.

Usability and UX research answer questions like: Can students figure out how to use this AI tutor? Is the AI tool confusing, frustrating, or error-prone? Does it fit the workflow of teachers or learners? These questions are a prerequisite for — and sometimes the hidden cause of — the learning gains (or lack thereof) measured in efficacy studies. An AI tool that is pedagogically sound but unusable will fail in practice; usability evidence explains why.

Core methods

  • Think-aloud protocols. Users verbalize their thoughts while performing tasks, revealing comprehension, confusion, and mental models in real time. A study of multi-view code visualizations and the LEARN framework use think-aloud to understand how learners make sense of AI-assisted tools; feedback futures examines how learners process AI-generated feedback.
  • User studies. Structured task-based evaluations measure efficiency, error rates, satisfaction, and completion. ProductiveMath evaluates a generative-AI app's usability in supporting productive-failure teaching; SupplyNet runs a user study of a visual exploratory learning tool; LLM chatbots for CS multiple-choice assess interaction quality.
  • Interviews and observation. Qualitative usability interviews and observation capture user experience, preferences, and pain points. A usability study of a storytelling humanoid robot uses structured evaluation to ask whether parents would let the robot interact with a child; AI in design studios observes and interviews students using AI in authentic design work.
  • Systematic usability evaluation. Heuristic evaluation, cognitive walkthrough, and questionnaire-based UX measures (e.g., SUS) systematically assess usability against established criteria.

How usability research appears in the wiki

Relationship to other research families

Usability research shares data-collection methods with qualitative research (interviews, observation, think-aloud) but differs in aim: qualitative research interprets meaning and experience to build understanding and theory, whereas usability research evaluates an artifact against usability/UX criteria. It also overlaps with AI Ed Evaluation (assessing whether a system works) and with measurement (quantifying usability constructs). The wiki treats usability as a distinct but connected methodological strand — relevant to Human AI Collaboration, Student Experience, and the design of effective AI learning tools. See Research Methods AIED for how it fits the broader methods landscape.

Strengths and limitations

  • Strengths: directly identifies usability barriers that block adoption and learning; produces actionable design guidance; complements efficacy and qualitative research by explaining why a tool works or fails in use; relatively fast and cheap compared to large experiments.
  • Limitations: usability findings do not establish learning effects (a usable tool can still fail to teach); small samples and task-specific settings limit generalizability; self-report satisfaction can diverge from objective performance; researcher and task-design dependence.

Connected Concepts

Connected Articles

View SourceView ChangesEdit