Design-Based Research

Design-based research (DBR) — a methodological approach that iteratively designs, implements, and refines an educational intervention in authentic contexts, cycling between theory, design, and real-world practice to produce both a usable artifact and validated design principles. In AI in education, DBR is the method of choice for developing AI learning environments, pedagogical models, and teacher-training programs that must work in the messy reality of classrooms — trading the causal control of experiments for ecological authenticity and iterative refinement.

DBR is a design tradition, not a data tradition: it does not fit neatly into the quantitative/qualitative/experimental contrast. It deliberately combines elements of all three — collecting both outcome and process data across iterative cycles — to answer "how do we design this AI learning environment to work in practice?" rather than "does X cause Y?". It is closely related to Instructional Design (which specifies the design process) and to usability evaluation (which feeds refinement), but is distinguished by its sustained, theory-driven, multi-cycle character and its dual goal of improving practice and generating theory.

The DBR cycle

DBR is not a single design but an iterative loop, typically comprising:

1. Needs analysis — understanding the problem, context, and learners in authentic settings.
2. Design — articulating an intervention and its underlying theoretical rationale.
3. Implementation — deploying the intervention in a real classroom or program.
4. Refinement — analyzing data, revising the design, and iterating (often over multiple cycles).
5. Theory and artifact output — producing both a usable intervention and generalizable design principles or a validated model.

The canonical AIEd example is the AI-Assisted Collaborative Learning (AACL) Model study, which ran a four-phase DBR cycle — needs analysis, model design, an eight-week classroom implementation with Indonesian undergraduates, and model refinement — iterating on a four-stage learning cycle (problem identification → AI-assisted collaborative inquiry → collaborative problem-solving → reflection and presentation).

How DBR appears in the wiki

• Developing learning models. The AACL Model study uses DBR to develop and evaluate an AI-assisted collaborative learning model targeting critical thinking and problem-solving in higher education.
• Building AI-literacy teacher training. Le et al. develop and evaluate a DBR GenAI-literacy training intervention for Teacher Education students; Baran et al. use DBR across 2023–2025 to design professional learning for critical AI literacy grounded in Human-Centered AI principles.
• Designing institutional standards. Crompton et al. use DBR across two iterative macro cycles and 114 participants to develop six faculty technology-integration standards.
• Iterative system implementation. Rienties et al. describe six iterative DBR studies (18 months, 498 participants) implementing the Open University's AIDA AI assistant using an embedded-systems approach.
• Scaffolding and intervention design. GenAI critical-thinking scaffolding and other intervention-development studies use DBR to design and refine AI-based scaffolds.

Strengths and limitations

• Strengths: high ecological validity and practical relevance; produces both usable artifacts and theory; responsive to the complexity of real classrooms and evolving AI tools; well-suited to developing a model and refining it based on authentic implementation evidence; captures how an intervention actually works (or fails) in practice.
• Limitations: weak internal validity (few/no control groups); findings are context-bound and hard to generalize; long timelines; difficult to isolate which design element caused an outcome — DBR demonstrates feasibility and improvement but cannot attribute learning gains to a specific mechanism.

DBR trades the causal control of experiments for ecological authenticity and iterative refinement: its evidence is strongest as proof-of-concept and design guidance rather than causal efficacy. Reading DBR learning gains requires the same caution as other designs — without an unassisted, controlled outcome measure, gains can reflect the same AI-inflated-performance confound documented under learning gains.

Relationship to other methods

DBR is complementary to, not a rival of, other research methods (see Research Methods AIED for the full landscape). Where experiments establish causality and surveys establish breadth, DBR establishes feasibility and design knowledge — whether an intervention can be built to work in authentic practice and what design principles support it. It frequently pairs with usability evaluation (to refine the interface) and qualitative methods (to understand how learners experience the intervention). A mature DBR program typically culminates in an efficacy trial or measurement study that tests the developed intervention's causal effects at scale.

Connected Concepts

• Research Methods AIED
• RCT
• Quantitative Research
• Qualitative Research
• Mixed Methods Research
• Usability Research
• Instructional Design
• Educational Measurement
• Learning Gains
• Limitations In AIED Research
• Theory Development AIED

Connected Articles

• AI Assisted Collaborative Learning Model Dbr — DBR for an AI-Assisted Collaborative Learning Model
• GenAI Literacy Training Teacher Education Dbr 2026 — DBR for AI-literacy training in teacher education
• Crompton Faculty Technology Integration Standards 2026 — DBR for faculty technology-integration standards
• Human Centered AI Teacher Educators 2026 — Human-centered AI for teacher educators (DBR)
• New Systems Of Learning For Distance Learning Institutions A Six Study Review Of — Six DBR studies implementing AIDA at the Open University
• Critical Thinking GenAI Scaffolding — DBR for GenAI critical-thinking scaffolding