Think First, ChatGPT Later: Guiding Human–AI Collaboration for Learning Gains in Independent Human Creativity

Synthesis: Wong and Qiu (2026) ask whether ChatGPT's boost to creative performance translates into durable learning, or only inflates assisted output. University students (N = 196) solved a product-improvement task either independently (human-only), using ChatGPT freely (general-AI), or with a guided "think first, ChatGPT later" approach (regulated-AI) in which they first generated their own ideas, then collaborated with ChatGPT to improve, develop, and evaluate them. On the assisted task the general-AI group produced more creative solutions — but this advantage vanished on a later, harder invention task completed without ChatGPT, where their creativity fell back to human-only levels. In striking contrast, the regulated-AI group, despite no immediate gains, outperformed both other groups in independent creativity afterward. Process analyses showed the regulated-AI group used far more collaborative prompts aimed at improving their own initial ideas, and this greater use mediated their later advantage in independent originality.

Performance versus learning

The study foregrounds the distinction between performance (transient, assisted behavior) and learning (durable change that persists when assistance is removed). The authors argue this distinction is often neglected in generative AI research, which tends to measure students' performance on the assisted task rather than their later unassisted transfer. Freely using ChatGPT may raise immediate output while students merely appropriate its responses — outsourcing the thinking rather than developing it — a dynamic consistent with the Over-Reliance and Cognitive Offloading literatures.

The "think first, ChatGPT later" approach

To move students from editing AI output toward co-creating with it, the intervention structured the task into three phases:

Think first (Phase 1): students independently brainstorm and generate their own initial ideas.
Collaborate (Phase 2): students work with ChatGPT as a brainstorming and Feedback partner to improve, develop, and evaluate their own ideas, guided by sample prompts that scaffold metacognitive and creative processes (seeking refinements, elaborating, connecting ideas, identifying weaknesses, comparing, and refining).
Select (Phase 3): students independently refine and submit their single best solution.

This design operationalizes co-creation — the human sets the direction and contributes original ideas while AI amplifies them — rather than either dictating to or merely editing the machine.

Findings

A 3 × 2 mixed ANOVA revealed a striking crossover interaction:

On the assisted product-improvement task, the general-AI group produced more original and useful solutions than both the human-only and regulated-AI groups. The regulated-AI group showed no immediate advantage — consistent with desirable difficulties, where effortful process can temporarily suppress performance.
On the later unassisted product-invention task, the regulated-AI group outperformed both other groups in originality and usefulness. The general-AI group's creativity declined to human-only levels — its benefit was transient performance, not learning.
Elaboration did not confound results: the regulated-AI group's solutions were less elaborate during the intervention, yet more creative afterward.

Process analysis of ChatGPT transcripts explained the mechanism. The regulated-AI group used collaborative prompts for 88.6% of its interactions (mostly "improve own initial ideas" and "develop selected ideas"), whereas 70.9% of the general-AI group's prompts were non-collaborative — most (59.6%) simply asking ChatGPT to generate ideas outright. Greater use of "improve own initial ideas" prompts was the only prompt type significantly correlated with later independent originality, and mediation analysis confirmed it accounted for the regulated-AI group's advantage.

Why free use fails: outsourcing divergent thinking

The general-AI group's pattern reflects a default of "metacognitive laziness": rather than engaging the divergent thinking that underpins original idea generation, students outsourced it wholesale to ChatGPT, investing less mental effort. Generating one's own ideas first forces the divergent phase of creative problem-solving, and then using ChatGPT to improve those ideas exercises self-regulated refinement and evaluation. Notably, simply working alone (the human-only group) did not confer the same benefit — the human-only group declined on the harder invention task — so collaboration with ChatGPT added learning value beyond independent effort, consistent with redefinition effects of AI.

Practical implications

Structure AI use around a "think first, ChatGPT later" sequence to convert assisted performance into durable independent learning and creativity.
Guide interaction, not just access: provide sample prompts that position ChatGPT as a brainstorming and feedback partner rather than an answer provider.
Support metacognition: because students often overestimate how much they "came up with" versus copied from AI, feedback and automated originality scoring can improve metacognitive accuracy.
Design assessments to reach the unassisted moment: the finding aligns with the course-design insight that an AI-resistant environment must make the unsupervised moment productive — the gap measured here is the same one Halani's Reach framework targets.

Relationship to existing research

The findings sit alongside work on Over-Reliance and AI-assisted learning that shows free AI use can erode durable gains, and extend the Human AI Collaboration and co-creation literature with an experimental demonstration that guided collaboration beats both solo and free-AI conditions. It also provides direct experimental evidence for the "performance–learning" gap in generative AI education, and connects to AI literacy frameworks (e.g., ED-AI Lit's collaboration component) as a candidate practice for integration.

Connected Concepts

Connected Articles

Halani Designing For Reach 2026 — Designing for Reach: Seven Levers and the Student Alone with AI
AI Availability Student Motivation — How AI Availability Shapes Students' Motivation
Cognitive Offloading Speedup Illusion — Cognitive Offloading and the Speedup Illusion
Cognitive Offloading LLM Synthesis Writing — Cognitive Offloading in LLM-Assisted Writing
Generative Refusal AI Tools For Thought — Generative Refusal: AI Tools for Thought
Learning By Chatting GenAI Impact — Learning by Chatting? GenAI Impact
Correct Answer Trap AI Tutor — The Correct-Answer Trap in AI Tutoring
Rethinking Scaffolding LLM Tutors — Rethinking Scaffolding in LLM Tutors
Student Cheat Sheets Make Or Take — Make or Take: Student Cheat Sheets
Beyond Detection Authentic Assessment AI 2025 — Beyond Detection: Authentic Assessment

Citation

Wong, S. S. H., & Qiu, S. X. (2026). Think First, ChatGPT Later: Guiding Human–AI Collaboration for Learning Gains in Independent Human Creativity. Educational Psychology Review, 38(45). https://doi.org/10.1007/s10648-026-10118-7