Agreement Is Not Quality: Blind Expert Verification of Human and LLM Qualitative Coding When Human Consensus Is Not Ground Truth
Alex Liu, Lief Esbenshade, Michael Xiao, Victor Tian, Zachary Zhang, Kevin He, Min Sun โ arXiv preprint (2026). ๐ Full text (arXiv) Synthesis This study challenges the standard practice of evaluating LLM qualitative coding by agreement with human coders, using data from a K-12 AI...
Human-LLM Collaborative Inductive Coding for Conceptualizing K-12 Educator AI Use
Alex Liu, Min Sun, Lief Esbenshade, Michael Xiao, Victor Tian, Zachary Zhang, Kevin He โ arXiv preprint (2026). ๐ Full text (arXiv) Synthesis A multi-phase human-LLM collaborative pipeline adapted open, axial, and selective coding to build a hierarchical codebook from 45,000 mess...
Through the WordStream Glass: Revisiting Quantitative Encoding for Qualitative Learning Analytics
Huyen N. Nguyen, Kathleen Bowe, Minh-Huyen Nguyen, Kit Thompson, Caleb M. Trujillo (2026) โ Institution. ๐ Full text (arXiv) Revisits WordStream (2009) as a quantitative encoding for qualitative learning analytics; demonstrates how structured coding can surface cohort-level trend...