Research Article
Research on the optimization of the training system of university faculty development centers in the context of GenAI: a comparative analysis based on Chinese and Kazakhstani universities
Synthesis: A mixed-methods field study compared GenAI pedagogical readiness among faculty at three Chinese and two Kazakhstani universities, then tested whether a structured prompt-task training cycle outperformed conventional GenAI workshops in a quasi-experimental subsample. Kazakhstani faculty reported higher baseline readiness on all seven dimensions, but that country advantage shrank to nothing once GenAI exposure, recent AI training, institutional support, perceived permission, multilingual resource access, policy clarity, and risk sensitivity were taken into account. The structured group improved far more than the conventional group, especially in prompt design and critical judgment, and only the structured group's prompt-design gains held up at delayed testing. The authors frame faculty development for GenAI as course-level professional learning embedded in real course artifacts rather than tool familiarisation.
Key Findings
- Country differences at baseline favored Kazakhstan on every dimension. Kazakhstani faculty scored higher than their Chinese counterparts across all seven readiness dimensions, with the widest gaps in disciplinary transfer, prompt design, and basic understanding, and the narrowest in ethics and critical judgment.
- Institutional conditions, not nationality, explained the baseline gap. In a hierarchical regression the Kazakhstan coefficient was clearly significant on its own but fell away to non-significance — a reduction of about four fifths — once prior GenAI use, recent AI training, institutional support, perceived permission, multilingual resource access, policy clarity, and risk sensitivity were entered. Institutional support and perceived permission carried the most positive weight, and risk sensitivity was the one predictor that worked against readiness.
- Exposure and permission differed sharply by country. More than twice as many Kazakhstani faculty as Chinese faculty reported AI-related training in the previous six months, and Kazakhstani faculty also reported stronger perceived permission to experiment and better multilingual resource access. Chinese faculty reported greater policy clarity, higher risk sensitivity, and a stronger sense of lacking training.
- Structured prompt-task training outperformed conventional GenAI faculty development. At post-test the structured group scored higher on all seven dimensions, with the largest advantage in prompt design — an effect of roughly two standard deviations — followed by critical judgment, basic understanding, and disciplinary transfer.
- Gains were retained at delayed testing only in the structured condition. In the structured group prompt design rose sharply from baseline and stayed near that level at delayed testing, whereas the conventional group's gain was small and had fallen back below baseline by the follow-up.
- Prompt logs exposed differentiated support needs. Coding of more than a thousand prompt–theme co-occurrences showed technical and practical prompts dominating, with exploratory, structured, and narrative prompts trailing behind. Nearly half of the structured-group faculty were efficient collaborators, about a quarter over-revisers, and a fifth mixed users; dependent and exploratory users were rare.
- Satisfaction was high on intention but low on usability. Continued-use intention was the highest-rated satisfaction dimension and tool usability the lowest, which points to platform friction rather than a lack of motivation.
Study Design & Method
The study used a mixed-methods field design with three linked components. The baseline survey collected GenAI pedagogical readiness scores and background data from 568 faculty members at five participating universities (three in China, two in Kazakhstan), recruited through faculty development offices and departmental coordinators. The readiness scale measured seven dimensions — basic GenAI understanding, prompt design, AI-supported instructional design, AI-supported assessment, critical judgment, educational ethics, and disciplinary transfer — each with four items on a 1–5 agreement scale, with dimension scores computed as item means. Chinese, English, Kazakh, and Russian versions were prepared through translation, back-translation, and reconciliation, and multi-group confirmatory factor analysis supported comparing observed means across the two country samples.
The quasi-experimental training component drew 160 faculty from the baseline sample, assigning 80 to structured GenAI prompt-task training and 80 to conventional GenAI-focused faculty development through institutional scheduling and voluntary sign-up rather than randomization; the two groups were equivalent at baseline on country composition, gender, age, teaching experience, prior GenAI use, institutional support, perceived permission, risk sensitivity, and all seven baseline readiness dimensions. Both conditions received four 90-min onsite workshops over four consecutive weeks using DeepSeek-R1, with identical contact time, environment, facilitator support, and base materials. The structured condition followed a prompt formulation → generated-output review → course-material revision → written reflection cycle, using a seven-component prompt template (course objective, student level, task constraints, assessment criteria, faculty verification, student disclosure, risk control) and yielding prompt records, revised teaching artifacts, and reflections. Analysis combined group comparisons and effect sizes for the baseline and post-test questions, hierarchical regression for the predictors of readiness, and a linear mixed-effects model for the T0–T1–T2 trajectory, with rule-based thematic coding of prompt logs for the qualitative component.
Implications
- Faculty development centers should treat GenAI readiness as course-embedded work: asking faculty to bring their own objectives, rubrics, and materials into a structured prompt-task cycle produces larger and more durable gains than function-orientation workshops.
- Because the country effect was absorbed by exposure, recent training, resource access, perceived permission, and institutional support, interventions that increase hands-on practice and clarify what experimentation is allowed may matter more than national policy framing alone.
- Prompt design functions as course-level teaching-task design rather than a detached technical skill; objectives, constraints, assessment criteria, verification, disclosure, and risk control jointly define whether a GenAI-mediated task is executable, assessable, revisable, and accountable.
- Prompt logs and use profiles can triage support: efficient collaborators can take on more complex course tasks, over-revisers need criteria for when an artifact is finished, mixed users need workflow stabilisation, dependent users need verification routines, and exploratory users need help converting ideas into assessable classroom steps.
- Low tool-usability ratings alongside high continued-use intention suggest that platform friction, not motivation, is a tractable target for centers planning GenAI provision.
Limitations
- The study relies primarily on a self-report readiness scale; concept interpretation and response styles across language backgrounds may have affected evidence for concepts such as AI literacy, ethical reasoning, prompt design, and disciplinary transfer.
- Group assignment in the training component reflected voluntary sign-up, institutional scheduling, and course arrangements, so results are best interpreted as associations between structured training and readiness change rather than strict causal estimates.
- Five universities cannot cover the full range of university types and disciplinary contexts in China and Kazakhstan, limiting generalisability.
- University-level sensitivity checks were treated as descriptive rather than confirmatory, and country fixed effects could not be estimated because universities were nested within country.
- The study measured self-reported readiness, not enacted teaching practice or student learning outcomes; future work needs course materials, classroom observation, and outcome data.
Connected Concepts
- Workplace Learning — positioned as course-level professional learning for faculty, in the Guskey/Desimone tradition
- Teacher AI Competency — the seven-dimension GenAI pedagogical readiness construct at the center of the study
- Prompt Engineering — structured prompt-task training is the intervention and the construct with the largest and most durable gains
- Educational Development — situates faculty development center practice in higher education development research
- Technological Pedagogical Content Knowledge (TPACK) — readiness dimensions are derived from TPACK, DigCompEdu, and AI literacy frameworks
- Stakeholders — institutional support, perceived permission, and policy clarity shaped practice
- Transfer of Learning — disciplinary transfer was the weakest baseline dimension
- Multilingual Learning — multilingual GenAI resource access predicted readiness and shaped prompt language use
Connected Articles
- Assessing faculty self-perceived knowledge in using generative AI to teach 21st-century skills — cross-institutional faculty preparation and resources for GenAI, a direct parallel on faculty readiness
- Faculty Readiness for AI-Supported Teaching and Scalable Online Program Delivery in Higher Education: The EPIQ-AI Framework for Epistemic Integrity — instrument development for faculty AI readiness, the same measurement problem
- Designing effective AI professional development: A framework grounded in intelligent-TPACK — designing AI professional development around integrated teacher knowledge
- Designing faculty standards for technology integration in higher education institutions: a design-based research study — faculty technology integration standards behind center-level training design
- From Proficiency to Pedagogy: A Mixed-Methods Study of In-Service Teachers' TPACK-GenAI and the Mediating Role of Pedagogical Knowledge — TPACK mediation of GenAI use among in-service teachers
- An Activity-Theoretical Approach to Teacher Professional Development in Pedagogical AI Agent Design — teacher professional development design for AI, comparable PD intervention logic
- The AI Adaptation Gap in Higher Education: Students, Faculty, and Administrative Staff — institutional conditions mediating AI adoption in higher education
- Governing generative AI in higher education: a global Delphi study on policy and practice — institutional governance and policy clarity in GenAI adoption
Citation
Bi, T., Araily, S., Lyu, A., & Xiu, S. (2026). Research on the optimization of the training system of university faculty development centers in the context of GenAI: a comparative analysis based on Chinese and Kazakhstani universities. Frontiers in Psychology, 17, 1890508.