On this page

Synthesis: Park et al. (2026) explore AI-powered automated feedback for tutors on Ringle, a popular online English tutoring platform in the gig economy. Their research probe analyzed tutors' lessons and provided automated feedback, followed by a survey of 36 tutors. Findings reveal that while tutors perceived automated feedback more negatively than learner feedback, they valued it for self-monitoring and understanding platform expectations. However, discrepancies between automated and learner feedback often caused confusion. The study proposes design considerations for feedback systems on educational gig platforms. This work contributes to AI Feedback Quality research by highlighting the social and affective dimensions of AI feedback in tutoring contexts, and connects to Teaching evolution and Intelligent Tutoring system design in Language Learning and Higher Education settings.

What this means for practice

  • Instructors. Treat the automated lesson report as a self-monitoring instrument rather than a final verdict: with learner ratings skewed positive and often missing altogether, the automated scores were the source tutors actually used to track progress, spot weak areas, and gain reassurance about their teaching.
  • Instructors. Expect the automated report to be harsher than learner feedback and read a high star rating as weak evidence — tutors rated automated feedback significantly more negatively than learner feedback on six of seven dimensions, yet the two sources did not differ on feedback uptake.
  • Designers. Label what each feedback source measures and on what scale instead of presenting both as 5-point scores: comparable scales led tutors to treat the two as equivalent evaluations and to distrust the automated one whenever the numbers diverged.
  • Designers. Attach a brief rationale or contextual cue to each score. The probe reported numerical ratings across nine pedagogical categories with no context, and tutors asked for explanations of the discrepancies and judged the automated judgments inconsistent.
  • Instructors. Use the two sources for planning rather than choosing between them: tutors found learner and automated feedback similarly helpful for planning future lessons even while criticizing the automated system's lack of context awareness.

Limitations

  • The survey covered 36 tutors (ages 18–32, M = 23.28, SD = 3.41) newly onboarded to one platform, Ringle, and excluded tutors who had not reviewed all ten learner feedback records and three automated feedback reports.
  • Perceptions were self-reported on a 7-point Likert scale after the first ten lessons, so the study measures what tutors said about the feedback, not whether their teaching changed or lesson quality improved — the authors leave that question to future work.
  • The automated feedback data covered 327 of 360 lessons (33 discarded for recording issues), while the learner-side comparison drew on a different sample of 10,000 randomly sampled lessons by 6,256 learners, so the two sources were never compared on the same lessons.
  • The probe used existing models with few-shot prompting and score thresholds refined with the Ringle team against nine pedagogical categories, tying the findings to one platform's evaluation standards.

Citation

Yeon Su Park, Sieun Kim, Keighley Overbay, Seoyoung Kim, Sewook Wee, Daho Jung, Juho Kim (2026). Supporting Tutors in the Gig Economy with Automated Feedback: A Case Study on Ringle.

Embed this page

Copy the code below to embed a chromeless version of this page in a learning management system or other website. The embedded view hides the site header, navigation, and footer.