Distinguish the purposes and scales of coexisting feedback sources in educational gig platforms¶

Strategy · All strategies
Evidence · no claims cited

Description¶

The article's first design consideration holds that when multiple feedback sources coexist where learner feedback carries strong evaluative weight, systems should "distinguish their purposes and scales". In the Ringle study, presenting both sources with similar 5-point scoring schemes created "a false impression of equivalent evaluations" and confusion. Explicitly clarifying what each feedback measures and how to interpret scores helps tutors make sense of multisource feedback.

Design Implications¶

Context¶

Requirements¶

• Feedback systems must clarify what each feedback source measures and how to interpret its scores.

Constraints¶

• Applies to settings where learner feedback carries strong evaluative weight and multiple feedback sources coexist.

Target Learners¶

• Newly onboarded online language tutors on gig platforms

Target Learning Goals¶

• Tutor understanding of performance standards and interpretation of multisource feedback

Related Strategies¶

• Frame learner and automated feedback as complementary rather than conflicting
• Make platform quality standards interpretable by pairing automated scores with rationales and contextual cues

Examples¶

-

Key Sources¶

• Yeon Su Park, Sieun Kim, Keighley Overbay, Seoyoung Kim, Sewook Wee, Daho Jung and Juho Kim. (2026). Supporting Tutors in the Gig Economy with Automated Feedback: A Case Study on Ringle. The 2026 Workshop on Pedagogical Evaluation of Automated Feedback (PEAF2026). https://osf.io/zsc3b/overview?view_only=dcf09d1a9fe64765b013df02af6bc382