Discrepancies between lenient learner feedback and more critical automated feedback caused tutors confusion, distrust, and demands for rationale¶

Claim · All claims
Evidence · 1 study (2 entries) · design r2 · q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person · recheck by 2029: tool and model accuracy changes quickly
Evidence quality · No study behind this claim is a peer-reviewed article with a DOI: it rests on a source with no registered publication record (a web page, book or unpublished report). It is kept because a design page cites it; treat it as a lead to check, not an established finding.

Subclaims¶

Reading the evidence codes

q is the design tier, i the impact, n the sample, and the kind with its r the rigour judged within that kind: what each code means.

This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.

q2 i? Tutors reported confusion over discrepancies between the two feedback sources, particularly because both used comparable 5-point scales, and higher learner ratings often led them to distrust automated feedback. → Yeon Su Park 2026 q2 i? Tutors preferred learner feedback because they felt the automated system could not account for varying lesson dynamics, and wanted clearer explanations justifying discrepancies. → Yeon Su Park 2026 (2)

Evidence¶

Yeon Su Park 2026¶

Yeon Su Park, Sieun Kim, Keighley Overbay, Seoyoung Kim, Sewook Wee, Daho Jung and Juho Kim. (2026). Supporting Tutors in the Gig Economy with Automated Feedback: A Case Study on Ringle. The 2026 Workshop on Pedagogical Evaluation of Automated Feedback (PEAF2026). https://osf.io/zsc3b/overview?view_only=dcf09d1a9fe64765b013df02af6bc382

q2 · i? · design · r2

Thematic analysis of open-ended responses found "confusion over discrepancies between the two feedback sources", with higher learner ratings often leading tutors to distrust automated feedback (P13, P18, P19, P27, P32, P34), consistent with prior findings on preferences for positive feedback.

"Many tutorsreported confusion over discrepancies between the two feedback sources, particularly because both used comparable 5-point scales"

Yeon Su Park 2026 (2)¶

q2 · i? · design · r2

Tutors preferred learner feedback because they felt "the automated system could not account for varying lesson dynamics"; lacking contextual awareness such as learner requests and time constraints, automated feedback was perceived as subjective, and tutors wanted clearer explanations of discrepancies (P3, P18, P33).

"the automated system could not account for varying lesson dynamics"

Discussion¶

AI multimodal feedback is rated higher than educator feedback on specificity, clarity, simplicity, motivation, satisfaction, and lower mental effort, with comparable correctness, trust, and acceptance — the general claim this finding bears on, with the studies behind it
Tutors on Ringle rated automated feedback significantly more negatively than learner feedback across six of seven perception dimensions — related
Learner feedback on Ringle was often missing and positively skewed, while automated feedback was consistently available with a broader, more fine-grained score distribution — related
Trust in customized agents was associated with clear, accurate, and contextually aligned feedback — related

Page metadata

Field	Value
`type`	`claim`
`id`	`feedback-source-discrepancies-cause-confusion`
`title`	`Discrepancies between lenient learner feedback and more critical automated feedback caused tutors confusion, distrust, and demands for rationale`
`description`	`Discrepancies between lenient learner feedback and more critical automated feedback caused tutors confusion, distrust, and demands for rationale`
`status`	`review`
`evidence_strength`	`moderate`
`newest_evidence`	`2026`
`recheck_by`	`2029`
`generated`	by `process:wiki-ingest` on `2026-10-11`
`trust`	unverified — no one has confirmed this page's content
`sources`	2 — `yeon-su-park-2026`, `yeon-su-park-2026-2`

Frontmatter is the page's machine-readable record — see the Schema & Guide.