Some students found the automated star ratings inconsistent, receiving different scores for the same unchanged submission¶
Claim · All claims
Evidence · 1 study · qualitativer3·q2
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person · recheck by 2028: tool and model accuracy changes quickly
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? Students at School D reported receiving very different ratings when resubmitting an unchanged paper. → Raigul Zheldibayeva 2025
Evidence¶
Raigul Zheldibayeva 2025¶
Raigul Zheldibayeva, Ana Karina de Oliveira Nascimento, Vania Castro, Bill Cope and Mary Kalantzis. (2025). Generative AI Feedback, English Writing and Teacher Rubrics: A Multiple-Case Study of CyberScholar. https://arxiv.org/abs/2605.17055 doi:10.48550/arxiv.2605.17055
q2 · i? · qualitative · r3
Student post-survey response from School D in the qualitative case study; the student reported that resubmitting "the same paper twice" produced "two very different rankings," undermining certainty about the deserved score.
"I did not like that when I put in the same paper twice, it gave me two very different rankings. It made me unsure of what score my paper should have ac tually gotten and made things more difficult."
Discussion¶
Related Claims¶
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
inconsistent-automated-ratings-same-submission |
title |
Some students found the automated star ratings inconsistent, receiving different scores for the same unchanged submission |
description |
Some students found the automated star ratings inconsistent, receiving different scores for the same unchanged submission |
status |
review |
evidence_strength |
weak |
newest_evidence |
2025 |
recheck_by |
2028 |
generated |
by process:wiki-ingest on 2026-10-10 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — raigul-zheldibayeva-2025 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.