Students perceive AI scoring as accurate for grammar, mechanics, and organization but skeptical of its ability to evaluate diverse styles, complex writing, tone, and emotion¶
Claim · All claims
Evidence · 1 study · associationalr1·q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person · recheck by 2029: tool and model accuracy changes quickly
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? Most participants agreed AI scoring accurately grades grammar and mechanics (73 vs. 20) and organization and clarity (63 vs. 30), but few agreed it fairly evaluates diverse writing styles (27 vs. 66) or accurately assesses complex or creative writing (31 vs. 62). → Yildirim-Erbasli 2026
Evidence¶
Yildirim-Erbasli 2026¶
Yildirim-Erbasli, S. N., Ilgun Dibek, M., Thomas, M. L., & Lesoway, N. (2026). When Do Undergraduate Students Prefer AI? Insights into AI Scoring and Feedback. Behavioral Sciences, 16(7), 1196. https://doi.org/10.3390/bs16071196
q2 · i? · associational · r1
Likert-type perception items in the survey of 93 undergraduates, summarized as aggregated agreement vs. disagreement. Students agreed AI scoring was accurate for grammar and mechanics (73 vs. 20) but disagreed it "fairly evaluates diverse writing styles (Q4; 27 vs. 66)".
"Fewer agreed that scoring is consistent (Q2; 30 vs. 63), fairly evaluates diverse writing styles (Q4; 27 vs. 66), or accurately assesses complex or creative writing (Q7; 31 vs. 62)."
Discussion¶
Related Claims¶
- Limited contextual understanding of pragmatic, cultural, and discourse information is a major technical limitation, reported in 16 of 54 studies (30%) — related
- Students report negative experiences with ChatGPT including inaccurate outputs, lack of emotional connection, and risk of overreliance, which constrain competence — related
- Preferred scoring and feedback methods differ significantly across assignment types, with AI-based scoring rarely preferred and mixed options most chosen for low-stakes assignments
- In Support & Evidence and Claim & Focus, teacher and AES scores agreed at the lowest and highest rubric points but diverged in the middle, with teachers more likely to score a 2 and the AES a 3 — related
- Only perceived accuracy differed across educational contexts, rated lower in CTeSP than in secondary and undergraduate education — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
ai-scoring-perceptions-lower-vs-higher-order |
title |
Students perceive AI scoring as accurate for grammar, mechanics, and organization but skeptical of its ability to evaluate diverse styles, complex writing, tone, and emotion |
description |
Students perceive AI scoring as accurate for grammar, mechanics, and organization but skeptical of its ability to evaluate diverse styles, complex writing, tone, and emotion |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2026 |
recheck_by |
2029 |
generated |
by process:wiki-ingest on 2026-10-12 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — yildirim-erbasli-2026 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.