Draft usefulness varies by grading context: higher for submissions with mistakes and applied questions¶
Claim · All claims
Evidence · 1 study · causalr2·q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? Drafts received higher ratings on submissions with mistakes (3.51 vs. 2.85) and were used more on applied questions (64.46% vs. 45.34%). → Mahinpei 2026
Evidence¶
Mahinpei 2026¶
Mahinpei, R., Dean, V., Fong, R., Liu, L. T., & Ribeiro, M. H. (2026). AI Assistance for Discretionary Work: Increasing Feedback Provision in Higher Education. arXiv. https://arxiv.org/abs/2606.03095 doi:10.48550/arxiv.2606.03095
q2 · i? · causal · r2
Descriptive subgroup analysis of treatment-only outcomes (Table 4) by mistake presence, question type, and TA role. GTAs used drafts more (82.00%) but rated them lower (2.79) than UTAs (40.58%, 3.25), suggesting perceptions vary by grader experience and context.
"the drafts receive higher usefulness ratings (3.51 vs. 2.85) on submissions with mistakes, suggesting that TAs find them more useful when feedback is clearly warranted. Similarly, the drafts are used more frequently (64.46% vs. 45.34%)"
Discussion¶
Related Claims¶
- AI-assisted feedback does not reduce student-perceived usefulness of rated feedback — related
- AI-assisted feedback drafts increase discretionary feedback provision by TAs by 10.81 percentage points — related
- AI-assisted feedback drafts increase total feedback length by 39.79 characters per submission — related
- AI-assisted feedback drafts do not reduce TAs' time spent per character of feedback — related
- Learners report more positive attitudes toward externally regulated prompts than self-regulated prompts — related
- TAs adapt rather than copy AI feedback drafts, with moderate draft–final overlap (ROUGE-L F1 = 0.60) — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
draft-usefulness-varies-by-grading-context |
title |
Draft usefulness varies by grading context: higher for submissions with mistakes and applied questions |
description |
Draft usefulness varies by grading context: higher for submissions with mistakes and applied questions |
status |
review |
evidence_strength |
weak |
newest_evidence |
2026 |
generated |
by process:wiki-ingest on 2026-10-10 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — mahinpei-2026 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.