The Diagnostic Review class scored higher on diagnostic accuracy, actionability, comprehension, revision quality, and self-assessment accuracy across all three cycles¶
Claim · All claims
Evidence · 1 study · causalr2·q2·i3large
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i3 Diagnostic accuracy means were 0.696, 0.721, and 0.775 in Diagnostic Review versus 0.590, 0.619, and 0.619 in Control, with Hedges' g of 1.35, 1.17, and 1.71 (all p < 0.001). → Yao X-C and Fan L 2026
q2 i3 Actionability and comprehension also favored Diagnostic Review in every cycle, with Hedges' g from 1.04 to 1.74, all p < 0.001. → Yao X-C and Fan L 2026
Evidence¶
Yao X-C and Fan L 2026¶
Yao X-C and Fan L (2026) From automated scoring to learning diagnosis: a mechanism study of AI-supported formative assessment in English writing. Front. Psychol. 17:1905455. https://doi.org/10.3389/fpsyg.2026.1905455
q2 · i3 · causal · r2
Cycle-level Welch t-tests in the quasi-experimental two-class study. Diagnostic Review showed "means of 0.696, 0.721, and 0.775" versus Control means of 0.590, 0.619, and 0.619, with large standardized differences in each cycle.
"Diagnostic accuracy was higher in the Diagnostic Review group across all three cycles, with means of 0.696, 0.721, and 0.775, compared with 0.590, 0.619, and 0.619 in the Control group. Standardized group differences were large in each cycle (Hedges' g = 1.35, 1.17, and 1.71; all p < 0.001)."
Discussion¶
Related Claims¶
- Assessment for learning improves achievement — the general claim this finding bears on, with the studies behind it
- AI-teacher diagnostic agreement was higher in the Diagnostic Review class and varied by issue type, with local language issues best diagnosed — related
- Feedback comprehension showed the strongest bivariate association with revision quality, and indirect associations through actionability and comprehension remained positive after adjustment — related
- Group-by-cycle interactions were significant for diagnostic accuracy, comprehension, revision quality, and self-assessment accuracy, but not for actionability — related
- Diagnostic Review revisions contained larger shares of meaning-change, organization, and content/argument work, while Control revisions remained more dependent on surface-level editing — related
- The Diagnostic Review class gained more writing points across three cycles than the Control class (Hedges' g = 1.12) — related
- Diagnostic Review reflection records contained fewer misunderstanding codes and higher reflection quality than Control follow-up records — related
- Teacher review workload was higher in the Diagnostic Review class in review minutes, added instruction, and review intensity — related
- High-acceptance groups made more effective use of AI feedback during revision, resulting in higher accuracy scores — related
- Evidence elicitation relates positively to diagnostic accuracy and diagnostic efficiency — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
diagnostic-review-higher-process-indicators |
title |
The Diagnostic Review class scored higher on diagnostic accuracy, actionability, comprehension, revision quality, and self-assessment accuracy across all three cycles |
description |
The Diagnostic Review class scored higher on diagnostic accuracy, actionability, comprehension, revision quality, and self-assessment accuracy across all three cycles |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2026 |
generated |
by process:wiki-ingest on 2026-10-10 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — yao-x-c-and-fan-l-2026 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.