Inter-rater scoring of the writing tests showed good correlation-coefficient reliability¶
Claim · All claims
Evidence · 1 study · causalr1·q2
Currency · newest study 2020 · checked against its sources 2026-11-01 (automated, 1 of 1 entry) · not reviewed by a person · overdue for a recheck since 2023: tool and model accuracy changes quickly
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? Pearson correlations between raters' scores on the pre- and post-tests of both groups indicated good reliability. → Ho 2020
Evidence¶
Ho 2020¶
Ho, P. V. P., Phung, L. T. K., Oanh, T. T. T., & Giao, N. Q. (2020). Should Peer E-Comments Replace Traditional Peer Comments? International Journal of Instruction, 13(1), 295-314. https://doi.org/10.29333/iji.2020.13120a
q2 · i? · causal · r1
Reliability analysis of ratings by two trained inter-raters using an 11-band analytic rubric; the article reports correlations of r=.729, .868, .808, and .840 (all p=.000) for the two groups' pre- and post-tests, and states the scores have good correlation coefficient reliability.
"the correlation coefficient between the experimental group’s post -test scores is r=.840; p=.000. These results indicate that the writing scores have good correlation coefficient reliability."
Discussion¶
Related Claims¶
- Facebook-based peer comment activities significantly improve students' writing quality over a semester — related
- Inter-assessor agreement on OSCE scores is substantial, with a pooled intraclass correlation coefficient of 0.77 — related
- Angoff and Modified Angoff standard-setting show good inter-rater reliability in dental education, with reported coefficients ranging from 0.65 to 0.94 — related
- Trained scorers applied the historical thinking skills rubrics with good overall inter-rater consistency — related
- Three independent expert instructors reached exceptionally high inter-rater reliability when grading 1200 bash exam responses, establishing a reliable human reference standard — related
- Faculty calibration with instructional rubrics yields high inter-rater reliability, rising after repeated calibration — related
- Rubrics enhance grading consistency and inter-rater reliability in dental education assessment — related
- The final indicator system shows good reliability (ICC = 0.86) and content validity (S-CVI = 0.92; I-CVI 0.85–1.00) — related
- In Study 2, inter-rater agreement for rating creative problem solving ideas was good to excellent across indicators — related
- Facebook-based peer comments outperform paper-and-pen peer comments on post-test writing quality — related
- Paper-and-pen peer comment activities significantly improve students' writing quality over a semester — related
Page metadata
| Field | Value |
|---|---|
status |
review |
generated |
by process:wiki-ingest on 2026-11-01 |
trust |
unverified — no one has confirmed this page's content |
Frontmatter is the page's machine-readable record — see the Schema & Guide.