Each of the 12 human raters' scores correlates significantly with AEEGS scores, with coefficients ranging from 0.604 to 0.864¶
Claim · All claims
Evidence · 1 study · associationalr1·q2
Currency · newest study 2026 · checked against its sources 2026-10-20 (automated, 1 of 1 entry) · not reviewed by a person · recheck by 2029: tool and model accuracy changes quickly
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? Pearson correlation coefficients between each human rater and AEEGS ranged from 0.604 (Rater 12) to 0.864 (Rater 2), all significant at the 0.01 level. → Olaoye DD 2026
Evidence¶
Olaoye DD 2026¶
Olaoye DD, Owolabi HO and Olaoye OT (2026). Automated software scoring of senior school certificate examination mathematical items in economics using a contextual similarity model. Front. Educ. 11:1669504. https://doi.org/10.3389/feduc.2026.1669504
q2 · i? · associational · r1
Pearson correlation analysis comparing each of the 12 human raters' scores on their 84 scripts with AEEGS scores for the same scripts. The article reports coefficients "range from 0.604 to 0.864", all significant at the 0.01 level (2-tailed).
"Table 5 revealed that the correlation coefficients range from 0.604 to 0.864, which implies that there is a very strong relationship between the scores of all human raters and AEEGS scores."
Discussion¶
Related Claims¶
- AEEGS scores show high absolute agreement with 12 human expert raters' scores on mathematical Economics essay items (average-measures ICC = 0.863) — a broader claim this one bears on
- AEEGS and human raters produced nearly equivalent, low mean scores (5.94 vs 5.97 of 20), with AEEGS slightly higher — related
- AEEGS and human raters produced similarly shaped score distributions, with most students' scores clustered around the mean in the 'good' band — related
- The response-level confidence score correlates positively and significantly with scoring accuracy — related
- The automated scoring system's agreement with human raters varied widely by dimension, with information fidelity showing a weak, non-significant correlation — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
aeegs-pearson-correlations-range-0604-0864 |
title |
Each of the 12 human raters' scores correlates significantly with AEEGS scores, with coefficients ranging from 0.604 to 0.864 |
description |
Each of the 12 human raters' scores correlates significantly with AEEGS scores, with coefficients ranging from 0.604 to 0.864 |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2026 |
source_checked |
2026-10-20 |
recheck_by |
2029 |
generated |
by process:wiki-ingest on 2026-10-10 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — olaoye-dd-2026 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.