AEEGS and human raters produced nearly equivalent, low mean scores (5.94 vs 5.97 of 20), with AEEGS slightly higher¶
Claim · All claims
Evidence · 1 study · associationalr2·q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person · recheck by 2029: tool and model accuracy changes quickly
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? Mean scores from AEEGS (5.94) and human raters (5.97) out of 20 were almost equivalent and low, with AEEGS awarding slightly higher scores than human expert raters. → Olaoye DD 2026
Evidence¶
Olaoye DD 2026¶
Olaoye DD, Owolabi HO and Olaoye OT (2026). Automated software scoring of senior school certificate examination mathematical items in economics using a contextual similarity model. Front. Educ. 11:1669504. https://doi.org/10.3389/feduc.2026.1669504
q2 · i? · associational · r2
Descriptive comparison of score distributions from the correlational study of 1,008 students' scripts. The article reports the means were "almost equivalent and low when compared to the obtainable marks of 20"; these are descriptive statistics with no significance test reported for the mean difference.
"the mean of AEEGS and Human scores were 5.94 and 5.97, respectively, which is almost equivalent and low when compared to the obtainable marks of 20, with the AEEGS given slightly higher scores than human expert raters."
Discussion¶
Related Claims¶
- AEEGS scores show high absolute agreement with 12 human expert raters' scores on mathematical Economics essay items (average-measures ICC = 0.863) — related
- Each of the 12 human raters' scores correlates significantly with AEEGS scores, with coefficients ranging from 0.604 to 0.864 — related
- AEEGS and human raters produced similarly shaped score distributions, with most students' scores clustered around the mean in the 'good' band — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
aeegs-human-mean-scores-equivalent-low |
title |
AEEGS and human raters produced nearly equivalent, low mean scores (5.94 vs 5.97 of 20), with AEEGS slightly higher |
description |
AEEGS and human raters produced nearly equivalent, low mean scores (5.94 vs 5.97 of 20), with AEEGS slightly higher |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2026 |
recheck_by |
2029 |
generated |
by process:wiki-ingest on 2026-10-10 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — olaoye-dd-2026 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.