Per-exercise analysis accuracy improved from 15 of 27 exercises above 80% to all 27 above 80% in the third version¶
Claim · All claims
Evidence · 1 study · designr2·q2
Currency · newest study 2014 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? In the third version, all 27 exercises were analysed correctly more than 80% of the time, with 16 exercises at 100% accuracy. → Weragama 2014
Evidence¶
Weragama 2014¶
Weragama, D. & Reye, J. (2014). Analysing Student Programs in the PHP Intelligent Tutoring System. Int J Artif Intell Educ 24:162–188. https://doi.org/10.1007/s40593-014-0014-z
q2 · i? · design · r2
Re-analysis of previously incorrectly analysed programs using the third version of the knowledge base. Figure 17 reports per-exercise accuracy; "All 27 exercises were now analysed correctly more than 80 % of the time".
"It can be seen that the analysis accuracy has increased markedly to 96.31 %. All 27 exercises were now analysed correctly more than 80 % of the time and 16 exercises were analysed accurately 100 % of the time."
Discussion¶
Related Claims¶
- The final PHP ITS version correctly analysed 96.31% of student solutions to programming exercises — related
- Two main causes of incorrect analysis were unhandled constructs and string-literal quote inconsistencies — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
php-its-per-exercise-accuracy-improvement |
title |
Per-exercise analysis accuracy improved from 15 of 27 exercises above 80% to all 27 above 80% in the third version |
description |
Per-exercise analysis accuracy improved from 15 of 27 exercises above 80% to all 27 above 80% in the third version |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2014 |
generated |
by process:wiki-ingest on 2026-10-28 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — weragama-2014 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.