Written examination scores were low and confounded, providing a serious warning about students' unaided performance on foundational calculations¶
Claim · All claims
Evidence · 1 study · designr2·q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? The 27 students who took the AI-free written examination received a mean score of 20.6 out of 80, with only two reaching 40 points; the score was confounded by the homework-heavy incentive structure. → M. Mikhasenko 2026
Evidence¶
M. Mikhasenko 2026¶
M. Mikhasenko, M. Stahl, I. Segal, D. Parmar, A. Zimmer, and A. Kazatsky. (2026). AI in Particle Physics Education: Research Problems and Foundational Skills. https://arxiv.org/abs/2609.05719 doi:10.48550/arxiv.2609.05719
q2 · i? · design · r2
Written examination record from the KT1 course: "The 27 students who took the examination received a mean score of 20.6 out of 80, and only two reached 40 points." The article states the incentive structure reduced the marginal effect of maximizing exam score, skewing the mean.
"The 27 stu- dents who took the examination received a mean score of 20.6 out of 80, and only two reached 40 points. Many students left problems unattempted because they knew their homework scores had already secured passing the threshold; this behavior skewed the mean score."
Discussion¶
Related Claims¶
- Most non-STAR studies could not be used in the synthesis because of high risk of bias, chiefly confounding — related
- Confounding may explain the large retention effects reported for the Course Signals early warning system — related
- Propensity score stratification using multilevel models reduces selection bias from confounding variables and improves accuracy of charter school effect estimations — related
- AI access raises immediate unaided test scores by 7.2 percentage points (0.28 SD) after a timed learning phase — related
- Persistence and performance costs concentrate among participants who used the AI to obtain direct solutions, while hint-users resemble controls — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
kt1-exam-low-unaided-performance-warning |
title |
Written examination scores were low and confounded, providing a serious warning about students' unaided performance on foundational calculations |
description |
Written examination scores were low and confounded, providing a serious warning about students' unaided performance on foundational calculations |
status |
review |
evidence_strength |
weak |
newest_evidence |
2026 |
generated |
by process:wiki-ingest on 2026-10-10 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — m-mikhasenko-2026 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.