Both groups improved significantly on harder-to-guess questions, and the experimental group outperformed the control group on them at post-test¶
Claim · All claims
Evidence · 1 study · causalr?·q3
Currency · newest study 2019 · checked against its sources 2026-10-28 (automated, 1 of 1 entry) · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q3 i? Both groups improved significantly on harder-to-guess questions from pre- to post-test (experimental W = 368, p = .001; control W = 472, p = .003). → Fabic 2019
q3 i? The experimental group outperformed the control group on harder-to-guess questions at post-test (U = 319, p = .016), though neither group improved significantly on easier-to-guess questions. → Fabic 2019
Evidence¶
Fabic 2019¶
Fabic, G. V. F., Mitrovic, A., & Neshatian, K. (2019). Evaluation of Parsons Problems with Menu-Based Self-Explanation Prompts in a Mobile Python Tutor. International Journal of Artificial Intelligence in Education, 29, 507–535. https://doi.org/10.1007/s40593-019-00184-0
q3 · i? · causal · r?
Following Aleven and Koedinger (2002), questions were classified into easier-to-guess (3 marks) and harder-to-guess (5 marks) categories. The printed Cohen's d for normalized gains on easier-to-guess questions was 0.308 (weak positive); for harder-to-guess questions it was −0.263 (weak negative).
"The results in Table 7 show that both groups improved significantly on harder-to-guess questions from pre- to post-test. The experimental group outperformed the control group on the harder-to-guess questions."
Discussion¶
Related Claims¶
- Low prior knowledge students learned more from PyKinetic's Parsons problems than high prior knowledge students, especially in the experimental group with SE prompts — related
- Both experimental and control groups improved significantly on all questions and conceptual questions from pre- to post-test after using PyKinetic — a broader claim this one bears on
- Direct instruction training improved 5th graders' task-model construction (question analysis) relative to an active control — related
- Training improved 5th graders' answer construction and evaluation within the experimental group, but not significantly relative to controls at post-test — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
se-prompts-harder-to-guess-questions |
title |
Both groups improved significantly on harder-to-guess questions, and the experimental group outperformed the control group on them at post-test |
description |
Both groups improved significantly on harder-to-guess questions, and the experimental group outperformed the control group on them at post-test |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2019 |
source_checked |
2026-10-28 |
generated |
by process:wiki-ingest on 2026-10-28 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — fabic-2019 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.