The experimental group spent significantly more time per problem and completed significantly fewer problems than the control group¶
Claim · All claims
Evidence · 1 study · causalr2·q3
Currency · newest study 2019 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q3 i? There was a significant difference (U = 340, p = .035) in average time spent per problem, with the control group faster (mean = 3.22 min, sd = 1.18) than the experimental group (mean = 4 min, sd = 1.52). → Fabic 2019
q3 i? The experimental group completed significantly fewer problems (13.2, sd = 1.9) than the control group (14.4, sd = 1.5) out of fifteen (U = 701.5, p = .001). → Fabic 2019
Evidence¶
Fabic 2019¶
Fabic, G. V. F., Mitrovic, A., & Neshatian, K. (2019). Evaluation of Parsons Problems with Menu-Based Self-Explanation Prompts in a Mobile Python Tutor. International Journal of Artificial Intelligence in Education, 29, 507–535. https://doi.org/10.1007/s40593-019-00184-0
q3 · i? · causal · r2
Log data from 63 participants showed the experimental group spent on average 48 min (sd = 13.1) using PyKinetic vs. 42 min (sd = 14.4) for control, with no significant difference in total interaction time. The authors state the time-per-problem difference "was expected, as they did not have SE prompts."
"there was a significant difference (U = 340, p = .035) between the two conditions on average time spent per problem, with the control group participants being faster (mean = 3.22 min, sd = 1.18) compared to the experimental group (mean = 4 min, sd = 1.52)."
Discussion¶
Related Claims¶
- Low prior knowledge students learned more from PyKinetic's Parsons problems than high prior knowledge students, especially in the experimental group with SE prompts — related
- Students receiving intelligent ITS feedback spent significantly more time and made significantly more steps on the hypothesis-testing tasks than controls — related
- The experimental group answered achievement tests faster (6.18 minutes) than the control group (7.51 minutes) — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
se-prompts-increase-time-per-problem |
title |
The experimental group spent significantly more time per problem and completed significantly fewer problems than the control group |
description |
The experimental group spent significantly more time per problem and completed significantly fewer problems than the control group |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2019 |
generated |
by process:wiki-ingest on 2026-10-28 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — fabic-2019 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.