In Study 1, the three conditions did not differ significantly on the immediate post-test of conceptual knowledge¶
Claim · All claims
Evidence · 1 study · causalr2·q3·i1small
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q3 i1 The one-way ANOVA on immediate post-test conceptual knowledge revealed no significant differences between the three conditions, η2 = 0.021. → Guido Makransky 2025
Evidence¶
Guido Makransky 2025¶
Guido Makransky, Ban M. Shiwalia, Tue Herlau, Steven Blurton. (2025). Beyond the "Wow" Factor: Using Generative AI for Increasing Generative Sense-Making. Educational Psychology Review. https://doi.org/10.1007/s10648-025-10039-x
q3 · i1 · causal · r2
In the pre-registered Study 1 between-subjects experiment (175 university students), the immediate post-test ANOVA "revealed no significant differences between the three conditions, F(2, 172) = 1.886, p = 0.155, η2 = 0.021"; equivalence was not tested.
"the one-way ANOVA revealed no significant differences between the three conditions, F(2, 172) = 1.886, p = 0.155, η2 = 0.021."
Discussion¶
Related Claims¶
- In Study 1, university students using ChatTutor scored significantly higher than teaching-as-usual students on a delayed conceptual knowledge test four weeks after the lesson, but did not differ significantly from ChatGPT students — related
- Initial failure did not hurt subsequent learning during instruction: no condition differences on example generation or immediate learning tests — related
- In Study 1, ChatTutor students answered significantly more new follow-up conceptual knowledge items correctly than teaching-as-usual students, controlling for the testing effect — related
- In Study 1, differences in self-efficacy between the three conditions did not reach significance — related
- In Study 1, ChatTutor produced significantly higher trust, enjoyment, and behavioral intentions than ChatGPT, while students were blind to condition — related
- Support conditions did not differ from control in learning scores within the environment — related
- Technology-enhanced adaptive teaching improves delayed but not immediate learning outcomes compared with business-as-usual teaching — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
chattutor-immediate-posttest-null-study1 |
title |
In Study 1, the three conditions did not differ significantly on the immediate post-test of conceptual knowledge |
description |
In Study 1, the three conditions did not differ significantly on the immediate post-test of conceptual knowledge |
status |
review |
evidence_strength |
weak |
newest_evidence |
2025 |
generated |
by process:wiki-ingest on 2026-10-20 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — guido-makransky-2025 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.