Claims

In the Paint.NET embedded-tutor comparison, task performance differed among book, movie, and ITS groups, with the book group scoring significantly higher than the movie group and the ITS group in between

Claim · All claims
Evidence · 1 study · causal r1 · q2 · i2 medium
Currency · newest study 2015 · not yet checked against its sources · not reviewed by a person

Subclaims

Reading the evidence codes

q is the design tier, i the impact, n the sample, and the kind with its r the rigour judged within that kind: what each code means.

This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.

q2 i2 Task performance after 12 learning exercises differed among groups (F(2,64)=3.859, p=.026, ω2=0.08); only book (M=25.0) significantly exceeded movie (M=17.7), with ITS at M=22.3. → Stephen B. Gilbert 2015

Evidence

Stephen B. Gilbert 2015

Stephen B. Gilbert, Stephen B. Blessing, Enruo Guo. (2015). Authoring Effective Embedded Tutors: An Overview of the Extensible Problem Specific Tutor (xPST) System. Int J Artif Intell Educ 25:428–454. https://doi.org/10.1007/s40593-015-0045-0

q2 · non-randomised group comparison · i2 · causal · r1

Comparison of three groups (assignment to groups not reported as random) of 75 students learning image editing via book excerpt, expert screen-capture movie, or the embedded Paint.NET ITS (groups of roughly 24/24/26 by measure). Only the book–movie difference was significant; the ITS group did not differ significantly from either. The quote reports the omnibus task-performance result with ω2=0.08, "a medium effect size".

"Task performance was significantly different among the groups, with a medium effect size (Book M=25.0, SD =8.8; Movie M=17.7, SD=9.4; ITS M=22.3, SD =8.1; F(2,64)=3.859, p=.0 26, ω2=0.08)."

Discussion

Page metadata
Field Value
type claim
id paintdotnet-its-task-performance-mixed
title In the Paint.NET embedded-tutor comparison, task performance differed among book, movie, and ITS groups, with the book group scoring significantly higher than the movie group and the ITS group in between
description In the Paint.NET embedded-tutor comparison, task performance differed among book, movie, and ITS groups, with the book group scoring significantly higher than the movie group and the ITS group in between
status review
evidence_strength mixed
newest_evidence 2015
generated by process:wiki-ingest on 2026-10-27
trust unverified — no one has confirmed this page's content
sources 1 — stephen-b-gilbert-2015

Frontmatter is the page's machine-readable record — see the Schema & Guide.