Claims

In the generalized condition, compliance with several suggested actions was associated with higher essay scores, with one exception: note-taking after the last scaffold was associated with lower essay scores.

Claim · All claims
Evidence · 1 study · design r2 · q2 · i3 large
Currency · newest study 2023 · checked against its sources 2026-10-20 (automated, 1 of 1 entry) · not reviewed by a person

Subclaims

Reading the evidence codes

q is the design tier, i the impact, n the sample, and the kind with its r the rigour judged within that kind: what each code means.

This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.

q2 i3 Students who executed scaffold 3 option 1 (review annotations) after the next scaffold showed higher essay scores than those who did not, d = 1.220. → Joep van der Graaf 2023 q2 i2 Students who executed scaffold 4 option 4 (write the essay with help from notes) after the next scaffold showed lower essay scores than those who did not, d = 1.000. → Joep van der Graaf 2023 q2 i2 Trends towards higher essay scores appeared for executing scaffold 4 option 2 (review the essay rubric, d = 0.801), scaffold 5 options 1 and 4 (d = 0.623), and scaffold 4 option 1 (d = 0.519) before the scaffold. → Joep van der Graaf 2023

Evidence

Joep van der Graaf 2023

Joep van der Graaf, Mladen Raković, Yizhou Fan, Lyn Lim, Shaveen Singh, Maria Bannert, Dragan Gašević, Inge Molenaar. (2023). How to design and evaluate personalized scaffolds for self-regulated learning. Metacognition and Learning. https://doi.org/10.1007/s11409-023-09361-y

q2 · i3 · design · r2

Separate t-tests in the generalized condition comparing essay scores of compliers versus non-compliers per scaffold option, with alpha raised to 0.150 due to insufficient power for multiple comparisons. Six (near) significant effects were found, e.g., "t(6.98) = 2.82, p = .026, d = 1.220" for reviewing annotations, and a detrimental effect for note-taking after the last scaffold (d = 1.000).

"Students who executed this action after the next scaffold showed higher essay scores than those who did not, t(6.98) = 2.82, p = .026, d = 1.220."

Discussion

Page metadata
Field Value
type claim
id compliance-suggested-actions-essay-scores-mixed
title In the generalized condition, compliance with several suggested actions was associated with higher essay scores, with one exception: note-taking after the last scaffold was associated with lower essay scores.
description In the generalized condition, compliance with several suggested actions was associated with higher essay scores, with one exception: note-taking after the last scaffold was associated with lower essay scores.
status review
evidence_strength weak
newest_evidence 2023
source_checked 2026-10-20
generated by process:wiki-ingest on 2026-10-19
trust unverified — no one has confirmed this page's content
sources 1 — joep-van-der-graaf-2023

Frontmatter is the page's machine-readable record — see the Schema & Guide.