Trace data tend to predict achievement better than self-reports, but self-reports of global SRL intensity can outperform traces¶

Claim · All claims
Evidence · 1 study (2 entries) · review r2–r3 · q2
Currency · newest study 2019 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 2022: tool and model accuracy changes quickly

Subclaims¶

q2 i? Across reviewed studies, traces tend to have higher predictive value for achievement than self-reports. → Rovers 2019 q2 i? In one exception, self-reported SRL intensity predicted achievement (16% of variance) while traces did not. → Rovers 2019 (2)

Evidence¶

Rovers 2019¶

Rovers, S. F. E., Clarebout, G., Savelberg, H. H. C. M., de Bruin, A. B. H., & van Merriënboer, J. J. G. (2019). Granularity matters: comparing different ways of measuring self-regulated learning. Metacognition and Learning. https://doi.org/10.1007/s11409-019-09188-6

q2 · i? · review · r3

Review's summary statement following its synthesis of the ten fine-grained comparison studies; no pooled effect size is printed, so the finding is directional rather than quantified.

"Traces tend to have a higher predictive value in terms of achievement than self-reports."

Rovers 2019 (2)¶

Rovers, S. F. E., Clarebout, G., Savelberg, H. H. C. M., de Bruin, A. B. H., & van Merriënboer, J. J. G. (2019). Granularity matters: comparing different ways of measuring self-regulated learning. Metacognition and Learning. https://doi.org/10.1007/s11409-019-09188-6

q2 · i? · review · r2

Review reports the follow-up analysis of Jamieson-Noel and Winne (2003): self-reported SRL intensity significantly predicted achievement (16% of variance) while trace-based measures did not; the review attributes this partly to traces being clustered into global scales.

"a notable exception to the general finding that traces have a higher predictive value for achievement than self-reports is the study by Jamieson-Noel and Winne ( 2003), in which traces of SRL intensity did not predict achievement, while self-report of SRL intensity did"

Discussion¶

Related Claims¶

• Self-report measures of SRL capture perceptions of strategy use rather than implementation quality, and a combined trace-data approach may be best
• Students are better calibrated in predicting achievement than in reporting specific study tactics (Winne & Jamieson-Noel 2002) — related
• When SRL is measured at a fine grain size (specific strategies), self-reports show low calibration with behavioral measures — related
• Self-reports of achievement goal orientations diverge markedly from traced goal orientations, which predict reading achievement while self-reports do not — related