Exam Playbook benefits relate to dosage and to earlier use before exams¶

Claim · All claims
Evidence · 1 study (2 entries) · associational r2–r3 · q3 · i0 negligible
Currency · newest study 2022 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i0 Among users, using the Exam Playbook on more occasions related to better average exam performance (b = 2.18, d = 0.18). → Chen 2022 q3 i0 Using the Exam Playbook earlier relative to the exam related to greater benefit (b = 0.42 percentage points per day, d = 0.03 per day). → Chen 2022 (2)

Evidence¶

Chen 2022¶

Chen, P., Teo, D. W. H., Foo, D. X. Y., Derry, H. A., Hayward, B. T., Schulz, K. W., Hayward, C., McKay, T. A., & Ong, D. C. (2022). Real-world effectiveness of a social-psychological intervention translated from controlled trials to classrooms. npj Science of Learning 7:20. https://doi.org/10.1038/s41539-022-00135-w

q3 · i0 · associational · r3

Mixed-effects meta-analysis among users found higher dosages "related to better average exam performance ( b = 2.18 percentage points [1.18, 3.19], d = 0.18, p < 0.001)", consistent with the original efficacy experiments.

"using the Exam Playbook on more occasions (i.e., higher dosages) related to better average exam performance ( b = 2.18 percentage points [1.18, 3.19], d = 0.18, p < 0.001) among students who used the Exam Playbook"

Chen 2022 (2)¶

Chen, P., Teo, D. W. H., Foo, D. X. Y., Derry, H. A., Hayward, B. T., Schulz, K. W., Hayward, C., McKay, T. A., & Ong, D. C. (2022). Real-world effectiveness of a social-psychological intervention translated from controlled trials to classrooms. npj Science of Learning 7:20. https://doi.org/10.1038/s41539-022-00135-w

q3 · i0 · associational · r2

Exam-level analysis among users (average use M = 7.0 days before exams) found users "bene fited more from using it earlier ( b = 0.42 percentage points per day [0.29, 0.54], d = 0.03 per day, p < 0.001)".

"Students who used the Exam Playbook bene fited more from using it earlier ( b = 0.42 percentage points per day [0.29, 0.54], d = 0.03 per day, p < 0.001)."

Discussion¶

Learner Variables¶

• Time and Continuity — predictor: learners who differ on it differ in outcomes

Related Claims¶

• Within individuals, adopting the Exam Playbook tracks better subsequent exam performance and dropping it tracks worse — related
• Class climate—peer uptake and instructor credit incentives—relates to larger Exam Playbook effect sizes — related
• A strategic resource-use exam playbook intervention raised final course grades in introductory statistics across two randomized cohorts, with a dosage effect for completing it twice — related
• Self-administered Exam Playbook use predicts higher exam scores in real-world college classes (d = 0.18) — related