Within individuals, adopting the Exam Playbook tracks better subsequent exam performance and dropping it tracks worse¶

Claim · All claims
Evidence · 1 study (2 entries) · associational r2 · q3 · i0 negligible
Currency · newest study 2022 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i0 Matched students who adopted the Exam Playbook on Exam 2 scored 1.75 percentage points higher (d = 0.12) than matched never-users. → Chen 2022 q3 i0 Matched students who dropped the Exam Playbook on Exam 2 scored 1.88 percentage points worse (d = 0.14) than matched continuing users. → Chen 2022 (2)

Evidence¶

Chen 2022¶

Chen, P., Teo, D. W. H., Foo, D. X. Y., Derry, H. A., Hayward, B. T., Schulz, K. W., Hayward, C., McKay, T. A., & Ong, D. C. (2022). Real-world effectiveness of a social-psychological intervention translated from controlled trials to classrooms. npj Science of Learning 7:20. https://doi.org/10.1038/s41539-022-00135-w

q3 · i0 · associational · r2

Stratified matching analysis (13 classes), matching on first-exam performance, entrance scores, gender, race, and first-generation status, found adopters "performed an average of 1.75 percentage points ([0.69, 2.81], d = 0.12, p = .001) better".

"students who adopted the Exam Playbook performed an average of 1.75 percentage points ([0.69, 2.81], d = 0.12, p = .001) better on the second exam, compared to those who never used it"

Chen 2022 (2)¶

Chen, P., Teo, D. W. H., Foo, D. X. Y., Derry, H. A., Hayward, B. T., Schulz, K. W., Hayward, C., McKay, T. A., & Ong, D. C. (2022). Real-world effectiveness of a social-psychological intervention translated from controlled trials to classrooms. npj Science of Learning 7:20. https://doi.org/10.1038/s41539-022-00135-w

q3 · i0 · associational · r2

In the parallel stratified matching analysis on first-exam users, droppers "performed an average of 1.88 percentage points ([0.64, 3.11], d = 0.14, p = .003) worse" than continuers.

"students who dropped the Exam Playbook performed an average of 1.88 percentage points ([0.64, 3.11], d = 0.14, p = .003) worse, compared to those who kept using it"

Discussion¶

Related Claims¶

• Self-administered Exam Playbook use predicts higher exam scores in real-world college classes (d = 0.18) — related
• Exam Playbook benefits relate to dosage and to earlier use before exams — related
• The instructor's own final exam showed the same direction of advantage on the intact randomized sample, with no difference on the pre-treatment midterm — related