Seminar students improved more on LSAT Logical Reasoning than control students (d = 0.71, 95% CI [0.37, 1.04], p < 0.001)¶

Claim · All claims
Evidence · 1 study · causal r2 · q3 · i2 medium
Currency · newest study 2018 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i2 Seminar students' degree of improvement on equivalated LSAT Logical Reasoning forms exceeded that of control students, d = 0.71. → Simon Cullen 2018

Evidence¶

Simon Cullen 2018¶

Simon Cullen, Judith Fan, Eva van der Brugge and Adam Elga (2018). Improving analytical reasoning and argument understanding: a quasi-experimental field study of argument visualization. npj Science of Learning 3:21. https://doi.org/10.1038/s41539-018-0038-5

q3 · i2 · causal · r2

Quasi-experimental field study comparing 105 seminar students across seven course iterations with 56 control students recruited from interested freshmen, tested on equivalated LSAT forms 85 days apart. The between-group improvement difference was d = 0.71; seminar students gained "an additional 2.6 questions correctly (SD = 2.8)".

"the degree of improvement exhibited by seminar students was greater than that exhibited by control students, t(159) = 4.3, p < 0.001, d = 0.71, 95% CI: [0.37, 1.04]"

Discussion¶

Related Claims¶

• Pretest LSAT scores did not differ reliably between seminar and control groups — related
• Control students' LSAT scores did not change significantly over the semester (d = 0.11, p = 0.27) — related
• Seminar group membership remained a significant predictor of improvement after controlling for pretest scores (η²p = 0.075) — related
• Recent studies found LSAT-measured effect sizes three times smaller than CCTST-measured effect sizes for critical-thinking training — related
• Students rated the seminar highly and many reported transferring argument visualization to other coursework — related