Partial credit under the IF-AT is granted in a discriminating manner: top final-exam scorers earned 65% ± 23% of available partial credit versus 39% ± 10% for bottom scorers¶

Claim · All claims
Evidence · 1 study · design r2 · q2 · i2 medium
Currency · newest study 2013 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 2016: tool and model accuracy changes quickly

Subclaims¶

q2 i? On the four-option final exam, the top fifteen scorers earned 65% ± 23% of the partial credit available to them while the bottom 15 students earned only 39% ± 10%, a difference the author reports as statistically significant by t-test. → Slepkov 2013

Evidence¶

Slepkov 2013¶

Slepkov, A. D. (2013). Integrated Testlets and the Immediate Feedback Assessment Technique. https://arxiv.org/abs/1308.4365 doi:10.48550/arxiv.1308.4365

q2 · i2 · design · r2

Analysis of second-attempt partial credit on the IF-AT final exam (49 students). The author reports "the top fifteen final exam scorers" earned a higher proportion of available partial credit than the bottom 15, confirming discriminating allocation; a t-test confirmed the difference as statistically significant.

"Indeed, the top fifteen final exam scorers 38 earned 65% ± 23% (mean ± standard deviation) of the partial credit available to them, while the bottom 15 students earned only 39% ± 10% of the partial credit available to them."

Discussion¶

Related Claims¶

• Partial credit accounts for only a small proportion of IF-AT exam scores, though weaker students depend on it more — related
• Polychotomously scored IF-AT physics exam items show excellent discrimination, with a mean item-total correlation of r′ = 0.41 ± 0.13 across 45 items — related
• High-risk students disproportionately scored 80 or above on the final exam (13 of 23), while no low-risk student did — related