Intra-testlet items were slightly more difficult than stand-alone questions (p′ = 0.69 ± 0.15 vs 0.75 ± 0.15)¶

Claim · All claims
Evidence · 1 study · design r2 · q2
Currency · newest study 2013 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? Across both examinations, intra-testlet items had a slightly lower mean polychotomous difficulty (p′ = 0.69 ± 0.15) than stand-alone questions (p′ = 0.75 ± 0.15). → Slepkov 2013

Evidence¶

Slepkov 2013¶

Slepkov, A. D. (2013). Integrated Testlets and the Immediate Feedback Assessment Technique. https://arxiv.org/abs/1308.4365 doi:10.48550/arxiv.1308.4365

q2 · i? · design · r2

Descriptive item-difficulty comparison across the midterm and final exams, where p′ is the mean obtained item score including partial credit. The author reports "the intra-testlet items were slightly more difficult than the stand-alone questions" and notes the spread was largely by design, using easier items as confidence boosters.

"Considering both examinations, the intra-testlet items were slightly more difficult than the stand-alone questions, with p′ = 0. 69 ± 0. 15 and 0.75 ± 0.15,"

Discussion¶

Related Claims¶

• IF-AT-scored physics midterm and final exams yield good test reliability (α = 0.71 and 0.82; α50 = 0.86 and 0.90) — related
• An item positioned later in one booklet was found more difficult by that booklet's test takers, attributed to fatigue effect — related
• Polychotomously scored IF-AT physics exam items show excellent discrimination, with a mean item-total correlation of r′ = 0.41 ± 0.13 across 45 items — related
• Point-biserial item-total correlation is negatively related to test discriminating value and can be expressed via item and test difficulty and discrimination parameters — related
• Partial credit accounts for only a small proportion of IF-AT exam scores, though weaker students depend on it more — related