Little of the existing IRT scaling and linking expertise from large-scale educational assessment is applied to scaling psychological and social-emotional survey constructs¶

Claim · All claims
Evidence · 1 study · causal r? · q1
Currency · newest study 2020 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q1 i? Although extensive guidance exists on scaling and linking IRT-based educational assessments for growth estimation, little of it is applied to psychological and social-emotional constructs. → Megan Kuhfeld 2020

Evidence¶

Megan Kuhfeld 2020¶

Megan Kuhfeld, James Soland. (2020). Avoiding bias from sum scores in growth estimates: An examination of IRT-based approaches to scoring longitudinal survey responses. Psychological Methods. https://doi.org/10.1037/met0000367

q1 · i? · causal · r?

The article asserts a gap between assessment-scaling expertise and practice in scaling psychological and social-emotional survey constructs, noting "little of this expertise is brought to bear" in that domain. The abstract offers no empirical support for this gap statement itself.

"Although there is great deal of guidance on scaling and linking IRT-based large-scale educational assessment to facilitate the estimation of examinee growth, little of this expertise is brought to bear in the scaling of psychological and social-emotional constructs."

Discussion¶

Related Claims¶

• Longitudinal survey growth is typically measured with sum scores or IRT scale scores from a consistent item set administered across multiple school years — related
• The effect of response styles on growth estimates varies by psychological construct, response style, and IRT model used — related
• Most Turkish IRT-based scale development studies did not check the unidimensionality or local independence assumptions — related
• Multidimensional IRT scores that account for latent variable covariances over time produce better recovery of growth parameters in longitudinal growth models than sum scores and other IRT approaches — related
• The multi-rater growth model shows promise relative to cruder approaches like estimating growth from a single rater — related