Compare growth estimates from IRT scoring models that do and do not account for response styles when evaluating longitudinal survey scores¶

Strategy · All strategies
Evidence · no claims cited

Description¶

The article's method is to score surveys two ways and compare: "we scored surveys using item response theory (IRT) models that do and do not account for response styles, and then used those different scores in growth models and compared results." This dual-scoring strategy lets researchers check whether growth parameter estimates on social-emotional surveys are sensitive to response-style modeling, using both empirical longitudinal data and simulation analyses.

Design Implications¶

Context¶

Requirements¶

• Longitudinal survey response data
• IRT scoring software supporting models with and without response-style parameters
• Growth models fitted to the alternative scores

Constraints¶

• The article reports that effects vary by psychological construct, response style, and model used, so a single comparison may not generalize across measures

Target Learners¶

• K-12 students completing social-emotional learning surveys

Target Learning Goals¶

• Valid estimation of growth on social-emotional constructs from survey scores

Affordances¶

• Response Styles Scale Usage Definition

Related Strategies¶

Examples¶

-

Key Sources¶

• James Soland, Megan Kuhfeld. (2020). Do response styles affect estimates of growth on social-emotional constructs? Evidence from four years of longitudinal survey scores. NWEA Research Working Paper. https://www.nwea.org/research/publication/do-response-styles-affect-estimates-of-growth-on-social-emotional-constructs-evidence-from-four-years-of-longitudinal-survey-scores/