Simulation-response convergence was corroborated by survey-based changes in mindsets and practices and by human rater ratings for Roster Justice¶

Claim · All claims
Evidence · 1 study (2 entries) · design r2 · q2
Currency · newest study 2021 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 2024: tool and model accuracy changes quickly

Subclaims¶

q2 i? The shift in simulation responses was corroborated by LE participants expressing more equity-oriented mindsets and describing more equity-promoting practices on immediate postcourse and follow-up surveys. → Littenberg-Tobias 2021 q2 i? For Roster Justice, LE participants whose responses were most similar topically with HE participants were also more likely to be rated as equitable by human raters. → Littenberg-Tobias 2021 (2)

Evidence¶

Littenberg-Tobias 2021¶

Littenberg-Tobias, J., Borneman, E., & Reich, J. (2021). Measuring Equity-Promoting Behaviors in Digital Teaching Simulations: A Topic Modeling Approach. AERA Open. https://doi.org/10.1177/23328584211045685

q2 · i? · design · r2

Survey corroboration of the simulation-response convergence among LE participants, using paired comparisons of composite equity mindset and equity-promoting practice scores at immediate postcourse and follow-up; the abstract prints effect sizes of 0.88 SD and 0.32 SD respectively.

"This shift was corroborated by LE participants also expressing more equity-oriented mindsets and described engaging in more equity-promoting practices on surveys (both immediate postcourse and follow-up)."

Littenberg-Tobias 2021 (2)¶

Littenberg-Tobias, J., Borneman, E., & Reich, J. (2021). Measuring Equity-Promoting Behaviors in Digital Teaching Simulations: A Topic Modeling Approach. AERA Open. https://doi.org/10.1177/23328584211045685

q2 · i? · design · r2

Human-rater validation for Roster Justice only: research assistants rated responses on a 5-point Avoidant-Aware rubric (weighted Krippendorff's alpha 0.76, 25% double-rated), blind to the distance measure. Topical similarity to HE participants was associated with more equitable ratings.

"Additionally, for one of the simulations, Roster Justice, we found that LE participants whose responses were most similar topically with HE participants were also more likely to be rated as equitable by human raters."

Discussion¶

Related Claims¶

• In Roster Justice, Avoidant-mindset participants described roster disparities in racially neutral terms while Aware-mindset participants named the racialized nature of the disparity — related
• Low-equity participants' simulation responses converged over successive simulations toward those of a high-equity reference group — related
• Structural topic modeling identifies simulation decision points indicative of different equity mindsets across four digital teaching simulations — related
• Educators need a shift in adult mindsets—from evaluative/accountability data use toward improvement-oriented use—for student experience data to improve practice — related