Recalibrated 5Essentials measures based on 2014–19 data maintained acceptable Rasch reliability and school-level variance¶

Claim · All claims
Evidence · 1 study (2 entries) · associational r3 · q2
Currency · newest study 2020 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 2023: tool and model accuracy changes quickly

Subclaims¶

q2 i? All recalibrated measures showed acceptable Rasch reliability, with the majority above 0.80. → Hart 2020 q2 i? All measures explained sufficient school-level variance (ICC >0.05) to differentiate schools. → Hart 2020 (2)

Evidence¶

Hart 2020¶

Hart, H., Young, C., Chen, A., Zou, A., & Allensworth, E.M. (2020). Supporting school improvement: Early findings from reexamination of the 5Essentials survey. Chicago, IL: University of Chicago Consortium on School Research. https://consortium.uchicago.edu/publications/supporting-school-improvement

q2 · i? · associational · r3

Psychometric recalibration recreating all measures from recent data (2014–19) to check whether they maintained expected reliability and could still differentiate schools, since some original item parameters were created as long as 25 years ago.

"We found each of the measures had acceptable Rasch reliability, with the majority able to differentiate several strata of respondents (>0.80)."

Hart 2020 (2)¶

Hart, H., Young, C., Chen, A., Zou, A., & Allensworth, E.M. (2020). Supporting school improvement: Early findings from reexamination of the 5Essentials survey. Chicago, IL: University of Chicago Consortium on School Research. https://consortium.uchicago.edu/publications/supporting-school-improvement

q2 · i? · associational · r3

Intraclass correlation analysis of the recalibrated measures, checking school-level variance. All measures exceeded the ICC 0.05 threshold the report sets for usefulness in differentiating schools.

"We also calculated the intraclass correlation coefficient (ICC) for schools and found that all of the measures explained sufficient variance at the school level to be useful in differentiating schools (ICC >0.05)."

Discussion¶

Related Claims¶

• In the spring 2015 pilot, 19 of 27 teacher-survey measures met the 0.80 reliability threshold and all but one met 0.70; the Early Childhood Discipline measure was removed — related
• All nine Cultivate learning condition measures show strong Rasch person reliability (0.82-0.87) in CPS administrations — related
• The Early Education Essentials is reliable across multiple ECE settings — related
• Rasch-based refinement reduced the Early Ed Essentials surveys to 24 teacher measures (122 items) and 9 parent measures (42 items) — related