Comparative validity study of MCAS versus a next-generation Common Core college-readiness test in Massachusetts¶

Element · All elements
Evidence · 7 claims (7 for) · 3 studies (3 associational), q2 · 0 of 3 report an effect size · 6 claims rest on one study

Description¶

An evidence publication comparing the validity of two standardized tests for assessing college readiness in Massachusetts: the long-standing Massachusetts Comprehensive Assessment System (MCAS) and a next-generation test designed for the Common Core. The article frames the study as relevant beyond one state, noting that more than 40 states adopted the Common Core and many face similar assessment-system decisions.

Design Implications¶

Context¶

Requirements¶

• State adoption of the Common Core State Standards as the policy context for choosing an aligned assessment

Constraints¶

• The comparison is specific to Massachusetts public schools and its two assessment options

Target Learners¶

• public high school students in Massachusetts

Target Learning Goals¶

• assessing students' readiness for college

Claims¶

• The study is the first to examine whether PARCC assessments identify students who are ready for college, and it was commissioned to inform Massachusetts's decision between MCAS and PARCC [+W]
• PARCC and MCAS scores show similar validity in predicting college grades for Massachusetts students [+W]
• PARCC sets a higher performance standard in mathematics than MCAS, while both exams predict college performance comparably [+W]
• The study is the first to examine whether PARCC assessments identify students who are ready for college [+W]
• PARCC and MCAS scores show similar validity for predicting college grades [+W]
• MCAS and PARCC scores similarly predict which students need remedial coursework in college [+W]
• In math, students meeting the PARCC college-ready standard are less likely to need remediation than students meeting the MCAS proficient standard; in ELA the standards are not statistically distinguishable [+W]

Related Elements¶

• Massachusetts PARCC versus MCAS predictive-validity study

Examples¶

-

Key Sources¶

• Ira Nichols-Barrer, Kate Place, Erin Dillon, Brian P. Gill. (2016). Testing College Readiness: Massachusetts Compares the Validity of Two Standardized Tests. Education Next, vol. 16, no. 3. https://www.educationnext.org/testing-college-readiness-massachusetts-compares-validity-two-standardized-tests/