Pilot test events represented fewer grade levels overall, with more grade levels represented for low- and high-performing students, while the comparison group showed the opposite pattern¶

Claim · All claims
Evidence · 1 study (2 entries) · causal r2 · q2
Currency · newest study 2023 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? In grade 3 math, only two grade levels were represented in the pilot group versus six in the comparison group; the middle 80% of pilot students had items spanning three grade levels versus six for comparison students. → J. Patrick Meyer 2023 q2 i? More grades were represented for the lower and upper 10% of pilot students than for the middle 80%, supporting the off-grade adaptation claim; the comparison group showed the opposite pattern. → J. Patrick Meyer 2023 (2)

Evidence¶

J. Patrick Meyer 2023¶

J. Patrick Meyer, Ann Hu, Sylvia Li. (2023). Content Proximity Spring 2022 Pilot Study Research Brief. Psychometric Solutions, NWEA. https://www.nwea.org/research/publication/content-proximity-spring-2022-pilot-study-research-report/

q2 · i? · causal · r2

Analysis of Table 2.1 (number of item grades represented with 5% or more items, by decile groups) showed pilot grade 3 math items spanned "only two grade levels" versus six in the comparison group.

"For example, only two grade levels were represented by items in grade 3 math pilot group, but 6 grade levels were represented by items in the comparison group (relevant numbers marked in Table 2.1 with superscript 1)."

J. Patrick Meyer 2023 (2)¶

J. Patrick Meyer, Ann Hu, Sylvia Li. (2023). Content Proximity Spring 2022 Pilot Study Research Brief. Psychometric Solutions, NWEA. https://www.nwea.org/research/publication/content-proximity-spring-2022-pilot-study-research-report/

q2 · i? · causal · r2

Table 2.1 analysis by ability decile groups showed more grades represented for the lower and upper 10% of pilot students than the middle 80%, while "the middle 80% tended to have more grades represented" in the comparison group, the opposite of expectations.

"It indicates that more grades were represented by items for in the lower and upper pilot study groups than for the middle 80%. In the comparison group, the middle 80% tended to have more grades represented than either the lower or upper 10%."

Discussion¶

Related Claims¶

• Content Proximity pilot tests contained significantly more on-grade items and made better use of adjacent-grade items than traditional MAP Growth tests — related
• The Content Proximity spring 2022 pilot study examined validity, reliability, and test score comparability of MAP Growth assessments using the new item-selection algorithm — related
• Pilot test events largely fulfilled updated blueprint requirements, including increased reading passages per test event — related
• A 200-student pilot showed strong content validity across relevance, comprehensiveness, comprehensibility, and face validity — related