For standardized mean changes, rubric effects on performance decrease with mean age, yet secondary-education studies show larger effects than primary and middle school — contradictory moderator results¶

Claim · All claims
Evidence · 1 study (2 entries) · quant-synthesis r2–r3 · q3 · i0 negligible
Currency · newest study 2023 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i? In the standardized-mean-change meta-analysis, each one-unit increase in mean age predicted a 0.062-unit decrease in effect, based on only 14 effect sizes from two studies. → Panadero 2023 q3 i0 Secondary-education studies showed a larger standardized mean change (g = 0.99) than primary (g = 0.03) and middle school (g = 0.14). → Panadero 2023 (2)

Evidence¶

Panadero 2023¶

Panadero, Ernesto; Jonsson, Anders; Pinedo, Leire; Fernández-Castilla, Belén. (2023). Effects of Rubrics on Academic Performance, Self-Regulated Learning, and self-Efficacy: a Meta-analytic Review. Educational Psychology Review. https://doi.org/10.1007/s10648-023-09823-4

q3 · i? · quant-synthesis · r3

Meta-regression within the standardized-mean-change analysis (12 studies). The article cautions the result is "based on only 14 effect sizes from two studies, and there were only two different values for the mean age."

"The mean age of the participants significantly predicted the variability of the standardized mean changes: for a one unit increase in the average age, there was a 0.062 unit decrease in the standardized mean changes"

Panadero 2023 (2)¶

Panadero, Ernesto; Jonsson, Anders; Pinedo, Leire; Fernández-Castilla, Belén. (2023). Effects of Rubrics on Academic Performance, Self-Regulated Learning, and self-Efficacy: a Meta-analytic Review. Educational Psychology Review. https://doi.org/10.1007/s10648-023-09823-4

q3 · i0 · quant-synthesis · r2

Moderator analysis of standardized mean changes by educational level; secondary education also exceeded middle school (g = 0.14, difference = 0.85, p < 0.001). The printed category effects (g = 0.99, g = 0.03, g = 0.14) are the article's only effect-size values for this contrast.

"the overall effect for studies from secondary education was higher (g = 0.99, number of effects = 10) than the overall effect of studies from primary education (g = 0.03, number of effects = 10, difference = 0.96, p = 0.004)"

Discussion¶

Related Claims¶

• Using rubrics has a positive, moderate effect on students' academic performance (corrected g = 0.45; standardized mean change = 0.38) — a broader claim this one bears on
• Most moderator variables are not significantly related to rubric effects on academic performance, including rubric design specifics — related
• Number of rubric sessions interacts negatively with mean age: intervention length matters less for older students — related
• Elementary classrooms score significantly higher on the PERTS academic mindset scale than middle school classrooms — related
• Attitude effects of innovative teaching decrease with student grade level — related