Attempting a new exercise on average increases estimated student ability during formative assessment¶

Claim · All claims
Evidence · 1 study · causal r1 · q3
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person · recheck by 2028: tool and model accuracy changes quickly

Subclaims¶

q3 i? Across the formative assessment period, each attempted exercise increased Rasch-estimated ability on average by 0.0055 (95% CI [0.0035, 0.0075]), corresponding to a grade increase of 0.028 (95% CI [0.018, 0.039]). → Letteri 2025

Evidence¶

Letteri 2025¶

Letteri, I. & Vittorini, P. (2025). Enhancing Student Feedback in Data Science Education: Harnessing the Power of AI-Generated Approaches. International Journal of Artificial Intelligence in Education. https://doi.org/10.1007/s40593-025-00492-8

q3 · i? · causal · r1

Analysis of system-logged Rasch ability estimates after every exercise for the 2023/24 cohort; the article calls the finding intuitive: "attempting a new exercise enhances ability, which leads to a better grade".

"On average, we observed an increase of 0.0055 (with 95% confidence intervals[0.0035, 0.0075]). This corresponds to an increase in grade of 0 .028 (with 95% confidence intervals [0.018, 0.039]), cal- culated by applying a linear transformation of the ability (which usually ranges from −3 to 3) to the grade (which instead ranges from 0 to 31, i.e., 30 cum laude)."

Discussion¶

Related Claims¶

• Students who attempted more than 90 different exercises achieved significantly higher final grades than students who attempted fewer — related
• First-attempt EEG features and initial performance score predict learning rate, with higher initial scores associated with lower learning rates — related