An instructional guide and examples led peer reviewers to write longer feedback comments, with a small effect size¶

Claim · All claims
Evidence · 1 study · causal r2 · q3 · i1 small
Currency · newest study 2024 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i1 Students with access to the guide wrote longer comments on average than untrained students (d = 0.24). → George Gyamfi 2024

Evidence¶

George Gyamfi 2024¶

George Gyamfi, Barbara E. Hanna, Hassan Khosravi. (2024). Impact of an instructional guide and examples on the quality of feedback: insights from a randomised controlled study. Education Tech Research Dev. https://doi.org/10.1007/s11423-024-10346-0

q3 · i1 · causal · r2

Randomised controlled experiment with 195 postgraduate students in a 13-week applied linguistics course; student-level analysis of average comment word length across moderations. The trained group's mean of 26.23 words exceeded the untrained group's 21.47, and "this difference was statistically significant, U = 42,621 p < 0.001, however the effect size was small, d = 0.24."

"on average students from the trained group provided longer comments (µ = 26.23, Mdn = 23, σ = 20.05) than the untrained group (µ = 21.47, Mdn = 20, σ = 18.14)"

Discussion¶

Related Claims¶

• Even with the guide, few comments displayed all five S.P.A.R.K. traits, showing limited comprehensive feedback ability — related
• The guide increased the percentage of feedback comments displaying at least one S.P.A.R.K. quality trait — related
• The guide increased co-occurrence of multiple S.P.A.R.K. traits within a single feedback comment — related
• Specific feedback was the most common trait and actionable feedback the least common in both trained and untrained groups — related