Third-party measures of teamwork yield significantly larger training effects than self-report measures¶

Claim · All claims
Evidence · 1 study · quant-synthesis r3 · q3 · i3 large
Currency · newest study 2017 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 2020: tool and model accuracy changes quickly

Subclaims¶

q3 i3 Effect sizes for third-party assessments of teamwork (d = 0.80) were significantly larger than for self-report measures (d = 0.38; Q = 6.02, p = 0.014). → McEwan D. 2017

Evidence¶

McEwan D. 2017¶

McEwan D., Ruissen G.R., Eys M.A., Zumbo B.D., Beauchamp M.R. (2017). The Effectiveness of Teamwork Training on Teamwork Behaviors and Team Performance: A Systematic Review and Meta-Analysis of Controlled Interventions. PLoS ONE. https://doi.org/10.1371/journal.pone.0169604

q3 · i3 · quant-synthesis · r3

Measurement moderator analysis (Table 3) in the teamwork pool comparing third-party versus self-report criterion measures. Both were significant, but third-party d = 0.80 exceeded self-report d = 0.38 (Q = 6.02, p = 0.014). For team performance, objective (d = 0.61) and third-party (d = 0.56) measures were both significant.

"significant improvements on teamwork emerged when either third-party (d = 0.80) or self-report (d = 0.38) measures of teamwork were utilized; the effect size for third-party measures was significantly larger (Q = 6.02, p = 0.014) than the effect size for self-report measures."

Discussion¶

Related Claims¶

• Teamwork training effects on teamwork are larger for new teams, but effects on team performance are larger for intact teams — related
• Teamwork training interventions produce significant positive effects on team performance in controlled studies — related
• Self-report factors correlate weakly with metacognitive behavior while within-factor subcomponent correlations are larger, per studies reviewed for the meta-analysis — related