CSCL scripts have a small significant positive effect on domain learning compared to unstructured collaborative learning¶

Claim · All claims
Evidence · 2 studies (3 entries) · 2 quant-synthesis r2 · q3 · i1 small
Currency · newest study 2020 · checked against its sources 2026-10-20 (automated, 3 of 3 entries) · not reviewed by a person

Subclaims¶

q3 i1 Learning with CSCL scripts yields a small significant positive summary effect on domain learning (Hedges' g = 0.24). → Radkowitsch 2020 q3 i1 The positive effect holds for both recall tests (g = 0.27) and application tests (g = 0.21), but not for mixed tests (g = 0.09, non-significant). → Radkowitsch 2020 (2)

q3 i1 Collaborative learning with a CSCL script produces a statistically significant small positive average effect on domain-specific knowledge relative to collaborative learning without a script. → Freydis Vogel 2016

Evidence¶

Radkowitsch 2020¶

Radkowitsch, A., Vogel, F., & Fischer, F. (2020). Good for learning, bad for motivation? A meta-analysis on the effects of computer-supported collaboration scripts. International Journal of Computer-Supported Collaborative Learning, 15, 5–47. https://doi.org/10.1007/s11412-020-09316-4

q3 · i1 · quant-synthesis · r2

Random-effects meta-analysis of 124 domain-learning effects (54 independent) from experimental comparisons of CSCL-scripted versus unguided collaborative learning; "a small significant positive summary effect, with Hedges' g of 0.24". Heterogeneity was significant (Q = 101.77, df = 53, p < .001) but low by the authors' own criteria (I2 = 46.23% per Table 2; 25–49% counts as low).

"In total, we examined 124 effects of CSCL scripts on domain learning, of which 54 were independent. Overall, the meta-analysis resulted in a small significant positive summary effect, with Hedges' g of 0.24."

Radkowitsch 2020 (2)¶

Radkowitsch, A., Vogel, F., & Fischer, F. (2020). Good for learning, bad for motivation? A meta-analysis on the effects of computer-supported collaboration scripts. International Journal of Computer-Supported Collaborative Learning, 15, 5–47. https://doi.org/10.1007/s11412-020-09316-4

q3 · i1 · quant-synthesis · r?

Moderator analysis distinguishing domain-learning measure types: significant effects for "recall tests (Hedges' g = 0.27)" and "application tests (Hedges'g = 0.21)", with mixed tests non-significant at g = 0.09.

"CSCL scripts showed small significant positive effects on both recall tests (Hedges' g = 0.27) and application tests (Hedges'g = 0.21). Studies reporting mixed tests for domain learning yielded a positive but non-significant summary effect of Hedges' g = 0.09"

Freydis Vogel 2016¶

Freydis Vogel, Christof Wecker, Ingo Kollar, Frank Fischer. (2016). Socio-Cognitive Scaffolding with Computer-Supported Collaboration Scripts: a Meta-Analysis. Educ Psychol Rev. https://doi.org/10.1007/s10648-016-9361-7

q3 · i1 · quant-synthesis · r?

Random-effects meta-analysis of 33 effect sizes from 21 articles comparing CSCL-script conditions to unstructured CSCL. The synthesis found a statistically significant positive, although small, average effect; Table 1 reports d = 0.20 with a statistically significant test (z = 2.08, p = .019).

"As hypothesized, a statistically significant positive, although small, average effect was found (see Table 1). Post hoc power analysis revealed that the statistical power of this test was 87 %."

Discussion¶

Related Claims¶

• The editorial reports that a meta-analysis of 53 primary studies found CSCL collaboration scripts had a non-significant positive effect on motivation, countering criticism that scripts harm motivation
• The effect of CSCL scripts on collaboration skills is significantly greater than their effect on domain-specific knowledge — related
• A meta-analysis of 20 studies found a large effect (Hedges' g = 0.871) for CTA use in training design — related
• Learning with CSCL scripts yields a large positive effect on collaboration skills compared to unstructured CSCL — related
• CSCL collaboration scripts substantially improve domain-specific and collaborative-skill outcomes compared with unstructured CSCL — a broader claim this one bears on
• The editorial reports that CSCL scripts show positive effects on domain learning and collaboration process skills, and that scaffolding single versus combinations of collaborative activities affects script impact — a broader claim this one bears on
• CSCL scripts have a medium significant positive effect on collaboration skills compared to unstructured collaborative learning — related
• The effectiveness of CSCL scripts for domain learning does not significantly depend on the number of different collaborative activities prompted — related
• Scripts scaffolding coordination alone or negotiation with information sharing show the largest domain-learning effects, while three-way combinations show smaller significant effects — a narrower finding that bears on this claim