Publication bias is detected in the cross-sectional data set, and bias-corrected estimates are highly heterogeneous¶

Claim · All claims
Evidence · 1 study · quant-synthesis r3 · q3
Currency · newest study 2023 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i? Modified Egger's tests and a 3-parameter selection model both detect significant small-study effects in the cross-sectional data, and correction yields highly heterogeneous adjusted estimates. → Benoit Bediou 2023

Evidence¶

Benoit Bediou 2023¶

Benoit Bediou, Melissa A. Rodgers, Elizabeth Tipton, Richard E. Mayer, C. Shawn Green, and Daphne Bavelier. (2023). Effects of Action Video Game Play on Cognitive Skills: A Meta-Analysis. Technology, Mind, and Behavior. https://doi.org/10.1037/tmb0000102

q3 · i? · quant-synthesis · r3

Publication bias detection in the cross-sectional meta-analysis using modified Egger's regression with the CHE model and a 3-parameter selection model; the NULL model shows "β = 2.10, SE = 0.59, t(17.0) = 3.57, p = .002" and the FULL model is also significant (p = .008).

"The modified Egger 's tests showed significant small-study effects, indicating signs of publication bias, both in the model without moderators used to assess the average impact of action video game experience on cognition, NULL model, β = 2.10, SE = 0.59, t(17.0) = 3.57, p = .002"

Discussion¶

Related Claims¶

• Egger's test indicates asymmetry bias in the cross-sectional ToM–achievement evidence base despite a right-skewed p-curve — possibly the same claim (merge candidate)
• A cluster-robust Egger-type test found no statistically detectable small-study effects, interpreted as absence of evidence rather than evidence of no publication bias — related
• No significant moderators of the action video game effect were found in either meta-analysis
• Evidence of publication bias exists, but the pooled video effects are robust to it — related
• GenAI effects on externally assessed learning are highly heterogeneous and conditional on prior knowledge, scaffolding, verification, and task design, with pooled effects unstable under publication-bias correction — related
• Evidence of small-study effects exists for cognition and motivation, but trim-and-fill adjustment leaves the moderate motivating effect essentially unchanged — related
• The bias-adjusted mean moderator effect in STEM education meta-analyses is g = 0.27 with substantial heterogeneity, and the published record shows overwhelming evidence of publication-bias-type selection — related
• Publication-bias tests (Egger's test and trim-and-fill) indicate absence of publication bias for the overall effect and moderators — related
• The included scaffolding studies show small-study effects, which the Bayesian approach addresses by shrinking overweighted effect sizes — related
• No evidence of dissemination bias was detected in the meta-analysis — reports the opposite
• Formal tests find no substantial evidence of publication bias or small-study effects in the meta-analysis — related