Trim-and-fill publication-bias analysis procedure applied to learning-effectiveness meta-analysis¶

Element · All elements
Evidence · no claims cited

Description¶

The article applies the trim and fill method (Duval & Tweedie) as its publication-bias analysis procedure within a five-step meta-analysis pipeline: effect size calculation, heterogeneity testing, summary effect calculation, forest-plot analysis, and funnel-plot bias analysis. The article describes the mechanism: "The trim and fill method uses an iterative procedure to eliminate the most extreme small studies from the funnel plot's positive side and recalculate each iteration's effect size until the funnel plot becomes symmetrical." Symmetry of the funnel plot indicates no publication bias; asymmetry would indicate bias. The procedure was implemented with JASP software for the forest plot and R software for the summary effect.

Design Implications¶

Context¶

Requirements¶

• Effect size and standard error for each research data based on a random-effects model
• Funnel-plot identification of extreme small studies on the positive side

Constraints¶

• The article states the limitation that grouped research came from published journal results without attention to publication status

Target Learners¶

• junior high school students

Target Learning Goals¶

• mathematical problem-solving ability

Claims¶

Related Elements¶

Examples¶

• Follow transparent, replicable meta-analysis practices tailored to PBL: multiple databases, gray literature, full heterogeneity reporting, funnel plots with Egger's test, and RVE for dependent outcomes

Key Sources¶

• Ridwan, M. R., Retnawati, H., Hadi, S., & Jailani (2021). The effectiveness of innovative learning on mathematical problem-solving ability: A meta-analysis. International Journal of Research in Education and Science (IJRES), 7(3), 910-932. https://doi.org/10.46328/ijres.2287