Report complete statistical data and use standardized success tests to enable future meta-analysis¶

Strategy · All strategies
Evidence · no claims cited

Description¶

Based on problems encountered while screening studies, the authors recommend that researchers report statistical operations to international standards and use standardized outcome measures. The article observes that "It was observed in the reviewed 96 studies that the success tests are not standardized" and that missing totals, standard deviations, means or sample sizes excluded many studies; it states "It is highly important to write statistical operations in conformity to international standards for these issues to be overcome."

Design Implications¶

Context¶

Requirements¶

• Researchers must report sample size, arithmetic mean and standard deviation (or convertible statistics) for each comparison
• Success tests should be standardized rather than researcher-developed tests of differing quality

Constraints¶

• The recommendation arises from the Turkish language instruction literature reviewed for this meta-analysis (2000–2016)

Target Learners¶

• researchers conducting experimental studies in Turkish language instruction

Target Learning Goals¶

• improving the quality and meta-analytic usability of research on teaching methods in Turkish language instruction

Related Strategies¶

• Include comparison groups and report means, standard deviations, and sample sizes in service-learning research
• Design future TFA studies to meet evidence standards and compare like-for-like teachers so effect sizes can enter meta-analysis
• Direct future self-regulation research toward standard methods of reporting SR outcomes to address substantial heterogeneity in outcome measures.
• Adopt standardized reporting protocols for AR enhanced analytics studies and extend analytics into broader XR (VR/MR) contexts
• Develop standardized, unified narrative medicine curricula to improve study comparability
• Use validated homogeneous outcome measures, preferably in a patient setting, in future FB SBT studies

Examples¶

-

Key Sources¶

• Nurşat Biçer. (2017). The Influence of Student-centered Methods in Turkish Language Instruction on Academic Success: A Meta-analysis Study. Universal Journal of Educational Research 5(4). https://doi.org/10.13189/ujer.2017.050419