External validity and rigour tend to be negatively assessed in TEL research¶

Claim · All claims
Evidence · 1 study · review r3 · q2
Currency · newest study 2024 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? External validity was assessed 34 times with only one positive conclusion; 28 of the 33 negative assessments cited focus on one educational context. → Haastrecht 2024

Evidence¶

Haastrecht 2024¶

Haastrecht, M. A. N. van, Haas, M., Brinkhuis, M. J. S., & Spruit, M. R. (2024). Understanding validity criteria in technology-enhanced learning: a systematic literature review. Computers & Education. https://doi.org/10.1016/j.compedu.2024.105128

q2 · i? · review · r3

Review analysis of external validity assessments across included TEL studies: "External validity was assessed 34 times, with only one study reaching a positive conclusion", with most negative assessments citing single-context designs.

"External validity was assessed 34 times, with only one study reaching a positive conclusion. Of the 33 negative assessments, 28 times researchers mentioned that that their study focused on one educational context, and that this implies their results do not generalise to other contexts."

Discussion¶

Related Claims¶

• Effectiveness and statistical validity are the most commonly assessed validity criteria in TEL research — related
• Validity criteria assessed with quantitative methods tend to be assessed more positively than those assessed with qualitative methods — related
• Use of evaluation and validation frameworks in TEL research is rare and fragmented — related
• The prevalence and epistemological positioning of TEL validity criteria are stable over time — related