Perceived usability of the TARGET-tool improved from mid-term (SUS 57.3) to the end of the experimental phase (SUS 67.0), a medium effect that was not statistically significant¶

Claim · All claims
Evidence · 1 study · design r2 · q2
Currency · newest study 2024 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? Mean SUS scores rose from 57.3 at mid-term to 67.0 at the end of the experimental phase, representing a medium effect size (g = 0.47) that was not statistically significant (p = 0.38). → Weeldenburg 2024

Evidence¶

Weeldenburg 2024¶

Weeldenburg, G., Slingerland, M., Borghouts, L. B., Kromkamp, L., van Dijk, B., van der Born, E., & Vos, S. (2024). Evaluation of the digital teacher professional development TARGET-tool for optimizing the motivational climate in secondary school physical education. Education Tech Research Dev. https://doi.org/10.1007/s11423-024-10379-5

q2 · i? · design · r2

Quantitative SUS administration with 10 PE teachers at mid-term and end of a 4–6 week implementation, analyzed with a paired sample t-test and Hedges' g. Scores indicated usability considered ‘OK’, with a medium effect size (g = 0.47) that was not statistically significant (p = 0.38).

"The total mean SUS score at mid-term was 57.3 (SD = 20.7) and at the end of the experimental phase 67.0 (SD = 21.2) out of 100. These scores indicate that the perceived usability of the tool can be considered ‘OK’ (Bangor et al., 2009). The mean increase represents a medium effect size (g = 0.47). However, the change was not statistically significant (p = 0.38)."

Discussion¶

Related Claims¶

• The system receives a good average usability rating (SUS 69.7, grade B) but with wide individual variation, which the authors take to suggest UI consistency issues — related