Existing online SRL questionnaires show reliability problems, with most having at least one scale outside the acceptable Cronbach's alpha range¶

Claim · All claims
Evidence · 1 study · design r2 · q2
Currency · newest study 2023 · not yet checked against its sources · not reviewed by a person · recheck by 2026: tool and model accuracy changes quickly

Subclaims¶

q2 i? Across reviewed online SRL measures, Cronbach's alpha of relevant scales ranged from 0.52 to 0.95, and every questionnaire except two had at least one scale outside the 0.70–0.90 range. → Broadbent 2023

Evidence¶

Broadbent 2023¶

Broadbent, J., Panadero, E., Lodge, J. M., & Fuller-Tyszkiewicz, M. (2023). The self-regulation for learning online (SRL-O) questionnaire. Metacognition and Learning, 18, 135–163. https://doi.org/10.1007/s11409-022-09319-6

q2 · i? · design · r2

The authors' review of Cronbach's alpha for relevant scales of existing online SRL questionnaires, retrieved from the original articles, found a range of 0.52 to 0.95; for example the MSLQ had help-seeking as low as 0.52 and the OSLQ had two of six subscales below 0.70.

"Every questionnaire below has at least one scale that falls outside the 0.70-0.90 range, with the exception of the Online Test Anxiety Inventory (OTAI; Alibak et al., 2019) and a measure of SRL used in MOOCs (Kizilcec et al., 2017)."

Discussion¶

Related Claims¶

• The GenAI-SRL scale shows satisfactory reliability, convergent validity, and discriminant validity across its six dimensions — related
• Questionnaire constructs showed acceptable to strong internal consistency (α = 0.740 to 0.945) — related
• The GAA-LS shows satisfactory-to-strong internal consistency and evidence of convergent and discriminant validity — related
• The MAKQ dimensions show acceptable internal consistency across both studies (alphas 0.77-0.93) — related
• The SKT-SRL shows acceptable-to-very good internal consistency across subscales — related
• TAILS dimensions show high internal consistency, with Cronbach's alpha values above 0.90 — related
• The post-interaction reflection instrument showed satisfactory internal consistency (Cronbach's α = .863) — related
• The TQsrl and SQsrl questionnaires are validated instruments measuring SRL sub-processes with emphasis on reflection — related
• No existing online SRL questionnaire covers the breadth of motivational beliefs and learning strategies the SRL-O covers — related
• The IEA-provided Instruction to Engage Students in Learning Scale has practically zero correlation to student achievement, according to IEA (2011) exhibit data cited in the article — related
• Measurement of AHS in preservice teachers is heterogeneous and often relies on brief subscales of broader SRL questionnaires with variable reliability — related