The full 32-item computing career intentions survey shows very good internal consistency (alpha = 0.94) in a large-scale field test¶

Claim · All claims
Evidence · 1 study · design r2 · q2
Currency · newest study 2023 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? In a large-scale field test with 552 analyzed responses, the survey's coefficient alpha of 0.94 falls in the very good range. → Kao 2023

Evidence¶

Kao 2023¶

Kao, Y., Murphy, D., Hubbard Cheuoua, A., Kannan, P., Tsan, J., Jennings, K. E., Smith, H., Emanuel, S., & Miller, E. R. (2023). Survey development for assessing student computing career intentions: Technical report. WestEd. https://eric.ed.gov/?id=ED638631

q2 · i? · design · r2

Classical item analysis of the large-scale field test (552 retained responses after data cleaning) computed coefficient alpha for the full survey. The article reports that "the survey’s alpha estimate of 0.94 is very good", and that no item significantly contributed to or detracted from internal consistency.

"Alpha values greater than or equal to 0.6 are generally considered acceptable, and values between 0.8 and 0.95 are considered very good. Using those guidelines, the survey’s alpha estimate of 0.94 is very good."

Discussion¶

Related Claims¶

• A 12-item short form of the survey retains acceptable-to-good reliability (alpha = 0.85; test-retest = 0.75) — related
• Survey items show good discrimination overall, but several items exhibit ceiling effects that limit measuring change over time — related
• The full survey's test-retest reliability coefficient is 0.79, considered acceptable bordering on good — related
• Self-efficacy measures show high reliability and domain-specific validity — a broader claim this one bears on
• The post-study survey instrument showed high internal consistency (alpha = 0.90) — related