The full survey's test-retest reliability coefficient is 0.79, considered acceptable bordering on good¶

Claim · All claims
Evidence · 1 study · design r3 · q2
Currency · newest study 2023 · not yet checked against its sources · not reviewed by a person · recheck by 2026: tool and model accuracy changes quickly

Subclaims¶

q2 i? In a test-retest study with 112 analyzed responses collected 1 to 2 months after the initial survey, the full survey's reliability coefficient was 0.79. → Kao 2023

Evidence¶

Kao 2023¶

Kao, Y., Murphy, D., Hubbard Cheuoua, A., Kannan, P., Tsan, J., Jennings, K. E., Smith, H., Emanuel, S., & Miller, E. R. (2023). Survey development for assessing student computing career intentions: Technical report. WestEd. https://eric.ed.gov/?id=ED638631

q2 · i? · design · r3

The test-retest study re-administered the survey to a stratified subsample 1 to 2 months after initial response; 112 responses remained after data cleaning. The article reports a coefficient of 0.79, "considered acceptable bordering on good"; no effect size is printed.

"The correlation between the participants’ scores from both survey administrations is used as the estimate of test–retest reliability. A correlation coefficient greater than 0.9 represents excellent reliability, between 0.9 and 0.8 represents good reliability, and between 0.8 and 0.7 represents acceptable reliability. The full survey test–retest reliability coefficient is 0.79, which is considered acceptable bordering on good."

Discussion¶

Related Claims¶

• The full 32-item computing career intentions survey shows very good internal consistency (alpha = 0.94) in a large-scale field test — related
• A 12-item short form of the survey retains acceptable-to-good reliability (alpha = 0.85; test-retest = 0.75) — related
• Self-efficacy measures show high reliability and domain-specific validity — a broader claim this one bears on
• CMS shows acceptable test-retest reliability and internal consistency — related