A 12-item short form of the survey retains acceptable-to-good reliability (alpha = 0.85; test-retest = 0.75)¶

Claim · All claims
Evidence · 1 study (2 entries) · design r3 · q2
Currency · newest study 2023 · not yet checked against its sources · not reviewed by a person · recheck by 2026: tool and model accuracy changes quickly

Subclaims¶

q2 i? The reduced 12-item survey achieved coefficient alpha of 0.85 and test-retest reliability of 0.75. → Kao 2023 q2 i? All but two items on the final 12-item survey had item-total correlations greater than 0.40, and none detracted from internal consistency. → Kao 2023 (2)

Evidence¶

Kao 2023¶

Kao, Y., Murphy, D., Hubbard Cheuoua, A., Kannan, P., Tsan, J., Jennings, K. E., Smith, H., Emanuel, S., & Miller, E. R. (2023). Survey development for assessing student computing career intentions: Technical report. WestEd. https://eric.ed.gov/?id=ED638631

q2 · i? · design · r3

Reliability computation for the 12-item short form selected from the field-test data. The article reports alpha of 0.85, which it calls unexpectedly high given the item count; no effect size is printed.

"Coefficient alpha for the reduced survey is 0.85, and remains in the good-to-adequate range as well."

Kao 2023 (2)¶

Kao, Y., Murphy, D., Hubbard Cheuoua, A., Kannan, P., Tsan, J., Jennings, K. E., Smith, H., Emanuel, S., & Miller, E. R. (2023). Survey development for assessing student computing career intentions: Technical report. WestEd. https://eric.ed.gov/?id=ED638631

q2 · i? · design · r3

The same short-form evaluation reports test-retest reliability of 0.75 and item discrimination statistics for the 12 selected items, computed from the field-test and retest samples.

"The test–retest reliability for the 12-item survey is 0.75. In addition, all but two items on the final survey had item–total correlations greater than 0.40, and therefore good discrimination properties, and none of these 12 items were found to detract from internal consistency"

Discussion¶

Related Claims¶

• The full 32-item computing career intentions survey shows very good internal consistency (alpha = 0.94) in a large-scale field test — related
• The full survey's test-retest reliability coefficient is 0.79, considered acceptable bordering on good — related
• CTAT shows robust psychometric properties for higher education CS/AI students, with reliable internal consistency and adequate IRT item parameters — related
• CMS shows acceptable test-retest reliability and internal consistency — related
• Self-efficacy measures show high reliability and domain-specific validity — related