Expert review establishes excellent content validity for TAILS (S-CVI/Ave = 0.98; I-CVI 0.86–1.00)¶

Claim · All claims
Evidence · 1 study · design r2 · q3
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person · recheck by 2029: tool and model accuracy changes quickly

Subclaims¶

q3 i? Seven expert reviewers rated all 30 TAILS items with I-CVI values from 0.86 to 1.00 and a scale-level S-CVI/Ave of 0.98, exceeding the excellent-content-validity threshold. → Salim Nabhan 2026

Evidence¶

Salim Nabhan 2026¶

Salim Nabhan, Anita Habók. (2026). Language teachers' AI literacy: A psychometric study based on the ED-AI framework. Computers and Education: Artificial Intelligence 10 (2026) 100583. https://doi.org/10.1016/j.caeai.2026.100583

q3 · i? · design · r2

Mixed quantitative–qualitative expert review with seven experts in teacher education rating items on a 4-point relevance scale. "The S-CVI/Ave for the entire scale was 0.98"; I-CVI ranged 0.86–1.00, S-CVI 0.94–1.00, S-CVI/UA 0.87, modified kappa 0.86–1.00.

"The S-CVI/Ave for the entire scale was 0.98, exceeding the threshold for excellent content validity."

Discussion¶

Related Claims¶

• MCQs generated by the generate-then-validate SLM pipeline are generally answerable and unambiguous, as judged by seven human experts — related
• Three independent expert instructors reached exceptionally high inter-rater reliability when grading 1200 bash exam responses, establishing a reliable human reference standard — related
• TAILS dimensions show high internal consistency, with Cronbach's alpha values above 0.90 — related