The final indicator system shows good reliability (ICC = 0.86) and content validity (S-CVI = 0.92; I-CVI 0.85–1.00)¶

Claim · All claims
Evidence · 1 study · design r2 · q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person · recheck by 2029: tool and model accuracy changes quickly

Subclaims¶

q2 i? Inter-rater agreement on the 63-indicator scale was good (ICC = 0.86, 95% CI: 0.79–0.91) and content validity exceeded recommended standards (S-CVI 0.92; I-CVI 0.85–1.00). → Song Xu 2026

Evidence¶

Song Xu 2026¶

Song Xu, Jia Qingjun, Li Qingchun, Huang Yinyan, Dai Ruoqi and Cheng Qinglin. (2026). Development of a personal competency evaluation indicator system for tuberculosis health educators: a scoping review and Delphi study. Frontiers in Public Health. https://doi.org/10.3389/fpubh.2026.1861732

q2 · i? · design · r2

Reliability and validity analysis based on the second-round importance ratings of the final 63 indicators by 20 experts. The article reports "the intraclass correlation coefficient (ICC) was 0.86 (95% CI: 0.79–0.91)" and an S-CVI of 0.92 with I-CVI ranging from 0.85 to 1.00.

"the intraclass correlation coefficient (ICC) was 0.86 (95% CI: 0.79–0.91), indicating good inter-rater agreement."

Discussion¶

Related Claims¶

• Expert review establishes excellent content validity for TAILS (S-CVI/Ave = 0.98; I-CVI 0.86–1.00) — related
• In Study 2, inter-rater agreement for rating creative problem solving ideas was good to excellent across indicators — related
• Trained scorers applied the historical thinking skills rubrics with good overall inter-rater consistency — related
• Structured viva shows significant inter-rater reliability between examiner pairs (r = 0.78 to 0.91) and high inter-rater agreement (86.7%) — related