ASR-based item-level passage reading speed scores correlate moderately to strongly with human transcriber speed scores¶

Claim · All claims
Evidence · 1 study · associational r2 · q2 · i3 large
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i3 ASR and human speed scores correlated r = 0.61 (transcriber 1), r = 0.57 (transcriber 2) and r = 0.59 (both transcribers). → van der Velde 2025

Evidence¶

van der Velde 2025¶

van der Velde, M., Harmsen, W., Veldkamp, B. P., Feskens, R., Keuning, J., & Swart, N. (2025). Speech Enabled Reading Fluency Assessment: a Validation Study. International Journal of Artificial Intelligence in Education. https://doi.org/10.1007/s40593-025-00480-y

q2 · i3 · associational · r2

Correlational validation of passage reading item-level speed scores against orthographic transcriptions by two Linguistics graduates using PRAAT; item-level speed was defined as the duration of the final reading attempt for a prompt. Correlations of r = 0.61, r = 0.57 and r = 0.59 all exceed the r = 0.37 threshold for a large correlation.

"We found moderate to strong correlations between the ASR and transcriber 1 (r = 0.61), transcriber 2 (r = 0.57) and both transcribers (r = 0.59)."

Discussion¶

Related Claims¶

• ASR-based item-level accuracy scores show moderate agreement with human raters in a Dutch word decoding and passage reading task — related
• Reliability of the ASR-based word decoding and passage reading accuracy and speed measures is excellent, ranging from 0.96 to 1 — related