Revising texts to improve readability-formula scores often produces nonexistent or insignificant comprehension gains¶

Claim · All claims
Evidence · 1 study · review r3 · q2
Currency · newest study 1991 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? When materials are revised to make them more readable by formula, gains in comprehension are often either nonexistent or insignificant. → Mary H. Sawyer 1991

Evidence¶

Mary H. Sawyer 1991¶

Mary H. Sawyer. (1991). A Review of Research in Revising Instructional Text. Journal of Reading Behavior. https://doi.org/10.1080/10862969109547744

q2 · i? · review · r3

The review reports, citing Duffy and Kabance (1982) among others, that a readable-writing approach to revision "failed to produce practical improvements in comprehension on several reading-to-do tasks" even after a reduction of six grade levels.

"when materials are revised to make them more "readable," gains in comprehension are often either nonexistent or insignificant"

Discussion¶

Related Claims¶

• In the random forest, word count was the most important readability feature while traditional readability formulas ranked near the bottom — related
• Iterative prompting to revise overly complex responses raised readability alignment, with most regenerated responses falling at or below target grade levels — related
• PPB maintained comparable readability on three of four measures while increasing Flesch-Kincaid toward grade level — related
• Rewriting MATHia word problems for struggling readers, by human experts or LLMs, sped completion by 30% and improved mastery rate — reports the opposite
• Product measures distinguish LLM-formulated text from classroom-formulated text regardless of how it was entered — related
• The three fine-tuned LLMs differ significantly in response length, readability, and similarity to posts — related
• Type-token ratio showed a non-monotonic relationship with predicted difficulty, with both very low and very high lexical diversity increasing predicted text difficulty — related