Reproductive health shows the highest coverage gap (82.1% absence) and the highest judge-rated significance among divergent pairs (86%), making it a priority content area¶

Claim · All claims
Evidence · 1 study (2 entries) · associational r2 · q2
Currency · newest study 2026 · not yet checked against its sources · not reviewed by a person · recheck by 2031: baselines and conditions change

Subclaims¶

q2 i? Reproductive health has the highest absence rate of the 13 benchmark topics at 82.1% of question–handbook answers, despite being the second-largest topic (291 questions). → Yubo Li 2026 q2 i? 86% of reproductive-health divergent/contradictory pairs are judge-rated high significance, compared with 34% for mental health and 56% for lifestyle. → Yubo Li 2026 (2)

Evidence¶

Yubo Li 2026¶

Yubo Li, Rema Padman, Ramayya Krishnan. (2026). Auditing Institutional Heterogeneity for Generative AI in Patient Education: A Large-Scale Study of 102 US Transplant Handbooks. arXiv preprint. https://arxiv.org/abs/2607.22606 doi:10.48550/arxiv.2607.22606

q2 · i? · associational · r2

Topic-level coverage analysis of the production run across all 13 benchmark topics, reported in Table 4. Monitoring & Follow-up has the lowest observed absence rate at 63%, indicating the sampled handbooks alone provide limited answer coverage.

"Reproductive Health is the second-largest topic in TransplantQA (291 questions, behind Medical Complications at 319), yet has the highest absence rate: 82.1% of question–handbook answers are absent (Table 4)."

Yubo Li 2026 (2)¶

Yubo Li, Rema Padman, Ramayya Krishnan. (2026). Auditing Institutional Heterogeneity for Generative AI in Patient Education: A Large-Scale Study of 102 US Transplant Handbooks. arXiv preprint. https://arxiv.org/abs/2607.22606

q2 · i? · associational · r2

Judge-rated severity analysis across topics, shown in Appendix Figure 4 (top). The article notes this is a severity estimate conditional on disagreement, not the probability that any two answers will disagree, and that ratings are model-derived potential consequences, not observed patient harm.

"86% of reproductive-health DIVER- GENT/CONTRADICTORYpairs are judge-rated high sig- nificance, compared with 34% for mental health and 56% for lifestyle (Appendix Figure 4, top)."

Discussion¶

Related Claims¶

• Clustering judge-derived divergence topics yields 991 themes, with immunosuppression and pregnancy timing among the highest judge-rated priorities — related
• Same-center cross-organ handbook agreement exceeds different-center same-organ agreement by 0.024, but the institution contrast is sensitive to coverage thresholds and document selection — related