ADA accessibility items were the most difficult and impacted the POET-O's construct validity¶

Claim · All claims
Evidence · 1 study · design r2 · q2
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? The ADA Accessibility items were the most difficult items on the POET-O and impacted the instrument's construct validity, with faculty reviewers reporting insufficient expertise to rate them. → Jia 2025

Evidence¶

Jia 2025¶

Jia, Y., Spagnolo, A. B., Barrett, N., Murphy, A. A., Basto, P. M., Rothpletz-Puglia, P., & Luther, S. (2025). Validation of a peer observation and evaluation tool for online teaching in the U.S. Education Tech Research Dev. https://doi.org/10.1007/s11423-024-10428-z

q2 · i? · design · r2

In the MFRM analysis, items 14, 15, and 16 (ADA Compliance/Accessibility) grouped as a separate construct outside the ±0.4 loading range. The authors report these "were the most difficult questions and impacted the construct validity."

"The ADA Accessibility items were the most difficult questions and impacted the construct validity (e.g., unidimensionality) of the instrument. Also, faculty in this pilot study reported lack of expertise in rating the ADA Accessibility items."

Discussion¶

Related Claims¶

• The POET-O demonstrates adequate construct validity and reliability for peer evaluation of single online lessons — related
• Asynchronous lessons were rated higher than synchronous lessons on the POET-O — related
• The 4-category rating scale of the POET-O functions properly overall but its threshold structure could be improved — related