The POET-O demonstrates adequate construct validity and reliability for peer evaluation of single online lessons¶
Claim · All claims
Evidence · 1 study · designr2·q2
Currency · newest study 2025 · checked against its sources 2026-10-29 (automated, 1 of 1 entry) · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? The POET-O demonstrates adequate construct validity and reliability as a peer evaluation measure of single online lessons. → Jia 2025
Evidence¶
Jia 2025¶
Jia, Y., Spagnolo, A. B., Barrett, N., Murphy, A. A., Basto, P. M., Rothpletz-Puglia, P., & Luther, S. (2025). Validation of a peer observation and evaluation tool for online teaching in the U.S. Education Tech Research Dev. https://doi.org/10.1007/s11423-024-10428-z
q2 · i? · design · r2
Pilot validation study using many-facet Rasch measurement on faculty peer ratings in a school of health professions: 26 reviewers were randomly assigned to evaluate 14 asynchronous lessons, and 22 reviewers to evaluate 12 synchronous lessons (26 lessons in all). The authors conclude the tool is a "reliable and valid peer observation measure of both online synchronous and asynchronous lessons."
"Based on the Rasch model analyses, overall, the modified POET-O is a reliable and valid peer observation measure of both online synchronous and asynchronous lessons."
Discussion¶
Related Claims¶
- ADA accessibility items were the most difficult and impacted the POET-O's construct validity — related
- Asynchronous lessons were rated higher than synchronous lessons on the POET-O — related
- The 4-category rating scale of the POET-O functions properly overall but its threshold structure could be improved — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
poet-o-valid-reliable-peer-evaluation-online-lessons |
title |
The POET-O demonstrates adequate construct validity and reliability for peer evaluation of single online lessons |
description |
The POET-O demonstrates adequate construct validity and reliability for peer evaluation of single online lessons |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2025 |
source_checked |
2026-10-29 |
generated |
by process:wiki-ingest on 2026-10-28 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — jia-2025 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.