Registered report authors report more constructive review, greater candor about findings, and time savings¶

Claim · All claims
Evidence · 1 study (2 entries) · theoretical r3 · q1
Currency · newest study 2021 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q1 i? Authors of registered reports in an education special topic reported that reviewers were more constructive and curious about design decisions when reviewers did not know the findings. → Preregistration and Registered Reports 2021 q1 i? Authors reported the format let them candidly describe null effects, confounds, and uncertainties, and saved analysis time by avoiding repeated re-analyses for reviewers. → Preregistration and Registered Reports 2021 (2)

Evidence¶

Preregistration and Registered Reports 2021¶

Preregistration and Registered Reports. (2021). https://osf.io/ya594

q1 · i? · theoretical · r3

Self-report evidence gathered from authors publishing in the AERA Open registered reports special topic, as reported by Reich et al. (2020). The article hedges that "these statements will not be true for every researcher in every study context".

"Registered report authors report that they find that reviewers are more constructive and more curious about research design decisions when they, too, do not know what the findings will be (Reich et al., 2020)."

Preregistration and Registered Reports 2021 (2)¶

Preregistration and Registered Reports. (2021). https://osf.io/ya594

q1 · i? · theoretical · r3

The article's account of author experiences in its special topic, including one team's report that they "saved so much time on analyses" by not redoing analyses for reviewers. These are author self-reports, not measured outcomes.

"After receiving an in-principle acceptance, researchers can report their findings and be straightforward about null effects, possible confounds, and additional possible interpretations."

Discussion¶

Related Claims¶

• People significantly underestimate AI-assisted completion times on simple cognitive tasks, even though AI assistance saves little or no actual time (the speedup illusion) — related