Checklist 2: reporting data collection training and quality¶

Element · All elements
Evidence · no claims cited

Description¶

The second checklist addresses "data collection training and quality," prompting researchers to report how data collectors were trained and what quality procedures were followed. As one of the brief's five checklists, it targets a distinct information need readers have when judging the credibility of measurement in an education study. It is applied when drafting or checking the completeness of a report's methods section.

Design Implications¶

Context¶

Requirements¶

• Data collection procedures and training must exist to be reported

Constraints¶

Target Learners¶

• education researchers preparing reports of studies using measures

Target Learning Goals¶

• transparent reporting of data collection training and quality procedures

Affordances¶

• Five Checklist Measures Reporting Guide

Related Elements¶

• Checklist 1: describing the study's measures
• Checklist 5: reporting missing data and descriptive statistics
• Checklist 3: reporting reference population, study sample, and measurement timing
• Checklist 4: reporting evidence of reliability and construct validity

Examples¶

• Use the checklists against a draft methods and results section to check completeness of reporting

Key Sources¶

• Kimberly Boller, Ellen Eliason Kisker. (2014). Reporting What Readers Need to Know About Education Research Measures: A Guide. Washington, DC: U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance. https://www.mathematica.org/publications/reporting-what-readers-need-to-know-about-education-research-measures-a-guide