The parabola achievement test used was a 27-item open-ended instrument with high internal consistency (Cronbach's alpha 0.942) and near-perfect inter-rater agreement¶

Claim · All claims
Evidence · 1 study · causal r1 · q3
Currency · newest study 2018 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 2021: tool and model accuracy changes quickly

Subclaims¶

q3 i? The final PAT consisted of 27 open-ended questions with Cronbach's alpha of 0.942 and a Cohen's Kappa agreement of 0.846 between evaluators. → Mehmet Alper Ardıç; Tevfik İşleyen 2018

Evidence¶

Mehmet Alper Ardıç; Tevfik İşleyen 2018¶

Mehmet Alper Ardıç; Tevfik İşleyen (2018). The Effect of Mathematics Instruction through Computer Algebra Systems on the Academic Achievements of Secondary Education Students: Turkey Example. Journal of Education and e-Learning Research, 5(3): 165-173. https://doi.org/10.20448/journal.509.2018.53.165.173

q3 · i? · causal · r1

Test development with a pilot on 128 10th-grade students from three schools; a 32-item draft was reduced to 28 after expert review, and one non-discriminating blank-filling item was removed after 27% upper-lower group item analysis, yielding "27 open-ended questions as its final state".

"In consideration of the data obtained from the pilot study, Cronbach's Alpha internal consistency coefficient of the test has been calculated 0.942. Thereby, it has been decided that the PAT, which is consisted of 27 open-ended questions as its final state, is reliable to use in the research."

Discussion¶

Related Claims¶

• Computer-assisted mathematics instruction through a computer algebra system at the transformation level produces higher parabola achievement than traditional teaching with ICT at the replacement level — related
• Before instruction, the experimental and control groups showed no statistically significant differences in mathematics report grades or parabola pretest scores — related
• GPT-4 achieved almost perfect inter-rater reliability with faculty after three iterations of rubric engineering on three of four medical school OEQ questions — related
• The AEEGS software demonstrated internal consistency of Cronbach alpha 0.86 in trial testing and was validated for face and content validity by three software experts — related
• A fine-tuned BERT model achieves almost perfect agreement with human coders when classifying student self-affirmation essays, matching human-human reliability — related
• Three independent expert instructors reached exceptionally high inter-rater reliability when grading 1200 bash exam responses, establishing a reliable human reference standard — related