Balanced 192-text evaluation dataset of EFL, professional, AI-generated, and hybrid texts¶
Product or Programme · All products and programmes
Evidence · 6 claims (5 for, 1 mixed) · 2 studies (1 review, 1 design),q2–q3· 0 of 2 report an effect size · 6 claims rest on one study
Description¶
A research dataset created by Mohammad Hadra et al. containing 192 balanced EFL, professional, AI-generated, and hybrid texts for evaluating authorship-detection and academic-integrity decisions.
Components¶
Claims¶
- Originality outperformed Turnitin in overall accuracy and macro-average recall on a balanced EFL-relevant dataset, but both showed limited consistency across classes [+W]
- Both detectors performed poorly on hybrid human–AI texts, with Originality showing near-zero recall for the Hybrid class [+W]
- Both detectors achieved substantially lower accuracy on scientific writing than on humanities texts [+W]
- Detector accuracy declined significantly as text length increased, with both detectors performing best on short texts [+W]
- Originality showed a borderline non-significant trend toward higher accuracy on professional than EFL student writing, while Turnitin showed no significant difference [+W]
- A detector can achieve high aggregate accuracy while producing materially different over-detection rates across author groups [~W]
Related Products and Programmes¶
Key Sources¶
- Mohammad Hadra, Karleen Cambridge and Mostefa Mesbah. (2026). Evaluating the accuracy and reliability of AI content detectors in academic contexts. International Journal for Educational Integrity. https://doi.org/10.1007/s40979-026-00213-1
Page metadata
| Field | Value |
|---|---|
type |
product |
id |
balanced-192-text-evaluation-dataset-of-efl-professional-ai-generated-and-hybrid-texts |
title |
Balanced 192-text evaluation dataset of EFL, professional, AI-generated, and hybrid texts |
description |
A research dataset created by Mohammad Hadra et al. |
status |
review |
product_kind |
dataset |
generated |
by process:settle-candidates on 2026-10-11 |
trust |
unverified — no one has confirmed this page's content |
Frontmatter is the page's machine-readable record — see the Schema & Guide.