Some students struggled to use Ecree's and MI Write's automated feedback¶
Claim · All claims
Evidence · 1 study · reviewr?·q2
Currency · newest study 2023 · checked against its sources 2026-10-15 (automated, 1 of 1 entry) · not reviewed by a person · recheck by 2026: tool and model accuracy changes quickly
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? Some students in the studied classrooms struggled to use the automated feedback provided by Ecree and MI Write. → Connor Rooney 2023
Evidence¶
Connor Rooney 2023¶
Connor Rooney, Adam Dunn. (2023). Using Automated Writing Feedback Tools in the Classroom: Research Insights for Tool Designers and Instructional Support Teams. Mathematica. https://www.mathematica.org/publications/using-automated-writing-feedback-tools-in-the-classroom-research-insights-for-tool-designers
q2 · i? · review · r?
Key finding from the brief's synthesis of the Ecree and MI Write studies: "Some students struggled to use Ecree’s and MI Write’s automated feedback," indicating student-facing usability limits of the tools.
"Some students struggled to use Ecree’s and MI Write’s automated feedback."
Studies bearing on this claim¶
Does the amount of feedback a learner receives at once overwhelm some learners, and what reduces it? This table gathers the studies behind this claim and the 4 narrower claims that bear on it: 5 distinct studies (2 review, 1 associational, 1 qualitative, 1 theoretical), q1–q3, 0 of 5 with an effect size coded. One row per study, codes as each entry records them; no effect is averaged and no verdict is drawn. Built by scripts/synthesize_claim.py from eval/synthesis/; a row that looks wrong is fixed on the claim it comes from.
| Study | Design | Effect as recorded | Bears on this claim through |
|---|---|---|---|
| Connor Rooney 2023 | q2 · review · r? | i? | this claim |
| Tareena Musaddiq 2023 | q2 · associational · r? | i? | More than half of surveyed teachers agreed Ecree was useful for improving students' writin (qualifies) |
| Isabel Callaway 2023 | q2 · qualitative · r? | i? | Students need clear guidance so they are not overwhelmed by Ecree's feedback, which may be (qualifies) |
| Bradley Irwin and Theron Muller 2026 | q1 · theoretical · r3 | i? | The Synthesizer is expected to reduce perceived overload and support affect relative to un (supports) |
| Marcin Jukiewicz and Michał Wyrwa 2026 | q3 · review · r3 | i? | LLM-generated feedback is more comprehensive in volume than human feedback but is sometime (qualifies) |
Discussion¶
Related Claims¶
- Some students may be overwhelmed by Ecree's feedback about their writing — related
- Teachers reported curriculum and technical integration challenges when implementing Ecree and MI Write — related
- Teachers found Ecree and MI Write useful for their writing instruction and for helping students improve their writing — related
- Regular and tailored support helped teachers integrate Ecree and MI Write into their teaching — related
- Teachers and students found Ecree easy to use and helpful for improving writing — related
- Ecree likely improved the quality of students' writing, especially for students with less advanced writing skills at the start of the school year — related
- Teachers used Ecree less than intended, and some reported they did not have enough time to learn it and integrate it with instruction — related
- MI Write's automated feedback is most useful to students when it supplements, not replaces, teacher feedback — related
- Students need clear guidance so they are not overwhelmed by Ecree's feedback, which may be most useful for advanced writers — related
- About half of surveyed students agreed Ecree was easy to use and helped improve their writing — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
some-students-struggled-automated-feedback-use |
title |
Some students struggled to use Ecree's and MI Write's automated feedback |
description |
Some students struggled to use Ecree's and MI Write's automated feedback |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2023 |
source_checked |
2026-10-15 |
recheck_by |
2026 |
generated |
by process:wiki-ingest on 2026-10-08 |
trust |
unverified — no one has confirmed this page's content |
sources |
1 — connor-rooney-2023 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.