Report Assessment & Feedback (RAF) procedure with human-in-the-loop approval of all feedback reports¶

Design · All designs
Evidence · no claims cited

Description¶

The RAF procedure is a flowchart (Figure 1) for AI-assisted report assessment. The system generates a low-level feedback (LLF) report and an intermediate-level feedback (ILF) report; the human assessor evaluates and can modify both, then provides high-level feedback (HLF); the system ranks comments and generates a student-facing Final Feedback Report (FFR), which the assessor can modify and approve for release. "In all cases, the human assessor is included in the loop, deciding whether to accept, reject, or modify the low- and intermediate-level feedback generated."

Design Implications¶

Context¶

Requirements¶

Pre-definition of the list of factual check points with relative importance, a rubric for human high-level feedback, and human assessor review at each stage

Constraints¶

The article notes both the frequency and the type of action the human-in-the-loop takes are of importance; high-frequency oversight may reduce efficiency gains and create workflow bottlenecks

Target Learners¶

higher education students submitting complex reports

Learning Goals¶

multi-level assessment feedback with clear attribution of sources

Claims¶

Human-in-the-Loop AI-assisted evaluation framework for high-stakes writing assessment

Examples¶

-

Key Sources¶

Venetsanos, D. T. (2026). A Tripartite Feedback Framework for AI-Assisted Assessment of Complex Reports in Higher Education. AI Educ. 2026, 2, 26. https://doi.org/10.3390/aieduc2030026

Page metadata

Field	Value
`type`	`design`
`id`	`raf-procedure-human-in-the-loop`
`title`	`Report Assessment & Feedback (RAF) procedure with human-in-the-loop approval of all feedback reports`
`description`	`The RAF procedure is a flowchart (Figure 1) for AI-assisted report assessment.`
`status`	`review`
`generated`	by `process:settle-candidates` on `2026-10-12`
`trust`	unverified — no one has confirmed this page's content
`sources`	1 — `venetsanos-2026`

Frontmatter is the page's machine-readable record — see the Schema & Guide.