Skip to content

Framework for determining the quality of rephrased responses (accuracy × responsiveness)

Research Method · All research methods
Evidence · 1 claim (1 for) · 1 study (1 design), q2 · 0 of 1 report an effect size · 1 claim rests on one study

Description

A two-dimensional framework the authors propose from their evaluation results for judging the quality of rephrased feedback responses. Accuracy measures whether the rephrased response is a better example of the lesson's target practice; responsiveness measures how selectively words are changed while preserving the trainee's original words and ideas. Responses rated 1 or 2 in accuracy are acceptable; the "optimal rephrased responses should be high in both accuracy and responsiveness (i.e., Excellent area in Fig. 6)", while low-accuracy responses (≤ 0) are undesirable regardless of responsiveness.

Accounts

  • Framework for determining the quality of rephrased responses (accuracy × responsiveness): A two-dimensional framework the authors propose from their evaluation results for judging the quality of rephrased feedback responses. Accuracy measures whether the rephrased response is a better example of the lesson's target practice; responsiveness measures how selectively words are changed while preserving the trainee's original words and ideas. Responses rated 1 or 2 in accuracy are acceptable; the "optimal rephrased responses should be high in both accuracy and responsiveness (i.e., Excellent area in Fig. 6)", while low-accuracy responses (≤ 0) are undesirable regardless of responsiveness. (Jionghao Lin et al. (2024))

Claims

-

Key Sources

  • Jionghao Lin, Zifei Han, Danielle R. Thomas, Ashish Gurung, Shivang Gupta, Vincent Aleven, Kenneth R. Koedinger. (2024). How Can I Get It Right? Using GPT to Rephrase Incorrect Trainee Responses. arXiv preprint. https://arxiv.org/abs/2405.00970
Page metadata
Field Value
type research-method
id framework-for-determining-the-quality-of-rephrased-responses-accuracy-responsiveness
title Framework for determining the quality of rephrased responses (accuracy × responsiveness)
description A two-dimensional framework the authors propose from their evaluation results for judging the quality of rephrased feedback responses.
status review
generated by process:settle-candidates on 2026-10-27
trust unverified — no one has confirmed this page's content

Frontmatter is the page's machine-readable record — see the Schema & Guide.