Longer APSS responses received higher scores, particularly for the scenario-application question (r = 0.70)¶

Claim · All claims
Evidence · 1 study · causal r2 · q3 · i3 large
Currency · newest study 2014 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i3 The correlation between response length and score was r = 0.70 for Question 2 of the APSS and r = 0.22 for Question 1, indicating that particularly for Question 2, longer responses received higher scores. → Jennifer M. Bekki 2014

Evidence¶

Jennifer M. Bekki 2014¶

Jennifer M. Bekki, Bianca L. Bernstein, Natalie Fabert, Natalie Gildar, and Amy Way. (2014). Efficacy of an Online Resource for Teaching Interpersonal Problem Solving Skills to Women Graduate Students in Engineering. Advances in Engineering Education. https://eric.ed.gov/?id=EJ1076131

q3 · i3 · causal · r2

Correlational analysis of participant responses to the APSS in the RCT, relating response length to rubric score for each question. The article reports "r = 0.70" for Question 2 and "r = 0.22" for Question 1.

"the correlation between response length and score was determined to be r = 0.22 for Question 1 of the APSS and r = 0.70 for Question 2, indicating that, particularly for Question 2, longer responses received higher scores."

Discussion¶

Related Claims¶

• No statistical difference was found between engineering and non-engineering participants on either APSS question, supporting conclusions about engineering students from the full STEM sample — related
• LLM-generated responses were substantially longer than authentic student submissions, suggesting response length as a signal the detector may exploit — related
• Implicit demographic cues produce larger and less predictable effects in open-ended tasks, including longer responses for laptop users and education-related length effects — related
• Wait-list control participants scored significantly higher on both APSS questions after their own exposure to CareerWISE — related