Help-seeking models transfer above chance across sites but perform poorly on the Costa Rican data¶

Claim · All claims
Evidence · 1 study · associational r1 · q2
Currency · newest study 2015 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? In ten of 12 cross-site applications the model's predicted learning correlated positively with actual learning (sign test two-tailed p=0.04), but the U.S. model correlated negatively with learning on the Costa Rica data. → Amy Ogan 2015

Evidence¶

Amy Ogan 2015¶

Amy Ogan, Erin Walker, Ryan Baker, Ma. Mercedes T. Rodrigo, Jose Carlo Soriano, Maynor Jimenez Castro. (2015). Towards Understanding How to Assess Help-Seeking Behavior Across Cultures. Int J Artif Intell Educ 25. https://doi.org/10.1007/s40593-014-0034-8

q2 · i? · associational · r1

Cross-cultural evaluation applying each site's model to the other three full datasets (non-cross-validated correlations, Table 4); a sign test indicated "two-tailed p=0.04".

"In ten out of the 12 cases where a model is applied to the full data set from a site, the correlation between the model’s predicted learning and the actual learning was positive, suggesting successful transfer of these models."

Discussion¶

Related Claims¶

• Collaborative classroom practice in Costa Rica may explain why help-seeking models fail to transfer there — related
• Students at all three international sites showed significant pre-test to post-test learning gains with the Scatterplot Tutor — related
• Help abuse is negatively associated with learning in both the Philippines and United States datasets — related
• Each site's help-seeking model predicted learning in its own data, with widely differing fit (Costa Rica r=0.462, U.S. r=0.350, Philippines r=0.126) — related
• Help-seeking skill models built from ITS practice data were not transferable across Costa Rican, Philippine, and US contexts (reported by Ogan et al., 2014) — reports the opposite
• Pre-test knowledge differed significantly across the three countries, producing a country by test time interaction — related
• Pre-test score differences do not explain the cross-cultural differences in effective help-seeking behaviors — related