Diagnosis capability of domain-specific Bayesian student models was tested with 152 students across 12 first-degree-equation concepts¶

Claim · All claims
Evidence · 1 study · design r2 · q2
Currency · newest study 2013 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? An evaluation with 152 students tested the diagnosis capabilities of BSMs measuring knowledge in 12 concepts related to first degree equations, with each student taking both a computerized test and a written exam. → Millán-Valldeperas 2013

Evidence¶

Millán-Valldeperas 2013¶

Millán-Valldeperas, E.; Descalço, L.; Castillo, G.; Oliveira, P.; Diogo, S. (2013). Using Bayesian networks to improve knowledge assessment. Elsevier. http://hdl.handle.net/10630/7068

q2 · i? · design · r2

Evaluation design as printed: 152 students, each taking both the PMatE computerized test and a written exam, both measures targeting 12 first-degree-equation concepts. The article prints the sample size and concept count directly; no effect size is reported in the supplied text.

"In order to test the diagnosis capabilities of such BSMs, an evaluation with 152 students has been performed. Each of the 152 students took both a computerized test within PMatE and a written exam, both of them designed to measure students’ knowledge in 12 concepts related to first degree equations."

Discussion¶

Related Claims¶

• A Bayesian student model's diagnoses agree highly with expert averages on a written exam but poorly on the computerized test — related
• Expert graders show high agreement among themselves when scoring a written exam on first degree equations — related
• The generic Bayesian student model had been evaluated with simulated students before its first real application — related