Rule Space successfully classified most examinees in architecture, with solve attributes the most powerful and check attributes the least powerful¶

Claim · All claims
Evidence · 1 study (2 entries) · associational r1 · q2
Currency · newest study 1993 · not yet checked against its sources · not reviewed by a person · overdue for a recheck since 1996: tool and model accuracy changes quickly

Subclaims¶

q2 i? Solve attributes were the most powerful classifiers across proficiency and status groups, classifying all 41 low-proficiency examinees. → Katz 1993 q2 i? Lower-proficiency and lower-status examinees were more often classified; twice the percentage of low-proficiency (61%) than high-proficiency (30%) examinees were classified under check. → Katz 1993 (2)

Evidence¶

Katz 1993¶

Katz, I. R., Martinez, M. E., Sheehan, K. M., & Tatsuoka, K. K. (1993). Extending the Rule Space Model to a Semantically-Rich Domain: Diagnostic Assessment in Architecture. Educational Testing Service. https://eric.ed.gov/?id=ED366652 doi:10.21236/ada273789

q2 · i? · design · r2

Results section reporting classification outcomes by process type (Table 7). The authors state "the solve attributes are the most powerful in classifying subjects across proficiency levels and status groups"; understand followed, then check.

"The first is that the solve attributes are the most powerful in classifying subjects across proficiency levels and status groups; in fact, all 41 low-proficiency examinees were classified."

Katz 1993 (2)¶

Katz, I. R., Martinez, M. E., Sheehan, K. M., & Tatsuoka, K. K. (1993). Extending the Rule Space Model to a Semantically-Rich Domain: Diagnostic Assessment in Architecture. Educational Testing Service. https://eric.ed.gov/?id=ED366652. doi:10.21236/ada273789

q2 · i? · associational · r1

Results section, Table 7 breakdown: "twice the percentage of low-proficiency examinees (61%) than high-proficiency examinees (30%) were classified under check", a pattern the authors note held almost uniformly across groups.

"For example,twice the percentage of low-proficiency examinees (61%) than high-proficiency examinees (30%) were classified under check."

Discussion¶

Related Claims¶

• The understand-solve-check cognitive model accounted for 71% of protocol subjects' verbalizations — related
• Solve attributes differ in discrimination: the environment attribute strongly separated proficiency groups while the learned-procedure attribute did not — related
• Attribute mastery showed significant proficiency-group, attribute, and attribute-by-proficiency effects, but no significant status-group main effect — related