Computer-delivered figural response test items for architecture¶

Element · All elements
Evidence · 2 claims (2 for) · 1 study (1 associational), q2 · 0 of 1 report an effect size · 2 claims rest on one study

Description¶

Figural response items are constructed-response items in which "examinees must construct their answers and the responses consist of the generation or manipulation of figural material (e.g., graphs, pictures)." In this study the 22 items were computer delivered, each consisting of a verbal stem, a diagram, and drawing tools; for example, one item required moving library, parking lot, and playground structures onto a site subject to explicit and implicit constraints. The authors argue the format suits graphical domains and may tap skills inaccessible to multiple choice.

Design Implications¶

Context¶

Requirements¶

• Delivery on a computer with responses made through mouse movements and clicks, with a stem, diagram, and manipulation tools per item.

Constraints¶

• Most items assess architectural knowledge through subsidiary tasks rather than assessing design skill directly.

Target Learners¶

• architecture licensure candidates

Target Learning Goals¶

• assessing architectural knowledge and figural problem-solving skills

Affordances¶

• Rule Space Model Cognitive Diagnosis

Claims¶

• Rule Space successfully classified most examinees in architecture, with solve attributes the most powerful and check attributes the least powerful [+W]
• Solve attributes differ in discrimination: the environment attribute strongly separated proficiency groups while the learned-procedure attribute did not [+W]

Related Elements¶

• Constructed-Response Assessment Items

Examples¶

-

Key Sources¶

• Katz, I. R., Martinez, M. E., Sheehan, K. M., & Tatsuoka, K. K. (1993). Extending the Rule Space Model to a Semantically-Rich Domain: Diagnostic Assessment in Architecture. Educational Testing Service. https://eric.ed.gov/?id=ED366652. doi:10.21236/ada273789