The teacher-conference problem met the sweet spot of complexity: 10th graders generated solution ideas containing the targeted errors without solving the problem canonically¶
Claim · All claims
Evidence · 1 study (2 entries) · causalr2·q2
Currency · newest study 2020 · checked against its sources 2026-10-19 (automated, 2 of 2 entries) · not reviewed by a person
Subclaims¶
Reading the evidence codes
q is the design tier, i the impact, n the sample, and the kind with its r
the rigour judged within that kind: what each code means.
This claim: no standardized effect is recorded in observations/ for it yet, so no benchmark reading is possible.
q2 i? Pilot tests showed students produced non-canonical solution ideas (on average 6.5 ideas in round one) that typically included at least one of the four targeted errors, supporting sweet-spot complexity for the PF problem. → Valentina Nachtigall · Katja Serova · Nikol Rummel 2020
q2 i? In a second pilot round with a whole social science class, eight student groups developed an average of 4.6 ideas including at least one of the targeted errors. → Valentina Nachtigall · Katja Serova · Nikol Rummel 2020 (2)
Evidence¶
Valentina Nachtigall · Katja Serova · Nikol Rummel 2020¶
Valentina Nachtigall · Katja Serova · Nikol Rummel. (2020). When failure fails to be productive: probing the effectiveness of productive failure for learning beyond STEM domains. Instructional Science. https://doi.org/10.1007/s11251-020-09525-2
q2 · i? · causal · r?
First pilot round tested four triads from two 10th-grade classes on the teacher-conference problem to check complexity. Students produced ideas without solving canonically; on average "6.5 solution ideas" were generated, typically including at least one of the four targeted errors.
"On average, the students generated 6.5 solution ideas in their groups and these solution ideas typically included at least one of the four errors, which are listed in Table 3 (see left column)."
Valentina Nachtigall · Katja Serova · Nikol Rummel 2020 (2)¶
Valentina Nachtigall · Katja Serova · Nikol Rummel. (2020). When failure fails to be productive: probing the effectiveness of productive failure for learning beyond STEM domains. Instructional Science. https://doi.org/10.1007/s11251-020-09525-2
q2 · i? · causal · r2
Second pilot round tested both learning phases with one whole social science class in the out-of-school lab. The authors report the results "revealed that 10th graders were able to generate various solution ideas without solving the problem canonically", with an average of 4.6 ideas per group.
"Specifically, eight student groups developed an average of 4.6 ideas, which again included at least one of the four errors listed in Table 3."
Discussion¶
Related Claims¶
- PF students did not outperform DI students when learning social science research methods in two quasi-experimental studies with 10th graders, failing to replicate the STEM-domain PF effect — related
- Productive Failure Improves Conceptual Learning — a broader claim this one bears on
- Retrieval context has a sweet spot at Top-K = 10: raising it to 15 did not improve recall but significantly worsened context precision via the distraction issue — related
- Success in developing the canonical solution is not a necessary condition for learning from generation, but failure is not claimed to be indispensable either — related
- Collaborative group failure on ill-structured physics problems confers later individual problem-solving advantages over success on well-structured problems (productive failure) — related
- PF students outperformed direct-instruction students on conceptual understanding and transfer without compromising procedural fluency — related
- Constructive behaviors are defined by generating outputs containing new ideas that go beyond the information given — related
- Consistently high task complexity yields faster immediate problem-solving than gradually increasing complexity, with no post-test difference — related
Page metadata
| Field | Value |
|---|---|
type |
claim |
id |
pf-problem-sweet-spot-complexity-pilot-tests |
title |
The teacher-conference problem met the sweet spot of complexity: 10th graders generated solution ideas containing the targeted errors without solving the problem canonically |
description |
The teacher-conference problem met the sweet spot of complexity: 10th graders generated solution ideas containing the targeted errors without solving the problem canonically |
status |
review |
evidence_strength |
moderate |
newest_evidence |
2020 |
source_checked |
2026-10-19 |
generated |
by process:wiki-ingest on 2026-10-18 |
trust |
unverified — no one has confirmed this page's content |
sources |
2 — valentina-nachtigall-katja-serova-nikol-rummel-2020, valentina-nachtigall-katja-serova-nikol-rummel-2020-2 |
Frontmatter is the page's machine-readable record — see the Schema & Guide.