The tendency to follow advice shows good test-retest reliability across two sessions (~0.73), behaving as a stable trait-like bias¶

Claim · All claims
Evidence · 1 study · causal r2 · q3 · i3 large
Currency · newest study 2024 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q3 i3 The reveal effect was reliable across two adjacent days, with a test-retest Pearson correlation of r = 0.73 (HDI 89% = 0.64 to 0.81). → Maayan Pereg 2024

Evidence¶

Maayan Pereg 2024¶

Maayan Pereg, Uri Hertz, Ido Ben-Artzi and Nitzan Shahar. (2024). Disentangling the contribution of individual and social learning processes in human advice-taking behavior. npj Science of Learning 9:4. https://doi.org/10.1038/s41539-024-00214-0

q3 · i3 · causal · r2

Participants completed the same bandit task in two sessions on adjacent days with changed visual stimuli; hierarchical Bayesian regression of the reveal effect across sessions yielded a test-retest Pearson correlation coefficient (Fig. 2d) of r = 0.73.

"We performed a hierarchical Bayesian regression analysis and found good test-retest reliability (posterior median = 0.73, HDI 89% = 0.64 to 0.81"

Discussion¶

Related Claims¶

• Revealing a teacher's advice causally increases participants' tendency to choose the advised card in a reinforcement learning task — related
• The Who Has More task showed moderate test-retest reliability (r = .46) in preschoolers, and the authors call for more stable ANS measures for this age — related
• Test-retest correlations of memory span are low, questioning the validity of a single memory span test — related
• Mental index ratings on the group test showed close correspondence over a two-year interval (r = .72, rank correlation .77) among 46 retested children — related
• Self-efficacy measures show high reliability and domain-specific validity — related
• A 12-item short form of the survey retains acceptable-to-good reliability (alpha = 0.85; test-retest = 0.75) — related
• The full survey's test-retest reliability coefficient is 0.79, considered acceptable bordering on good — related
• Spanish Math and Reading scores show high marginal reliability and moderate-to-strong test-retest stability, lowest for fall–spring and kindergarten — related
• Spatial orientation skills can be measured reliably with a gamified virtual-environment battery, with average test–retest reliability r = 0.74 — related