Sinusoidal steady-state analysis is the most challenging topic for both GPT-4o and Llama 3 70B in homework assessment¶

Claim · All claims
Evidence · 1 study · design r2 · q2
Currency · newest study 2025 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? Performance of both GPT-4o and Llama 3 70B varies across topics, with sinusoidal steady-state analysis yielding the lowest average percentage of correct responses. → Liangliang Chen 2025

Evidence¶

Liangliang Chen 2025¶

Liangliang Chen, Zhihao Qin, Yiming Guo, Jacqueline Rohde, Ying Zhang. (2025). Benchmarking Large Language Models on Homework Assessment in Circuit Analysis. Int J Artif Intell Educ. https://doi.org/10.1007/s40593-025-00501-w

q2 · i? · design · r2

Cross-topic comparison in the benchmark results. The article reports the topic-level difficulty pattern and speculates the difficulty arises from conversions among complex numbers, phasors, and sinusoids.

"Sinusoidal steady-state analysis is the most challenging topic for both GPT-4o and Llama 3 70B, as indicated by the average percentage of correct responses."

Discussion¶

Related Claims¶

• GPT-4o shows more consistent performance than Llama 3 70B across topics and metrics, while Llama 3 70B falls below 60% on the unit metric for three advanced topics — related
• GPT-4o and Llama 3 70B significantly outperform GPT-3.5 Turbo across all five homework-assessment metrics in circuit analysis — related
• Llama 3 70B outperforms GPT-4o on completeness and method metrics due to its leniency, but performs significantly worse on the unit metric — related