Certain aspects of AI literacy play a role in higher-quality prompt engineering by non-expert students¶

Claim · All claims
Evidence · 1 study · associational r? · q2
Currency · newest study 2024 · not yet checked against its sources · not reviewed by a person

Subclaims¶

q2 i? Certain aspects of students' AI literacy are associated with higher-quality prompt engineering and targeted adaptation of LLMs in education. → Knoth 2024

Evidence¶

Knoth 2024¶

Knoth, N., Tolzin, A., Janson, A., & Leimeister, J. M. (2024). AI literacy and its implications for prompt engineering strategies. Computers and Education: Artificial Intelligence. https://doi.org/10.1016/j.caeai.2024.100225

q2 · i? · associational · r?

The article reports that "certain aspects of AI literacy can play a role in higher quality prompt engineering" among non-expert students. The available text does not specify which aspects or print effect sizes.

"In addition, the results show that certain aspects of AI literacy can play a role in higher quality prompt engineering and targeted adaptation of LLMs within education."

Discussion¶

Learner Variables¶

• Digital Literacy — predictor: learners who differ on it differ in outcomes

Related Claims¶

• Higher-quality prompt engineering skills predict the quality of LLM output in goal-directed use of generative AI tools — related
• LLM accuracy increases monotonically with prompt sophistication across semantically equivalent medical questions, with Low Literacy users scoring significantly below Prompt Engineer users — a narrower finding that bears on this claim
• Non-expert students exhibit intuitive behaviors towards LLM-based AI systems when prompt engineering — related
• Effective AI use in nursing education depends on prompting skills, which participants identify as critical for obtaining accurate and reliable outputs — related