Unreflected Acceptance – Investigating the Negative Consequences of ChatGPT-Assisted Problem Solving in Physics Education

by   Lars Krupp, et al.

Large language models (LLMs) have recently gained popularity. However, the impact of their general availability through ChatGPT on sensitive areas of everyday life, such as education, remains unclear. Nevertheless, the societal impact on established educational methods is already being experienced by both students and educators. Our work focuses on higher physics education and examines problem solving strategies. In a study, students with a background in physics were assigned to solve physics exercises, with one group having access to an internet search engine (N=12) and the other group being allowed to use ChatGPT (N=27). We evaluated their performance, strategies, and interaction with the provided tools. Our results showed that nearly half of the solutions provided with the support of ChatGPT were mistakenly assumed to be correct by the students, indicating that they overly trusted ChatGPT even in their field of expertise. Likewise, in 42 ChatGPT – an approach only used in 4 the stark differences in interaction behavior between the groups and indicating limited reflection when using ChatGPT. In our work, we demonstrated a need to (1) guide students on how to interact with LLMs and (2) create awareness of potential shortcomings for users.


Evaluating Students Perspectives on ICT Readiness in Somali Higher Education towards Teaching – Learning Acceptance

Along the rapid development of Information and communication technology ...

An Approach to Adaptive Microlearning in Higher Education

Current changes in society and the education system, cumulated with the ...

Empathic Robot for Group Learning: A Field Study

This work explores a group learning scenario with an autonomous empathic...

Two Different Experiments with the Rope-Attached Sphere by Using Arduino

Arduino microcontrollers are electronic devices that can be used in phys...

Presenting and Evaluating the Impact of Experiential Learning in Computing Accessibility Education

Studies indicate that much of the software created today is not accessib...

Does Interdisciplinary Creative Coding Boost Creativity? A Mixed Methods Approach

This study explores the influence of an interdisciplinary intervention o...

Students' Information Privacy Concerns in Learning Analytics: Towards a Model Development

The widespread interest in learning analytics (LA) is associated with in...

Please sign up or login with your details

Forgot password? Click here to reset