Alma Robinson | Search arXiv

arXiv2026

Skepticism vs. Convenience: Physics Students' Perceptions and Use of Large Language Models Before and After Instruction

The recent emergence of large language models (LLMs) has produced research focusing on the ability of these tools to solve physics problems, evaluate student work, or otherwise impact the problem-solving process of students. However, studies exploring how physics students perceive LLMs (in terms of capabilities, educational impacts, usage, and role in problem solving) remain limited. This study evaluates the first-year physics students' perceptions toward LLMs and further explores how these perceptions change after practicing problem-solving with and without LLMs and engaging in a reflective lesson on the functioning and educational impacts of LLMs. We find that student opinions toward LLMs vary, with generally favorable perceptions of their capabilities but greater skepticism regarding their value for learning. Despite this skepticism, a majority of students self-report regularly using LLMs to obtain help, commonly reporting deadlines and convenience as motivating factors. Following the lesson, students expressed greater skepticism toward LLMs in several areas, with 88% of students believing that LLMs can leave them with a false sense of confidence about their understanding, up from 58% before the lesson.

physics.ed-ph↗

arXiv2021

Positive attitudinal shifts and a narrowing gender gap: Do expertlike attitudes correlate to higher learning gains for women in the physics classroom?

A large body of research shows that using interactive engagement pedagogy in the introductory physics classroom consistently results in significant student learning gains; however, with a few exceptions, those learning gains tend not to be accompanied by more expertlike attitudes and beliefs about physics and learning physics. In fact, in both traditionally taught and active learning classroom environments, students often become more novicelike in their attitudes and beliefs following a semester of instruction. Further, prior to instruction, men typically score higher than women on conceptual inventories, such as the Force Concept Inventory (FCI), and more expertlike on attitudinal surveys, such as the Colorado Learning Attitudes about Science Survey (CLASS), and those gender gaps generally persist following instruction. In this paper, we analyze three years of pre-post matched data for physics majors at Virginia Tech on the FCI and the CLASS. The courses were taught using a blended pedagogical model of peer instruction, group problem solving, and direct instruction, along with an explicit focus on the importance of conceptual understanding and a growth mindset. We found that the FCI gender gap decreased, and both men and women showed positive, expertlike shifts on the CLASS. Perhaps most surprisingly, we found a meaningful correlation between a student's post- CLASS score and normalized FCI gain for women, but not for men.

physics.ed-ph↗