Search arXiv⌕ Search
Home/Archive/arXiv

arXiv · 2601.09965

aiPlato: A Novel AI Tutoring and Step-wise Feedback System for Physics Homework

Atharva Dange·Ramon E. Lopez·Louis Deslauriers·Nimish Shah
View original source ↗Read source document ↗Export metadata ↓

Abstract

This exploratory study examines the classroom deployment of aiPlato, an AI-enabled homework platform, in a large introductory physics course at the University of Texas at Arlington. Designed to support open-ended problem solving, aiPlato provides step-wise feedback and iterative guidance through tools such as "Evaluate My Work" and "AI Tutor Chat", while preserving opportunities for productive struggle. Over four optional extra-credit assignments, the platform captured detailed student interaction data, which were analyzed alongside course performance and end-of-semester survey responses. We examine how students engaged with different feedback tools, whether engagement patterns were associated with performance on the cumulative final exam, and how students perceived the platform's usability and learning value. Students who engaged more frequently with aiPlato tended to achieve higher final exam scores, with a mean difference corresponding to a standardized effect size of approximately 0.81 between high and low engagement groups after controlling for prior academic performance. Usage patterns and survey responses indicate that students primarily relied on iterative, formative feedback rather than solution-revealing assistance. As a quasi-experimental pilot study, these findings do not establish causality and may reflect self-selection effects. Nonetheless, the results demonstrate the feasibility of integrating AI-mediated, step-wise feedback into authentic physics homework and motivate future controlled studies of AI-assisted tutoring systems.

Explore related subjects

physics.ed-ph

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Atharva Dange, Ramon E. Lopez, Louis Deslauriers, Nimish Shah. 2026-01-15. aiPlato: A Novel AI Tutoring and Step-wise Feedback System for Physics Homework. https://arxiv.org/abs/2601.09965

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

The Force Concept Inventory Across Continents: Testing Q-Matrix Transferability and Cross-Cultural Differences in Mechanics Reasoning

The Force Concept Inventory (FCI) is one of the most widely used research-based assessments in physics education, yet the assumption that its underlying cognitive structure is transferable across educational contexts remains largely untested. This study investigates the transferability of FCI Q-matrices using the Generalized Deterministic Inputs, Noisy "And" Gate (G-DINA) cognitive diagnostic applied to two large cohorts: students from the Learning About STEM Student Outcomes (LASSO) online system database in the United States (N = 4,750) and introductory physics students at the University of Johannesburg, South Africa (N = 1,016). Rather than treating the analysis as a local model calibration exercise, we frame the problem as one of cross-context cognitive invariance. Differential Item Functioning (DIF) analyses revealed substantial cross-cultural differences, with 14 of 30 items exhibiting high DIF after controlling for latent skill mastery. These differences were concentrated in force dynamics and contact-force reasoning and remained invariant under alternative Q-matrix specifications. The findings suggest that observed differences reflect genuine variations in students' conceptual reasoning rather than psychometric artifacts, highlighting the importance of validating Q-matrix structures before deploying cognitive diagnostic and adaptive assessments across diverse non-local educational settings.

physics.ed-ph↗
arXiv2026

Inference uncertainty about an aircraft crash

Problem-based learning benefits from situations taken from real life, which usually stimulate student interest. In this paper, we examine the shooting down of the Rwandan president's aircraft on April 6th, 1994. We discuss methods to infer information about the location from which the missile was launched, its trajectory and type, where the aircraft was struck and its trajectory during the fall. To this end, we developed a physics-based analysis based on expert reports, witness statements, and other publicly available information, as interpreted by our calculations. The analysis is designed to be understandable using undergraduate-level physics. The uncertainty of each result is discussed and propagated to ensure a proper assessment of the hypotheses and a traceability of their consequences. Such approach encourages the students to exercise their critical mind and teaches inference methods that are routinely used in physics research. In addition, it illustrates the importance and limits of scientific expertise during a judiciary process.

physics.ed-ph↗
arXiv2026

Skepticism vs. Convenience: Physics Students' Perceptions and Use of Large Language Models Before and After Instruction

The recent emergence of large language models (LLMs) has produced research focusing on the ability of these tools to solve physics problems, evaluate student work, or otherwise impact the problem-solving process of students. However, studies exploring how physics students perceive LLMs (in terms of capabilities, educational impacts, usage, and role in problem solving) remain limited. This study evaluates the first-year physics students' perceptions toward LLMs and further explores how these perceptions change after practicing problem-solving with and without LLMs and engaging in a reflective lesson on the functioning and educational impacts of LLMs. We find that student opinions toward LLMs vary, with generally favorable perceptions of their capabilities but greater skepticism regarding their value for learning. Despite this skepticism, a majority of students self-report regularly using LLMs to obtain help, commonly reporting deadlines and convenience as motivating factors. Following the lesson, students expressed greater skepticism toward LLMs in several areas, with 88% of students believing that LLMs can leave them with a false sense of confidence about their understanding, up from 58% before the lesson.

physics.ed-ph↗