Search arXiv⌕ Search

arXiv · 2610.26411

Exploring Visual Access and Proactive AI Tutoring for Handwritten Mathematics

Abstract

Handwritten work captures mathematical reasoning that learners may not express in typed or voice-dictated messages. We built a multimodal AI tutoring platform in which a phone camera gives the tutor a live view of learners' work on paper. In a randomized online study, 117 adults solved calculus problems with Text-Reactive, Visual-Reactive, or Visual-Proactive assistance. Analysis of 2,140 tutor messages showed that visual access shifted assistance toward checking ongoing work, while proactivity enhanced error identification and directive hints. Learners valued feedback grounded in their writing; those who received proactive help rated it as supportive, and about a third wanted it more often. These findings inform when tutors should intervene and what they should address. We release the platform, prompts, and instruments, together with 255,984 timestamped images of handwritten work linked to tutoring conversations, intervention decisions, and learning outcomes, to support multimodal tutoring systems that preserve the affordances of handwritten work while providing adaptive feedback.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Nachiket Kotalwar, Conrad Borchers, Shubham Gandhi, Partha Sarathi Purkayastha, David Yaron, Carolyn P. Rosé. 2026-10-19. Exploring Visual Access and Proactive AI Tutoring for Handwritten Mathematics. https://arxiv.org/abs/2610.26411

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Situating Vulnerability: An Ethical Governance Framework for Anthropomorphic AI Interaction

Large language models increasingly address users in the register of care: they remember personal details, adopt a first-person emotional voice, and sustain relationships across many sessions. This anthropomorphic mode of interaction generates risks that output-level metrics capture poorly, because the same empathic utterance may console one user, entrap a second, and consolidate a delusion in a third. Governance has responded in two ways. Uniform restriction refuses sensitive requests or suppresses empathic phrasing across all outputs; group-targeted protection profiles vulnerable populations and applies stricter or prohibitive rules to them. This article argues that both fail. Uniform restriction mislocates harm in the lexical form of responses rather than in the trajectory of a relationship; group-based protection depends on a list that can never be complete, treats a fluid property as a static attribute of persons, and converts protective attention into stigmatizing labels. Drawing on philosophical work that treats vulnerability as universal, relational, and differentiated, we propose that the unit of ethical governance should be the vulnerability situation rather than the vulnerable group, develop a typology of five situations - physical, emotional, cognitive, autonomy, and relational - and specify seven principles into requirements that guide response calibration without diagnosing or persistently classifying users. The framework relocates AI safety from output control to relational safety.

cs.CY↗

Strong Men Create Good Memes: Far-Right Memes as Means of Authoritarian Legitimation in Russia

This study examines how Russian far-right communities on Telegram shape perceptions of political figures through meme-based visual narratives. In Russia, such groups are central because they articulate the ideological foundations of the war against Ukraine and reflect the regime's drift toward ultranationalist rhetoric. Drawing on a dataset of 404,013 images from expert-selected far-right Telegram channels, the study uses automated face recognition, CLIP-based image embeddings, and HDBSCAN clustering with UMAP to identify memes featuring Russian (Putin, Medvedev) and foreign politicians (Zelensky, Biden, Trump) and to uncover recurrent visual patterns in their representation. Findings show that far-right memes co-produce state propaganda by generating new bottom-up narratives of legitimation and delegitimation that situationally align with state ideology. By framing authoritarian leaders as heroic and their opponents as corrupt, weak, or non-human, far-right actors act as informal co-creators of authoritarian legitimacy within Russia's informational autocracy.

cs.CY↗

How to Stop Playing Whack-a-Mole: Mapping the Ecosystem of Technologies Facilitating AI-Generated Non-Consensual Intimate Images

The last decade has witnessed a rapid advancement of generative AI technology that significantly scaled the accessibility of AI-generated non-consensual intimate images (AIG-NCII), a form of image-based sexual abuse that disproportionately harms and silences women and girls. There is a patchwork of commendable efforts across industry, policy, academia, and civil society to address AIG-NCII. However, these efforts lack a shared, consistent mental model that clearly situates the technologies they target within the context of a large, interconnected, and ever-evolving technological ecosystem. As a result, interventions remain siloed and are difficult to evaluate and compare, leading to a reactive cycle of whack-a-mole. In this paper, we contribute the first comprehensive AIG-NCII technological ecosystem that maps and taxonomizes 11 categories of technologies facilitating the creation, distribution, proliferation and discovery, infrastructural support, and monetization of AIG-NCII. First, we build and visualize the ecosystem through a synthesis of over a hundred primary sources from researchers, journalists, advocates, policymakers, and technologists. Then, we conduct two detailed walkthroughs to demonstrate the usefulness of the ecosystem in 1) making sense of new AIG-NCII harms using a case study of Grok and 2) mapping a clearer tech policy landscape using U.S. federal law and 63 state laws. We conclude with a vision for future AIG-NCII research that refines the edges of the ecosystem, recommending researchers to study critical relationships between technologies and potential ripple effects from different interventions. Our goal is to produce an AIG-NCII technological ecosystem that provides a clear, shared terminology and framework for stakeholders to move into the future of AIG-NCII prevention with clarity and foresight.

cs.CY↗