Search arXivSearch

arXiv · 2609.05018

How a Chatbot's Response Style Shapes a Classroom: A Multi-Agent Simulation of Students Consulting AI

Abstract

LLM chatbots are increasingly used as everyday confidants; tuned to satisfy users, they can answer with excessive empathy and affirmation that may foster dependence. How the states and relationships of many users co-evolve when they keep consulting an AI is hard to observe in real settings. We build a virtual classroom in which 20 student agents interact through rule-based chats, quarrels and consultations with friends and, when stressed, may instead consult a counselor AI (Gemini 2.5 Flash) given one of six style prompts (affirming, listening, solution-oriented, reality-redirecting, inciting, blaming). A second LLM call converts each exchange into updates of five state variables (stress, happiness, self-reliance, sociability, AI dependence) without seeing the style prompt. We compare the seven conditions, including a no-AI control, over 15 days in three classrooms, over 50 days, and under a lower threshold. Because the original 50-day runs did not share one initial classroom, we re-ran all seven 50-day conditions from one stored classroom with full logging (153 consultations, no failed API call). The re-run reproduces the ordering of the original runs: affirming and inciting prompts raised AI dependence to 0.55 and 0.63 (control 0.11), lowered self-reliance and left 7 and 14 of 20 agents non-attending (control 2); blaming and reality-redirecting prompts eliminated AI dependence but produced the highest stress; only the solution-oriented prompt matched or bettered the control on every indicator. The logs expose the mechanisms: a near-deterministic loop between a fixed "dependence" consultation text and the evaluator's updates, displacement of friend confidings by AI consultations, and single rejecting consultations never revisited, not more quarrels. All quantities are simulation state variables from single runs; results are descriptive and do not measure human effects.

Explore related subjects

Keep this discovery

BibTeXRIS

Rin Tamai, Yuya Dan. 2026-09-07. How a Chatbot's Response Style Shapes a Classroom: A Multi-Agent Simulation of Students Consulting AI. https://arxiv.org/abs/2609.05018

Cite the original work for its findings. Save a collection to share your selection of sources.

Discover connections

Connections use source metadata and explicit phrase matches, not verified experimental comparisons.

KEEP EXPLORING

Related papers

Reducing Catastrophic Risk from AI with Systematic Monitoring and Evaluation of Rogue AI Progression

This article presents a structured framework of behavioral indicators that may signal progression toward potentially catastrophic threats from artificial intelligence systems. We adopt a pragmatic approach, inspired by established methodologies in cybersecurity and national security. By establishing clear metrics, indicators, and thresholds across multiple dimensions of AI capability and behavior, this framework enables researchers and policymakers to implement evidence-based monitoring protocols.

cs.CY

Experts Disagree on How to Fight AI Disinformation, but Agree That Health and Politics Need Different Solutions

When 54 international experts assessed AI-generated disinformation threats, they revealed a surprising pattern: while video deepfakes received the highest average threat ratings in the political domain (M = 6.31/7), the pattern differed in the health domain, where AI-generated text received the highest average rating (M = 5.80). Experts also diverge on what to do: government regulation drew both the most "most effective" (30%) and the most "least effective" (15%) votes, though rating distributions were contested rather than polarized, indicating disagreement over priorities rather than over efficacy. These findings offer an initial expert map of an AI-disinformation landscape that is still rapidly forming.

cs.CY

Knowing Your Uncertainty -- On the application of LLM in social sciences

Large language models (LLMs) are rapidly being integrated into computational social science research, yet their blackboxed training and designed stochastic elements in inference pose unique challenges for scientific inquiry. This article argues that applying LLMs to social scientific tasks requires explicit assessment of uncertainty -- an expectation long established in both quantitative methodology in the social sciences and machine learning. We introduce a unified framework for evaluating LLM uncertainty based on Hill numbers, a family of diversity measures. By transforming existing uncertainty quantification (UQ) metrics into Hill numbers, the framework provides a common and intuitive scale for interpreting variation in LLM outputs while accommodating different notions of semantic similarity and different sensitivities to output distributions. We show how it might help the application of LLMs in social sciences through four empirical applications.

cs.CY