Search arXiv⌕ Search

arXiv · 2610.22724

A misinformation playbook sharpens judgement without breeding cynicism

Abstract

Misinformation harms public health and democracy, and generative artificial intelligence now writes falsehoods as persuasive as people's. Defences range from fact-checking individual claims to training people to resist falsehoods. Yet many claims are too new to check, and interventions that teach doubt can reduce belief in truth too. We propose a defence that targets not the facts of each claim but the persuasion strategies that recur across them. Here we show that learning misinformation's persuasion playbook, mapped from 214,646 fact-checked claims in 51 languages, can sharpen human and machine judgement of claims they know little about, without making either more cynical about true claims. The playbook spans social influence, information manipulation and emotional appeals, combined around a core of fear, conspiracy and fabrication. Briefed with it, plus a reminder that persuasion is not proof of falsehood, a language model better distinguished true from machine-generated false claims about events after its training data. In a pre-registered experiment, the same briefing improved people's discernment of claims they reported as unfamiliar and left their belief in true claims unchanged. Averaged over all claims, the gain was not statistically significant. Because it targets what recurs, this defence need not wait for claim-specific fact-checks.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Tong Guo, Teng Ye, Yutong Xie, Qiaozhu Mei. 2026-10-15. A misinformation playbook sharpens judgement without breeding cynicism. https://arxiv.org/abs/2610.22724

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Evaluating Deception, Not Just Deepfakes

Deepfake detection is typically evaluated as a media-classification task: given a clip, determine whether it is synthetic. Yet benchmark performance is increasingly invoked to support broader claims about preventing deepfake-enabled deception in video calls, voice calls, and targeted communications. We argue that these claims require evidence across two distinct validity gaps. External validity concerns whether detection performance transfers across generators, processing pipelines, and communication channels. Consequential validity, as used here, concerns whether reliable detection translates into timely intervention and prevention of harmful actions. Even perfect synthetic-origin classification does not guarantee prevention when verification is unavailable, intervention occurs too late, or recipients disregard warnings. We therefore propose a scenario-level evaluation framework that integrates media evidence, interaction-level indicators grounded in speech act theory, conversational pragmatics, and influence principles, and operational outcomes. We define candidate measures of attack prevention, benign pass-through, intervention precision under explicit deployment base rates, and intervention timing. Our position is that deployment-oriented evaluation must measure not only whether synthetic media is detected, but whether deception is prevented without unnecessarily disrupting legitimate interactions. https://jesseeho.github.io/deepfake-deception/

cs.CY↗

From the Gettier Machine to Justified True Output: A Three-Step Account of Rational Trust in Generative AI

As generative artificial intelligence (AI) settles into everyday practices of inquiry, an old epistemological question returns in a new guise: when does a proposition a user takes from an AI output become something the user knows, and when is it rational to trust it as such? This paper argues that the characteristic failures of AI-mediated inquiry are precisely those that the justified-true-belief (JTB) tradition and its post-Gettier anti-luck refinements were built to diagnose, and it advances three claims. First, AI outputs inherit neither the presumptive warrant of testimony nor the reliabilist warrant of deterministic tools: unaudited trust in a calculator rests on a type-level reliability record, and for general-purpose generative models there is no type-stable process to which such a record could attach -- a practical form of the generality problem. Second, use that stops at obtaining an output turns generative AI into a Gettier machine: the user's fluency-based seeming of justification is disconnected from the truth of what is believed, and, as a clock running ten times too fast illustrates, sheer speed of production multiplies coincidental hits, inflating the appearance of reliability without improving the standing of any single hit. Third, the remedy is a three-step structure of use -- acquisition, understanding, independent verification -- whose first two steps answer to the classical belief and justification conditions and whose third answers to the post-Gettier sensitivity condition. The result is a stakes-indexed criterion of rational trust, justified true output (JTO), with an everyday test: "Had this been false, would I have noticed?" The criterion is defended against objections from over-demandingness, the extended mind, model improvement, and redundancy.

cs.CY↗

IKTRACE: A Natural Language Processing Framework for Identifying Indigenous Knowledge Representation in Academic Literature

As artificial intelligence systems increasingly rely on vast textual data, respectful and accurate representation of Indigenous Knowledge has become critical. This paper introduces IKTRACE, a natural language processing framework for identifying, analyzing, and organizing Indigenous Knowledge representations in academic literature while adhering to Indigenous Data Sovereignty (IDsov) principles. We present a community-informed taxonomy co-developed with Inuit partners, comprising nine knowledge domains grounded in Indigenous Data Sovereignty principles. Building on this taxonomy, we implement a multi-method Knowledge identification pipeline using complementary natural language processing approaches. Outputs are integrated into a knowledge graph to support future expert and community validation. Applied to a corpus of Canadian Arctic research documents, IKTRACE demonstrated high accuracy and strong community relevance in expert validation. Our framework provides a scalable, ethically grounded foundation for Community-centered Knowledge validation and the development of Indigenous-informed AI systems.

cs.CY↗