Using AI Predictions to Augment Rather Than Replace Surveys

Lai Wei; Yifei Zhu

Home/Archive/arXiv

arXiv · 2611.06743

Using AI Predictions to Augment Rather Than Replace Surveys

Lai Wei·Yifei Zhu

View original source ↗Read source document ↗Export metadata ↓

Abstract

LLMs can predict human survey responses with nontrivial accuracy. What this means for the future of social surveys remains hotly contested. Optimists anticipate a coming era of synthetic respondents; skeptics see a fragile and overhyped substitute. This article advocates a position: AI predictions cannot replace surveys, but they can augment them. Using prediction-powered inference (PPI), a statistical framework rooted in survey methodology and known in sociology as "mixed subjects design", the study tests whether AI predictions can improve the statistical efficiency of social surveys when combined with census-scale auxiliary information. Applying the framework to 83 social outcomes in the General Social Survey (GSS) and National Health Interview Survey (NHIS), with American Community Survey (ACS) being the auxiliary file, we find that supervised predictors yield effective-sample-size gains of about 7-12 percent when estimating the mean, while LLM gains are smaller but positive.

Explore related subjects

cs.CY

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Lai Wei, Yifei Zhu. 2026-11-04. Using AI Predictions to Augment Rather Than Replace Surveys. https://arxiv.org/abs/2611.06743

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Digital Security Under Compound Threats: Surveillance, Threat Reasoning, and Habituation Among North Korean Defectors in China

North Korean defectors residing in China face persistent uncertainty regarding digital security and privacy. Through semi-structured interviews with 19 defectors, we examine how individuals understand digital threats and adapt their security behaviors. We identify three interrelated conditions: transnational surveillance pressure from North Korea, identity-linked digital infrastructure and intermediary dependency in China, and threat reasoning shaped by prior surveillance schemas. Participants developed uneven protective practices and followed two trajectories: adaptive habituation driven by knowledge acquisition and erosive habituation driven by the prolonged absence of adverse events. Our findings show how compound threats, attribution uncertainty, and constrained agency shape security reasoning among undocumented users.

cs.CY↗

arXiv2026

The Popular Get More Popular: Auditing Brand Bias in Generative Search

The shift from traditional to generative search has fundamentally transformed online product discovery. Because conversational recommendations synthesize choices into a few direct answers, subtle systemic preferences toward specific providers can exert profound commercial impacts. In this work, we audit this phenomenon through two distinct dimensions: (i) brand popularity bias, the systematic preference for market-dominant entities over long-tail alternatives, and (ii) brand familiarity bias, the ranking advantage an entity encoded in an LLM's parametric memory holds over an unfamiliar competitor. First, evaluating commercial queries across major engines, we observe persistent brand popularity bias: dominant brands in the top quintile are cited 1.4x to 2.8x more frequently than the average brand within a sample of 1,176 top market players, already present in parametric memory that external web retrieval fails to mitigate. Second, through controlled in-context experiments holding product attributes constant, we find that substituting authentic brand signatures with unfamiliar ones significantly degrades recommendation rank. Conversely, fact-preserving content rewrites yield negligible ranking gains. Taken together, our findings demonstrate that generative search engines reinforce a ``rich-get-richer'' dynamic by favoring established market leaders and imposing a parametric barrier to entry that standard content optimization cannot overcome.

cs.CY↗

arXiv2026

Operationalizing NCII and CSAM Law in the Age of AI: Open Problems

Advances in generative AI have driven a surge in synthetic non-consensual intimate imagery (NCII) and child sexual abuse material (CSAM), prompting a series of legal reforms. These reforms rely on legal definitions where technical operationalization is ambiguous, such as whether a depicted person is identifiable, whether a model is capable of or intended for abuse generation, and whether an abusive image can be traced to the model that produced it. Drawing on the law of England and Wales and the United States, we examine the relevant law alongside the technical research needed to operationalize it. From this, we develop a research agenda of open problems at this technical-legal interface, spanning the interpretation of existing law, the prevention of harm before an AI tool is deployed, and enforcement of offenses. These are problems the technical community is well placed to solve, and where progress is vital to real-world protection.

cs.CY↗