Going PLACES: Participatory Localized Red Teaming for Text-to-Image Safety in the Global South

Charvi Rastogi; Mukul Bhutani; Minsuk Kahng; Shamsuddeen Hassan Muhammad; Evgeniia Razumovskaia; Priyanka Suresh; Ibrahim Said Ahmad; Charu Kalia; Yaaseen Mahomed; Madhurima Maji; Minjae Lee; Alicia Parrish; Jessica Quaye; Vijay Janapa Reddi; Aishwarya Verma; Lora Aroyo

arXiv · 2605.19190

Going PLACES: Participatory Localized Red Teaming for Text-to-Image Safety in the Global South

Charvi Rastogi·Mukul Bhutani·Minsuk Kahng·Shamsuddeen Hassan Muhammad·Evgeniia Razumovskaia·Priyanka Suresh·Ibrahim Said Ahmad·Charu Kalia·Yaaseen Mahomed·Madhurima Maji·Minjae Lee·Alicia Parrish·Jessica Quaye·Vijay Janapa Reddi·Aishwarya Verma·Lora Aroyo

View original source ↗Read source document ↗Export metadata ↓

Abstract

Despite the global deployment of text-to-image (T2I) models, their safety frameworks are largely calibrated to a Western-centric default, creating significant vulnerabilities for the rest of the world. To embrace cultural pluralism and bring historically under-represented perspectives in T2I safety, we conduct localised community-centered red teaming studies in the Global South. Our two-fold approach prioritizes localization and participation, by focusing on secondary urban centers in these regions, and conducting community engagement and training workshops to contextualize local norms. As a result, we present PLACES, a dataset comprising over 26,000 examples of T2I model failures collected in partnership with universities in Ghana, Nigeria, and two regions of India (Karnataka and Punjab). Analysis of prompts collected reveals a wide-ranging diversity in socio-cultural and linguistic attributes, when compared to existing geography-agnostic crowdsourced red-teaming data. We observe unique adversarial patterns enabled by local cultural and linguistic nuances, and distinct clusters within region around specific themes, such as religion in India. Moreover, we uncover structural contextual gaps in existing safety frameworks by identifying novel harms showing normative dissonance (e.g., violating religious norms, ignoring local customs, and ominous symbolism). This work argues that expanding T2I safety requires moving beyond mere scale to incorporate deeply localised, participatory methodologies for data collection and contextualization. Content warning: This paper includes examples containing potentially harmful or offensive content.

Explore related subjects

cs.CY cs.AI cs.HC

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Charvi Rastogi, Mukul Bhutani, Minsuk Kahng, Shamsuddeen Hassan Muhammad, Evgeniia Razumovskaia, Priyanka Suresh, Ibrahim Said Ahmad, Charu Kalia, Yaaseen Mahomed, Madhurima Maji, Minjae Lee, Alicia Parrish, Jessica Quaye, Vijay Janapa Reddi, Aishwarya Verma, Lora Aroyo. 2026-05-18. Going PLACES: Participatory Localized Red Teaming for Text-to-Image Safety in the Global South. https://arxiv.org/abs/2605.19190

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

A Brief AI Literacy Intervention Does Not Significantly Reduce Over-Reliance and Increases Under-Reliance on ChatGPT: A Randomized Study

In this study, we examined whether a brief AI literacy intervention influences high school students' reliance on recommendations from large language models (LLMs). In a randomized experiment, students were assigned to either a control group receiving a brief introduction to LLMs or an intervention group receiving additional information about how LLMs work, their limitations, and effective usage strategies. Participants then solved eight math puzzles with ChatGPT's advice, which was incorrect in half of the trials. Results indicated widespread over-reliance, with incorrect recommendations adopted in 52.1% of the trials. The intervention did not significantly reduce over-reliance. Instead, it led to an increase in under-reliance, as students were more likely to reject correct recommendations. These findings provide preliminary evidence that brief text-based interventions may be ineffective in fostering appropriate reliance. More comprehensive and interactive approaches may be required to meaningfully influence students' real-world reliance on LLMs.

cs.CY↗

arXiv2026

Examining Community-Requested Fact-Checking: Request Alerts Are Associated with Greater Diversity and Visibility of Community Notes

Crowdsourced fact-checking systems such as Community Notes are increasingly used on social media platforms, yet concerns remain about which content receives scrutiny and how visible that scrutiny is. X allows users to request notes for specific posts. When sufficient requests accumulate, an alert is displayed, creating an interface cue that may guide contributor behavior. We present a quantitative, non-causal analysis comparing the diversity and visibility of community notes written for X posts with and without request alerts. We infer alert presence at note submission and analyze 10,432 alerted and 44,442 non-alerted English notes from 318 top writers. We find that, alerted notes are associated with greater individual-level topical diversity, but also with stronger collective concentration in the Politics category. Mixed-effects models estimate that alerted notes are 8.4-20.2 percentage points more likely to be modeled helpful and visible, though this visibility gain diminishes as topics diverge from writers' prior interests.

cs.CY↗

arXiv2026

Scarcity and Predictive Uncertainty: Implications for Societal Resource Allocation

An emerging literature examines the critical question of when and how prediction can be useful in allocating scarce societal resources. We examine a novel variant of this question: What happens when predictive uncertainty differs systematically across the population? This can occur in several situations; for example, when machine learning models have significantly different accuracies across different demographics. We show that this uncertainty has serious implications for resource allocation when coupled with commonly used binary measures of societal benefit from allocation. We formulate a novel mathematical model of scarce resource allocation that accounts for heterogeneous predictive uncertainties and analyze implications for both the allocation mechanism and the realized population-level benefits. We find that when resources are very scarce, maximum marginal benefit (MMB) prioritization favors individuals with lower predictive uncertainty even at the identical underlying initial state. However, we observe a flip in prioritization when resources are abundant, targeting higher-uncertainty individuals. We illustrate the implications of our results on the PISA educational testing dataset. Our findings have meaningful ramifications for the distributional outcomes of prioritization policies in many domains touched by the theory of local justice, including the allocation of public education resources, medical triage, and homelessness services. They also reveal a new moral dilemma in the ethics of scarce resource allocation - is it just to allocate a resource to one person over another solely based on predictive uncertainty about their futures? We also assess efficiency losses under both MMB and the vulnerability-first (VF) prioritization. Our model predicts efficiency losses across all resource levels, but particularly in low-resource settings.

cs.CY↗