Search arXivSearch

arXiv · 2412.18337

The Value of AI-Generated Metadata for UGC Platforms: Evidence from a Large-scale Field Experiment

Abstract

AI-generated content (AIGC), such as advertisement copy, product descriptions, and social media posts, is becoming ubiquitous in business practices. However, the value of AI-generated metadata, such as titles, remains unclear on user-generated content (UGC) platforms. To address this gap, we conducted a large-scale field experiment on a leading short-video platform in Asia to provide about 1 million users access to AI-generated titles for their uploaded videos. Our findings show that the provision of AI-generated titles significantly boosted content consumption, increasing valid watches by 1.6% and watch duration by 0.9%. When producers adopted these titles, these increases jumped to 7.1% and 4.1%, respectively. This viewership-boost effect was largely attributed to the use of this generative AI (GAI) tool increasing the likelihood of videos having a title by 41.4%. The effect was more pronounced for groups more affected by metadata sparsity. Mechanism analysis revealed that AI-generated metadata improved user-video matching accuracy in the platform's recommender system. Interestingly, for a video for which the producer would have posted a title anyway, adopting the AI-generated title decreased its viewership on average, implying that AI-generated titles may be of lower quality than human-generated ones. However, when producers chose to co-create with GAI and significantly revised the AI-generated titles, the videos outperformed their counterparts with either fully AI-generated or human-generated titles, showcasing the benefits of human-AI co-creation. This study highlights the value of AI-generated metadata and human-AI metadata co-creation in enhancing user-content matching and content consumption for UGC platforms.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Xinyi Zhang, Chenshuo Sun, Renyu Zhang, Khim-Yong Goh. 2024-12-24. The Value of AI-Generated Metadata for UGC Platforms: Evidence from a Large-scale Field Experiment. https://arxiv.org/abs/2412.18337

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Local Media and the Shaping of Social Norms: Evidence from the Ebola outbreak

Media's influence on norms and behavior is widely recognized. Less is known about the role played by media being local. I examine this in a high-stakes context, the Ebola outbreak in Guinea. I exploit quasi-random variation in access to radio and the timing of a public-health campaign aired on community radio. I find that 12-17% of Ebola cases could have been prevented if places with access to a neighboring community radio station had instead had their own. Impacts are driven by radio being local rather than by ethno-linguistic belonging. Local media facilitates coordination in behaviors observed and sanctioned locally.

econ.GN

Productivity Shocks and Input Misallocation: A Decomposition

This paper asks how much input misallocation productivity uncertainty generates and at which stage of input decisions it arises. I separate revenue productivity by when each component is revealed and trace each into the gap between an input's marginal revenue product and its price. In six European countries, shocks revealed after an input is committed account for 20 percent of capital gap dispersion and 5 percent of labor gap dispersion. An unanticipated one percent rise in productivity raises the capital gap by 0.92 percent and the labor gap by 0.19 percent, because most of the shock passes into the wage.

econ.GN

When Do Type-Specific Wages Buffer Distributional Incidence in TANK?

When do relative wages buffer the unequal incidence of aggregate shocks? I derive a consumption-gap decomposition and a present-value condition for partial offset in a TANK model. An extension separates wage-setting demand elasticity from substitution between labor segments and allows each segment to contain both financial types. With a zero inherited wage gap and a same-sign discounted wedge, substitution above one gives offsetting earnings reallocation; substitution below one gives amplification. The channel disappears when financial types have identical segment exposure. Numerical experiments assess these mechanisms, shock persistence, policy feedback, and aggregate-IRF matching. In the nested perfect-alignment monetary benchmark, the peak consumption gap is about two-fifths smaller under type-specific wages than under the common-wage closure. These are conditional model comparisons, not empirical effect estimates or welfare rankings.

econ.GN