Search arXivSearch

arXiv · 2608.10274

Exploration and Stopping

Abstract

We study a decision-maker who explores --- dynamically choosing what to learn --- before stopping to act. We first reduce this dynamic control problem to a static one: any exploration-and-stopping strategy is equivalent to a choice of the joint distribution of the stopped state and the stopping time, subject to one information-budget constraint at each date, and we characterize exactly which distributions are attainable. The reduced problem is a convex program with a linear objective; its dual prices information over time, and the optimal policy concavifies the stopping payoff net of these shadow prices. The curvature of the decision-maker's time preference then governs the shape of optimal exploration: convex time preference induces Poisson exploration, concave time preference confines stopping to a window whose length is controlled by the dispersion of the marginal cost of delay --- forcing an initial phase of pure exploration when the window is short --- and the linear case lies at the boundary between them. We apply the framework to real options, to the speed--accuracy tradeoff in information acquisition, and to a continuous-time exploration contest.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Yuliy Sannikov, Weijie Zhong. 2026-08-10. Exploration and Stopping. https://arxiv.org/abs/2608.10274

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Measurement of Trustworthiness of the Online Reviews

Online review platforms shape consumer decisions, yet reported ratings and comments may be unreliable when reviewers behave inconsistently. This paper models online reviews as a sequential choice problem and proposes a formal rationality pattern function that links a reviewer's current review to their revealed preference history. Building on a two-way consistency axiom for choices from nested sets, we derive an object-specific support trajectory and an associated degree measure in [0,1] (Average Propensity to Choose a Pattern, APCP) that quantifies review trustworthiness. The measure is designed to support information updating and reduce asymmetric information by discounting reviews that are inconsistent with past behavior. A worked example illustrates how the approach assigns trustworthiness grades to reviews for different objects and how these grades can complement aggregate rating statistics. Finally, a generalized theory has been established.

econ.TH

The Cesàro average criterion on infinite utility streams and its extensions

When evaluating policies that affect future generations, the most commonly used criterion is the discounted utilitarian rule. However, in terms of intergenerational fairness, it is difficult to justify prioritizing the current generation over future generations. This paper axiomatically examines impartial utilitarian rules over infinite-dimensional utility streams. We provide simple characterizations of the social welfare ordering that evaluates utility streams by their long-run average on the domain where the average exists. Furthermore, we derive the necessary and sufficient conditions for the same axioms to hold in a more general domain, the set of bounded utility streams. Some of these results are closely related to the Banach limits, a well-known generalization of the classical limit concept for streams. Thus, this paper can be seen as proposing an appealing subclass of Banach limits through axiomatic analysis.

econ.TH

The Institutional Window: Occupation- and Jurisdiction-Specific Calibration of Liability Signaling for Preserved Human Fallback Capability

Generative AI makes expert output uninformative about the human fallback capability its provider keeps in reserve. A liability commitment can signal that capability: a provider whose staff rescue more of the cases the AI fails pays damages less often, so the commitment certifies an asset built by keeping people on cases and lost by taking them off. This paper asks where contract law leaves room for such a signal. Four legal primitives map a posted cap into retained exposure and close the message space from both sides: litigation viability, the penalty doctrine, displacement of liability to the state or an indemnity pool, and mandatory control of standard terms. Where the law leaves an option of zero exposure, low types pool at zero, intermediate types separate on a schedule anchored at the mandatory floor, and high types pool at the ceiling; where it does not, separation starts at the bottom type. A statutory floor removes the lower pool but pushes the schedule toward the ceiling, so its net effect is not monotone. The penalty doctrine decides whether recovery adequate for deterrence can be restored by contract or only by investing in verifiability. Holding fallback skill constant demands more human engagement the less often the AI fails. A calibration to five occupations and twelve legal configurations in Germany, Austria, Switzerland, the United Kingdom and the United States locates the binding margin of each cell and supports no ranking by legal family or contracting channel.

econ.TH