Search arXivSearch

arXiv · 2503.02654

Hamilton-Jacobi-Bellman Equations in the Wasserstein Space for the Optimal Control of the Kushner-Stratonovich Equation

Abstract

This paper develops a comparison theorem for viscosity solutions of a new class of Hamilton-Jacobi-Bellman (HJB) equations, which is used to solve the separated problem governed by the K-S equation in the Wasserstein space. A distinctive feature of these HJB equations is the simultaneous presence of variational and Lions derivatives, an inevitable consequence of a nonzero observation function. Moreover, the presence of state-dependent correlated noise adds further complexity to the analysis, making the proof of the comparison theorem more challenging. The core proof strategy for the comparison theorem is to introduce a novel adaptation of the doubling variables argument, specifically tailored to tackle the challenges posed by the Wasserstein space. To this end, we construct an entirely new bivariate functional that combines viscosity sub/supsolutions, a smooth gauge-type function, and two Gaussian regularized entropy penalizations. The gauge-type function compensates for the non-differentiability (in the Lions sense) of the 2-Wasserstein distance, while the entropy penalizations ensure that the maximal point of the functional is well-behaved. Another major contribution of this paper is the derivation of the second-order variational and Lions derivatives of the gauge-type function and entropy functional, which are crucial for dealing with the second-order HJB equation. Meanwhile, the simple structure and pleasing regularity of these derivatives make the methodologies developed in this paper applicable within a wider range of theoretical settings. This paper gives the first result concerning the uniqueness of viscosity solutions for second-order HJB equations with variational derivatives in the Wasserstein space.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Hexiang Wan, Jie Xiong. 2025-03-04. Hamilton-Jacobi-Bellman Equations in the Wasserstein Space for the Optimal Control of the Kushner-Stratonovich Equation. https://arxiv.org/abs/2503.02654

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Renormalized Lambert-W Cascade and Finite-Time Amplification and Blowup for reconstructed b Dynamics on T^3 for the 3D Navier Stokes Equations

This article extracts and consolidates the renormalized Lambert-$W$ branch-point cascade, its distinguished phase reduction, the exact characteristic invariant and finite-time amplification mechanism, and the extended reconstructed $b_i$ equation on $\mathbb T^3$. Repeated historical derivations are removed while the principal proofs and terminal reconstruction estimates are retained. The presentation separates exact finite-depth statements from coupled-depth asymptotics and records the hypotheses required for the extended PDE reconstruction. This paper further supports a recent paper \cite {moschandreou2026exploration} published by the corresponding author which claims that the Navier Stokes equations lose smoothness in finite time from initial smooth data.

math.AP

Unconditional uniqueness for the derivative nonlinear Schrödinger equation by normal form approach

We prove uniqueness of solutions to the Cauchy problem for the derivative nonlinear Schrödinger equation in $L^\infty_tH^{1/2}_x$. Our proof is based on the method of normal form reduction (NFR), which has been employed to obtain the uniqueness in $C_tH^s_x$, $s>1/2$. To overcome logarithmic divergences at the $H^{1/2}$ regularity, we exploit the $B^{0+}_{\infty,1}$ control of solutions provided by a refined Strichartz estimate. Our NFR argument consists of two stages: we first use NFR finitely many times to derive an intermediate equation in which the main cubic nonlinearity is restricted to a certain type of frequency interaction; we then apply the infinite NFR scheme to the intermediate equation. Moreover, we modify the usual NFR argument relying on continuity in time of solutions so that the uniqueness in the class $L^\infty_tH^{1/2}_x$ can be obtained directly.

math.AP

Equivalence between solvability of the Dirichlet and Regularity problem under an $L^1$ Carleson condition on $\partial_t A$

We study an elliptic operator $L:=-\mathrm{div}(A\nabla \cdot)$ on the upper half space. It is known that solvability of the Regularity problem in $\dot{W}^{1,p}$ implies solvability of the adjoint Dirichlet problem in $L^{p'}$. Previously, Shen (2007) established a partial reverse result. In our work, we show that if we assume a mixed \(L^1-L^\infty\) condition on only \(|\partial_t A|\), the full reverse direction holds. As a result, we obtain equivalence between solvability of the Dirichlet problem $(D)^*_{p'}$ and the Regularity problem $(R)_p$ under this condition. As a further consequence, we can extend the class of operators for which the $L^p$ Regularity problem is solvable by operators satisfying the mixed $L^1-L^\infty$ condition. Additionally in the case of the upper half plane, this class includes operators satisfying this this mixed \(L^1-L^\infty\) condition.

math.AP