Search arXivSearch

arXiv · 2506.06053

Some remarks on stochastic converse Lyapunov theorems

Abstract

In this brief note, we investigate some constructions of Lyapunov functions for stochastic discrete-time stabilizable dynamical systems, in other words, controlled Markov chains. The main question here is whether a Lyapunov function in some statistical sense exists if the respective controlled Markov chain admits a stabilizing policy. We demonstrate some constructions extending on the classical results for deterministic systems. Some limitations of the constructed Lyapunov functions for stabilization are discussed, particularly for stabilization in mean. Although results for deterministic systems are well known, the stochastic case was addressed in less detail, which the current paper remarks on. A distinguishable feature of this work is the study of stabilizers that possess computationally tractable convergence certificates.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Pavel Osinenko, Grigory Yaremenko. 2025-12-31. Some remarks on stochastic converse Lyapunov theorems. https://arxiv.org/abs/2506.06053

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Pivoting technique for the circle homeomorphism group

We adapt Gou{ë}zel's pivoting technique to the circle homeomorphism group. As an application, we give different proofs of Gilabert Vio's probabilistic Tits alternative and Malicet's exponential synchronization.

math.DS

Asymmetry of a class of Mellin transforms

We introduce the quantity $μ_η$, defined for every complex $s$ in the critical strip, as a transformation of the Mellin transform associated to the functions $η$. We establish a sufficient condition on $η$ under which $μ_η(s)$ and $μ_η(1-s)$ cannot both vanish outside the critical line. An application is given to the case in which $η$ is the fractional part function, and the zeros of $μ_η$ coincide with the zeros of the Riemann zeta function.

math.DS

Infinite Set of Resonances in the Linear Damped Oscillator Subject to Harmonic Forcing with Non-standard Frequency Modulation

It is shown that harmonic signals incorporating a type of weak non-standard frequency modulation (wNSFM) have interesting spectral properties, namely, time-dependent bandwidths that become increasingly broader with increasing time. As such, they represent a class of signals with frequency-time coupling in their spectra. Specifically, the weakly damped oscillator exhibits always two transient resonance captures involving two distinct harmonics possessing relatively high amplitudes over finite time intervals, while the overall response decays as $~t^{-1/2}$ as $t\rightarrow\infty$. Considering the undamped oscillator, it possesses two types of resonances, referred to as simple and non-simple resonances. Simple resonances correspond to finite-amplitude steady-state responses caused by two sustained resonance captures, in the form of two distinct modulated quasi-periodic responses, which, however are "activated" at different time instances. The necessary and sufficient conditions for non-simple resonances are given in the form of a theorem which predicts the existence of resonant harmonics and specifies the special phase conditions that the resonant harmonics must satisfy for constructive interference; the resulting undamped non-simple resonance grows unboundedly as $~t^{-1/2}$ as $t\rightarrow\infty$, in contrast to the classical resonance growth of the linear resonator with unmodulated harmonic excitation whose response grows as $~t$ as $t\rightarrow\infty$. These resonant responses are persistent to changes in the parameters of the wNSFM. Our results reveal interesting infinite sets of resonances in linear SDOF resonators under frequency-modulated excitations.

math.DS