Search arXivSearch

arXiv · 2307.12597

A unified perspective on exponential tilt and bridge algorithms for rare trajectories of discrete Markov processes

Abstract

This article analyzes and compares two general techniques of rare event simulation for generating paths of Markov processes over fixed time horizons: exponential tilting and stochastic bridge. These two methods allow to accurately compute the probability that a Markov process ends within a rare region, which is unlikely to be attained. Exponential tilting is a general technique for obtaining an alternative or tilted sampling probability measure, under which the Markov process becomes likely to hit the rare region at terminal time. The stochastic bridge technique involves conditioning paths towards two endpoints: the terminal point and the initial one. The terminal point is generated from some appropriately chosen probability distribution that covers well the rare region. We show that both methods belong to the class of importance sampling procedures, by providing a common mathematical framework of these two conceptually different methods of sampling rare trajectories. We also conduct a numerical comparison of these two methods, revealing distinct areas of application for each Monte Carlo method, where they exhibit superior efficiency. Detailed simulation algorithms are provided.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Javier Aguilar, Riccardo Gatto. 2024-05-14. A unified perspective on exponential tilt and bridge algorithms for rare trajectories of discrete Markov processes. https://doi.org/10.1103/physreve.109.034113

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

The free energy of the square lattice Ising model with interactions alternating in horizontal and vertical directions

The free energy of the Ising model on the square lattice with alternating interactions in both horizontal and vertical directions is exactly derived. This model is distinct from the checkerboard Ising model. The result includes Onsager's free energy as a special case, and also includes Lee-Yang's free energy with an imaginary field, and relates these two solutions via continuous parameters. The result includes a generalization of Lee-Yang's result to cases with four different couplings. It is also derived that each imaginary magnetic field $iπ/2$ applied to a lattice site corresponds to a single frustrated square in its dual lattice.

cond-mat.stat-mech

Ideal heat engine cycles at maximal efficiency -- the ideal gas and beyond

Given a particular heat engine cycle, what is the optimal working medium that results in the highest efficiency? While one might jump to the conclusion that it must surely be the ideal gas, the situation is actually more intricate. Starting with a general Helmholtz potential that depends polynomially on molar volume and temperature we derive exact expressions for the ideal Stirling, Otto, and Brayton cycles. We find that for the thermodynamic systems described by our ansatz for the Helmholtz potential the maximal efficiency is achieved, if the working medium is described by a fundamental relation linear in temperature. This includes the ideal gas, but also classical harmonic oscillators and phenomenological models of the rubber band.

cond-mat.stat-mech

Local Detailed Balance in the Lorenz Model: Replaces the Butterfly with Frenetic Bursting

The Lorenz system is the canonical low-order model of convective instability, yet its dissipative and driving terms have never been checked against, nor constructed from, an explicit thermodynamic bookkeeping. We derive a modification that satisfies the local-detailed-balance condition for macroscopic relaxation toward nonequilibrium steady states, thereby identifying the thermodynamic force, entropy-production rate and frenesy of the resulting flow. The resulting model produces a transition from a quiescent fixed point to a robust, large-amplitude relaxation oscillation, closely analogous to recharge-discharge oscillator paradigms used for the El Nino-Southern Oscillation. The system alternates between a long, nearly reversible recharge phase and a brief, violently frenetic discharge burst, during which essentially all of the cycle's activity and entropy production is concentrated.

cond-mat.stat-mech