Search arXiv⌕ Search

arXiv · 0704.3603

Rapid Mixing of Gibbs Sampling on Graphs that are Sparse on Average

Abstract

In this work we show that for every $d < \infty$ and the Ising model defined on $G(n,d/n)$, there exists a $β_d > 0$, such that for all $β< β_d$ with probability going to 1 as $n \to \infty$, the mixing time of the dynamics on $G(n,d/n)$ is polynomial in $n$. Our results are the first polynomial time mixing results proven for a natural model on $G(n,d/n)$ for $d > 1$ where the parameters of the model do not depend on $n$. They also provide a rare example where one can prove a polynomial time mixing of Gibbs sampler in a situation where the actual mixing time is slower than $n \polylog(n)$. Our proof exploits in novel ways the local treelike structure of Erdős-Rényi random graphs, comparison and block dynamics arguments and a recent result of Weitz. Our results extend to much more general families of graphs which are sparse in some average sense and to much more general interactions. In particular, they apply to any graph for which every vertex $v$ of the graph has a neighborhood $N(v)$ of radius $O(\log n)$ in which the induced sub-graph is a tree union at most $O(\log n)$ edges and where for each simple path in $N(v)$ the sum of the vertex degrees along the path is $O(\log n)$. Moreover, our result apply also in the case of arbitrary external fields and provide the first FPRAS for sampling the Ising distribution in this case. We finally present a non Markov Chain algorithm for sampling the distribution which is effective for a wider range of parameters. In particular, for $G(n,d/n)$ it applies for all external fields and $β< β_d$, where $d \tanh(β_d) = 1$ is the critical point for decay of correlation for the Ising model on $G(n,d/n)$.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Elchanan Mossel, Allan Sly. 2009-01-29. Rapid Mixing of Gibbs Sampling on Graphs that are Sparse on Average. https://arxiv.org/abs/0704.3603

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Scaling Limits of Density Fluctuation Fields of the Symmetric Partial Exclusion Processes Approaching the Zero Range Process

We study equilibrium fluctuations for the symmetric partial exclusion process (SPEP) on the one-dimensional integer lattice $\mathbb{Z}$, an interacting particle system in which each site is occupied by at most $α$ particles. We assume that the jump rate is decomposable and that the instantaneous current admits a gradient form. Our aim is to study the scaling limit of the density fluctuation field of the SPEP starting from an invariant measure and to derive the corresponding stochastic partial differential equation (SPDE). A distinctive feature of our setting is that the maximum number of particles per site depends on the scaling parameter $n$ as $α=α_n \propto n^a$ for some $a>0$, so that the model interpolates between the partial exclusion process ($α<\infty$) and the symmetric zero range process (SZRP, $α= \infty$). Under the diffusive rescaling in which the lattice spacing is $1/n$ and time is accelerated by a factor $n^2$, we prove that the density fluctuation field converges to the solution of the stochastic heat equation. The limiting SPDE coincides with the one obtained for the SZRP. A key ingredient in the proof is the convergence, under a suitable rescaling, of the partition function of the reversible measure of the SPEP to that of the SZRP. This convergence implies that expectations of a wide class of local functions under the reversible measure of the SPEP converge to the corresponding expectations under the reversible measure of the SZRP, and provides a rigorous sense in which the SPEP approximates the SZRP as $n\to\infty$.

math.PR↗

Free energy and fluctuations of generalized bipartite Sherrington-Kirkpatrick models and generalized Hopfield models

We consider the free energy of generalized bipartite Sherrington-Kirkpatrick models in the high temperature regime, with one spin normalized and the other either normalized or i.i.d. We derive a unified formula for the limiting free energy in both settings. We also prove that the fluctuations of the free energy converge to a Gaussian distribution under mild assumptions. The proof is based on a bipartite multigraph expansion, which also gives free energy results for generalized Hopfield models and log likelihood ratio of spiked rectangular models.

math.PR↗

Refined Cramér-type moderate deviations by Stein's method under dependence

In this paper, we establish refined Cramér-type moderate deviations for dependent random variables at any fixed order $m\geq3$. Combining higher-order Stein identities with exponential tilting, we obtain cumulant-corrected tail approximations with explicit error bounds for boundedly supported kernels. Our main application gives a fourth-order expansion under bounded local dependence, reaching an $O(n^{3/10})$ deviation range under standard normalization with fixed dependence parameters. It improves on previous work in both deviation range and applicability, and also covers bounded $m$-dependent sequences without an independent-base representation. Further applications to the generalized combinatorial central limit theorem and the Curie-Weiss model also extend some earlier results under permutation and mean-field dependence.

math.PR↗