Search arXivSearch

arXiv · 2601.02418

Mean Field Variational Bayesian Inference and Statistical Mechanics of Gaussian Mixture Model

Abstract

One of the main modeling in many data science applications is the Gaussian Mixture Model (GMM), and Mean Field Variational Bayesian Inference (MFVBI) is classically used for approximate fast computation. In this paper, our aim is to lay a mathematical foundation for a rigorous analysis of the MFVBI applied to the GMM. Several fundamental key concepts from statistical mechanics surge naturally throughout our process. It turns out that GMM can be considered as a generalization of Curie-Weiss model in statistical mechanics. The standard quantities like partition function, Legendre transform and free energy come into operation. The initial system of equation \eqref{introp} reduces to a simpler \eqref{bonyi}. We introduce a temperature parameter in order to accommodate a phase transition phenomena which can finally guarantee the accuracy of the solutions to MFVBI.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Alireza Bahraini, Saeed Sadeghi. 2026-06-24. Mean Field Variational Bayesian Inference and Statistical Mechanics of Gaussian Mixture Model. https://arxiv.org/abs/2601.02418

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

On the topology of manifolds with nonnegative Ricci curvature and linear volume growth

Understanding the relationships between geometry and topology is a central theme in Riemannian geometry. We establish two results on the fundamental groups of open (complete and noncompact) $n$-manifolds with nonnegative Ricci curvature and linear volume growth. First, we show that the fundamental group of such a manifold contains a subgroup $\mathbb{Z}^k$ of finite index, where $0\le k\le n-1$. Second, we prove that if the Ricci curvature is positive everywhere, then the fundamental group is finite. The proofs are based on an analysis of the equivariant asymptotic geometry of successive covering spaces and a plane/halfplane rigidity result for RCD spaces.

math.DG

K-polystability of Asymptotically Conical Kähler-Ricci Shrinkers

Recently, Sun-Zhang have developed an algebraic theory for Kähler-Ricci shrinkers showing that they admit the structure of a polarized Fano fibration $(π: X \to Y, ξ)$. In particular, they conjecture that existence of a Kähler-Ricci shrinker metric is equivalent to a notion of K-stability. We prove one direction of this conjecture, namely that existence of a Kähler-Ricci shrinker metric $g$ implies K-polystability of $(π: X \to Y, ξ)$, in the case that the Ricci curvature of $g$ decays at infinity. As an application, we give a non-existence result: if $M$ is the blowup of a six-dimensional quadric along a two-dimensional subquadric, then the total space $X$ of the cube root of $K_M$ is a polarized Fano fibration not admitting a Kähler-Ricci shrinker.

math.DG

Observações sobre funções potenciais de variedades quase-Einstein não compactas

Neste artigo, estudamos o conjunto de funções potenciais em variedades quase Einstein não compactas. Mostramos que o espaço de todas as funções potenciais positivas em uma variedade tridimensional não compacta quase-Einstein tem dimensão no máximo dois, e que a igualdade vale se e somente se a variedade for isométrica a um produto $B\times\mathbb{R}$, onde $B$ é uma superfície $λ$-Einstein ou um dos exemplos obtidos por L. Berard Bergery e descritos no livro de Besse. Além disso, provamos que qualquer variedade quase-Einstein assintoticamente plana $n$-dimensional com $λ=0$ é necessariamente Ricci-plana.

math.DG