Search arXiv⌕ Search
Home/Archive/arXiv

arXiv · 1206.0500

Binary hidden Markov models and varieties

Andrew J. Critch
View original source ↗Read source document ↗Export metadata ↓

Abstract

The technological applications of hidden Markov models have been extremely diverse and successful, including natural language processing, gesture recognition, gene sequencing, and Kalman filtering of physical measurements. HMMs are highly non-linear statistical models, and just as linear models are amenable to linear algebraic techniques, non-linear models are amenable to commutative algebra and algebraic geometry. This paper closely examines HMMs in which all the hidden random variables are binary. Its main contributions are (1) a birational parametrization for every such HMM, with an explicit inverse for recovering the hidden parameters in terms of observables, (2) a semialgebraic model membership test for every such HMM, and (3) minimal defining equations for the 4-node fully binary model, comprising 21 quadrics and 29 cubics, which were computed using Grobner bases in the cumulant coordinates of Sturmfels and Zwiernik. The new model parameters in (1) are rationally identifiable in the sense of Sullivant, Garcia-Puente, and Spielvogel, and each model's Zariski closure is therefore a rational projective variety of dimension 5. Grobner basis computations for the model and its graph are found to be considerably faster using these parameters. In the case of two hidden states, item (2) supersedes a previous algorithm of Schonhuth which is only generically defined, and the defining equations (3) yield new invariants for HMMs of all lengths $\geq 4$. Such invariants have been used successfully in model selection problems in phylogenetics, and one can hope for similar applications in the case of HMMs.

Explore related subjects

math.AGstat.ML

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Andrew J. Critch. 2012-09-03. Binary hidden Markov models and varieties. https://arxiv.org/abs/1206.0500

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

G3-Criteria and Applications

The G3-property of a subvariety was introduced by Hironaka-Matsumura, and plays an important role for deducing connectedness and extension results. Unfortunately, it's a rather elusive notion, which is not always easy to establish. Most of the existing work is concentrated on subvarieties of homogeneous varieties. The first goal of this article is to show that mobility assumptions on the subvariety, considered in works of Badescu, Chow, Debarre, Voisin, yield a certain partial positivity property, slightly stronger than G3, previously introduced by the author. Second, we apply the result to prove that, in numerous situations, the splitting of the normal bundle of a smooth two-codimensional subvariety implies that it is a complete intersection.

math.AG↗
arXiv2026

Moduli Stacks of $G$-Curves in Homotopy Theory at Height $p-1$

Let $p$ be odd and $G' = \mathbb{Z}/p \rtimes \mathbb{Z}/(p-1)^2$ the maximal finite subgroup of the Morava stabilizer group at height $p-1$. Inverse Galois theory produces from $G'$ alone a curve $X$, the unique curve of minimal genus with $\operatorname{Aut}(X) \simeq G'$; its ramification, its field of definition and its equation are consequences of the group, not choices. We prove a $G'$-equivariant equivalence between the deformations of $X$ and Lubin--Tate space, so that the Lubin--Tate action of $G'$ is the action of $\operatorname{Aut}(X)$ on deformations of the curve. The proof is a coordinate-free Kodaira--Spencer argument reducing to a single character count. The action becomes explicit: $G'$ acts through $\mathbb{F}_p \rtimes \mathbb{F}_p^\times$ shifting and scaling $p+1$ points on $\mathbb{P}^1$. From this we compute $H^*(G', π_* E_{p-1})$ and its Tate cohomology. One identity, $π^{p-1} = -p$, runs through every section.

math.AG↗