Search arXiv⌕ Search
Home/Archive/arXiv

arXiv · 2606.18440

Algebraic Networks and Architectural Degenerations

Giacomo Graziani
View original source ↗Read source document ↗Export metadata ↓

Abstract

We study the geometry of polynomial neural networks with monomial activation functions and no bias. We introduce a general framework of algebraic networks, together with their realization maps and associated affine neurovarieties. In this setting we define morphisms, subnetworks, symmetry groups and quotient parameter spaces and we discuss geometric notions of identifiability and reducibility. Our main goal is to relate the singularities of neurovarieties to degenerations of the underlying architecture. For fully connected networks, we define the architectural degeneracy locus as the locus of functions admitting a representation by parameters with a rank-deficient layer or an inactive hidden neuron. We prove that, for fully connected networks with non-increasing widths and scalar output, full parameters give smooth points of the corresponding neurovariety under explicit layerwise regularity assumptions. In particular, for these architectures, the singular locus is contained in the architectural degeneracy locus.

Explore related subjects

math.AG

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Giacomo Graziani. 2026-06-16. Algebraic Networks and Architectural Degenerations. https://arxiv.org/abs/2606.18440

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Shrinking dynamic on multidimensional tropical series

Let $Ω\subset\mathbb R^n$ be a compact convex domain. An $Ω$-tropical series is a nonnegative, concave, integral-slope, piecewise-affine function on $Ω$ that vanishes on $\partialΩ$. For a finite set $P\subsetΩ^\circ$, we study the least such function above prescribed initial data whose corner locus contains $P$. It is obtained by repeatedly applying one-point shrinking operators $G_p$. We prove that every fair order of these operators stabilizes after finitely many nontrivial steps. We also describe an event-driven implementation that records the lowest monomials at each point and updates only affected watcher lists. Finally, we show that, on every compact subset of $Ω^\circ$, the resulting dynamics can be approximated by a finite path whose intermediate tropical hypersurfaces have only mild singularities on that compact set; equivalently, the corresponding local cells of the dual regular subdivision contain no lattice points other than their vertices.

math.AG↗
arXiv2026

A stacky $p$-adic Riemann--Hilbert correspondence on Hitchin-small locus

Let $C$ be an algebraically closed perfectoid field over $\mathbb{Q}_p$ with the ring of integer $\mathcal{O}_C$ and the infinitesimal thickening $\Ainf$. Let $\mathfrak X$ be a semi-stable formal scheme over $\mathcal{O}_C$ with a fixed flat lifting $\widetilde{\mathfrak X}$ over $\Ainf$. Let $X$ be the generic fiber of $\mathfrak{X}$ and $\widetilde X$ be its lifting over $\BdRp$ induced by $\widetilde{\mathfrak X}$. Let $\MIC_r(\widetilde X)^{{\rm H}\text{-small}}$ and $\rL\rS_r(X,\BBdRp)^{{\rm H}\text{-small}}$ be the $v$-stacks of rank-$r$ Hitchin-small integrable connections on $X_{\et}$ and $\BBdRp$-local systems on $X_{v}$, respectively. In this paper, we establish an equivalence between these two stacks by introducing a new period sheaf with connection $(\calO\bB_{\dR,\pd}^+,\rd)$ on $X_{v}$.

math.AG↗
arXiv2026

A refinement of the coherence conjecture of Pappas and Rapoport

The coherence conjecture of Pappas and Rapoport, proved by Zhu, asserts the equality of dimensions for the global sections of a line bundle over a spherical Schubert variety in the affine Grassmannian and those of another line bundle over a certain union of Schubert varieties in a partial affine flag variety. We refine this equality of dimensions to an isomorphism of representations. The comparison is established by introducing a parahoric Bruhat-Tits group scheme $\mathcal{G}$ over the affine line, ramified at 0. We further strengthen this comparison by equipping any line bundle on the global Schubert variety of $\mathcal{G}$ with a unique equivariant structure under the global jet group scheme. As an application, we obtain new relations among affine Demazure modules.

math.AG↗