Search arXivSearch

arXiv · 2508.03867

Constraining the outputs of ReLU neural networks

Abstract

We introduce a class of algebraic varieties naturally associated with ReLU neural networks, arising from the piecewise linear structure of their outputs across activation regions in input space, and the piecewise multilinear structure in parameter space. By analyzing the rank constraints on the network outputs within each activation region, we derive polynomial equations that characterize the functions representable by the network. We further investigate conditions under which these varieties attain their expected dimension, providing insight into the expressive and structural properties of ReLU networks.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Yulia Alexandr, Guido Montúfar. 2026-06-12. Constraining the outputs of ReLU neural networks. https://arxiv.org/abs/2508.03867

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

The Brauer-Manin obstruction for stacky curves

We show that the Brauer-Manin obstruction is the only obstruction to strong approximation for all stacky curves over global fields with finite abelian fundamental groups. This includes all stacky curves of genus $g = \frac{1}{2}$, thus explaining a recent counterexample to the Hasse principle of Bhargava-Poonen. We will furthermore show that the elementary obstruction is the only obstruction to the integral Hasse principle for smooth proper integral models of stacky curves of genus $g < 1$. We then compute the Brauer-Manin obstruction for smooth proper integral models of stacky curves of genus $\frac{1}{2}$.

math.AG

Tropicalization of super Gromov-Witten invariants

We show that genus-0, $n$ Neveu-Schwarz marked, super Gromov-Witten invariants of a convex, toric variety $X$ can be defined and computed using tropical geometry. When $X$ is a point, the tropical, super Gromov-Witten invariants of $X$ are descendant invariants on the moduli space of tropical curves. When $X$ is a general convex, toric variety, we define a procedure that computes the tropical, inverse Euler class of the SUSY normal bundle $\overline{N}_{n, β} \rightarrow \overline{\mathcal{M}}_{0,n}(X, β)$, under the assumption that $\overline{N}_{n, β}$ is in some sense locally tropicalizable. We define the tropical, genus-0, $n$ Neveu-Schwarz marked, super Gromov-Witten invariants of $X$, and show that the definition recovers the tropical, super Gromov-Witten invariants of a point. We compute a tropical, super Gromov-Witten invariant of $\mathbb{P}^1$.

math.AG

Optimal bounds for local volumes of threefold singularities

We establish an optimal upper bound for local volumes of Gorenstein canonical non-hypersurface threefold singularities. Specifically, we show that a klt threefold singularity with local volume at least $9$ is either a hypersurface singularity or a quotient singularity. As applications, we obtain new restrictions on the singularities of members in K-moduli spaces of Fano threefolds, and we establish a sharp inequality between local volumes and minimal log discrepancies for threefold singularities.

math.AG