Search arXiv⌕ Search
Home/Archive/arXiv

arXiv · 2610.23842

Canonical Layer Inference for Deep Gaussian Processes via Symmetry-Breaking Augmentation

Yichen Zhu·Hengrui Luo
View original source ↗Read source document ↗Export metadata ↓

Abstract

Deep Gaussian processes (DGPs) are flexible priors for compositional regression functions, but inference for intermediate layers faces questions. The basic obstruction is an adjacent-layer symmetry: applying an invertible transformation and its inverse to two adjacent layers leaves the composed regression map unchanged. Under explicit symmetry and prior-comparability conditions, we show that the posterior may not concentrate on any prescribed intermediate-layer representation, even when the composed regression function is estimable. We then introduce an augmented $ρ$-fractional posterior that reweights layer decompositions by a non-saturating identity-deviation penalty. The augmentation changes posterior odds between symmetry-related decompositions by an exponential penalty ratio. Under proper choices of the penalty and a prior mass condition, it preserves function-level fractional posterior contraction, while shrinking the redundant layers towards the identity mapping. Thus, the likelihood does not identify a unique ``true'' set of layers; the augmentation favors identity-biased parsimonious decompositions within an equivalence class of layers; uniqueness of a selected representative is not established.

Explore related subjects

math.STstat.MEstat.TH

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Yichen Zhu, Hengrui Luo. 2026-10-16. Canonical Layer Inference for Deep Gaussian Processes via Symmetry-Breaking Augmentation. https://arxiv.org/abs/2610.23842

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Local increment inference for time-inhomogeneous drift in Gaussian processes

We study statistical inference for deterministic drifts in Gaussian process models under high-frequency observations over an expanding time horizon. Using a least squares-type contrast based on first-order increments, we establish consistency and asymptotic normality under conditions on drift accumulation and increment dependence.A key feature is that the convergence rate is determined jointly by the deterministic signal and the full covariance structure of the weighted Gaussian increments, rather than by local noise roughness alone.For power and fixed-frequency periodic drifts under Gaussian and Ornstein-Uhlenbeck covariance kernels, we derive explicit convergence rates and limiting variances, revealing distinct regimes depending on the drift structure and, for periodic drifts, the noise spectrum. These results clarify the respective roles of sampling frequency and observation horizon.

math.ST↗
arXiv2026

Benign Overfitting Property of the Minimum $\ell_q$ -norm Interpolant Estimator in Regression Problem via Feature Space Decomposition

This paper establishes high-probability, non-asymptotic upper bounds for the population excess risk of minimum $\ell_q$-norm interpolating estimators in linear regression, valid for all $1<q<\infty$ under three scenarios: convex concentration, mild moment assumptions and log-concavity. Consequently, we derive sufficient conditions for these estimators to exhibit benign overfitting. Our analysis hinges on a Feature Space Decomposition (FSD) framework, which naturally highlights the self-regularizing properties of minimum norm interpolants as well as the role of alignment between the signal and the features for benign overfitting. From a technical perspective, our approach circumvents the traditionally used Convex Gaussian Min-max Theorem (CGMT) by instead leveraging the Dvoretzky-Milman theorem. We emphasize that the FSD method has the potential to refine standard uniform convergence approaches. Furthermore, the isomorphic Dvoretzky-Milman theorem established herein -- proven under the three scenarios mentioned above -- for the $\ell_q$-norm is of independent mathematical interest.

math.ST↗
arXiv2026

Asymptotic Normality of the Hill Estimator in Linear Preferential Attachment

We prove asymptotic normality of the Hill estimator based on the largest $k_n$ degrees in a homogeneous linear preferential attachment graph with $n$ vertices. Each new vertex sends a fixed number $m\ge1$ of edges sequentially to older vertices, with attachment weight $d+δ$ and fixed $δ>-m$. Let $α=m/(2m+δ)$. For every deterministic sequence $k_n\to\infty$ satisfying $\sqrt{k_n}(k_n/n)^α\to0$, the estimator, centered at $α$ and multiplied by $\sqrt{k_n}$, converges to a centered normal law with an explicit variance strictly smaller than $α^2$. The reduction relative to the Hill variance for independent observations separates into contributions from the different degree laws at different birth times and from competition for new edges. The contribution from competition is $1/m$ times that from different birth times. Representations using Gamma and beta functions give a consistent standard error and a studentized normal limit. The proof uses martingales indexed by edge attachments and comparisons with independent pure-birth processes, while retaining the integer degrees and their ties.

math.ST↗