Search arXiv⌕ Search

arXiv · 2610.24163

Explicit Criteria for Finite-Time Identification in Sparse Primal--Dual Dynamics

Abstract

We study when selected coordinates become and remain zero in a finite-dimensional sparse-regression primal--dual flow and its exact full resolvent iteration. Invariant balls centered at \((0,z)\), with \(z\) strictly dual feasible, give computable deadlines without rank assumptions or optimizer knowledge. The certificates may be available at initialization. We determine the smallest invariant radius for the continuous flow within this family. For a prescribed positive feasibility margin, center selection is convex and admits an exact finite conic formulation. We bound the coordinate margins for all centers in this family and give a normalized correlated example attaining the bound. A composite Bregman Lyapunov estimate proves rank-free convergence without primal uniqueness and finite identification under strict dual margins. Under restricted injectivity, the discrete gap-based deadlines multiplied by the step size tend to the continuous bound for fixed data, observed state, and certificate parameters. Numerical experiments assess certificate timing. A noisy weak-form oscillator regression illustrates the difference between fitted and physical support.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Hassan Saoud. 2026-10-16. Explicit Criteria for Finite-Time Identification in Sparse Primal--Dual Dynamics. https://arxiv.org/abs/2610.24163

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Achieving Linear Speedup and Near-Optimal Complexity for Decentralized Optimization over Row-stochastic Networks

A key challenge in decentralized optimization is determining the optimal convergence rate and designing algorithms to achieve it. While this problem has been extensively addressed for doubly-stochastic and column-stochastic mixing matrices, the row-stochastic scenario remains unexplored. This paper bridges this gap by introducing effective metrics to capture the influence of row-stochastic mixing matrices and establishing the first convergence lower bound for decentralized learning over row-stochastic networks. However, existing algorithms fail to attain this lower bound due to two key issues: deviation in the descent direction caused by the adapted gradient tracking (GT) and instability introduced by the Pull-Diag protocol. To address descent deviation, we propose a novel analysis framework demonstrating that Pull-Diag-GT achieves linear speedup, the first such result for row-stochastic decentralized optimization. Moreover, by incorporating a multi-step gossip (MG) protocol, we resolve the instability issue and attain the lower bound, achieving near-optimal complexity for decentralized optimization over row-stochastic networks.

math.OC↗

Muon Dynamics as a Spectral Wasserstein Flow

Gradient normalization can stabilize deep-learning optimization, and spectral normalizations are especially natural for matrix-shaped parameter blocks; Muon is the motivating example. We study an idealized deterministic, continuous-time, vanishing-momentum version of this idea in the mean-field regime, where wide models are represented by probability measures on parameter space. Starting from normalized matrix flows, we introduce Spectral Wasserstein distances indexed by norms $γ$ on positive semidefinite matrices: the trace norm recovers the classical $W_2$ distance, the operator norm gives the Muon geometry, and Schatten norms interpolate between them. We develop a static Kantorovich formulation, a max--min robust-cost representation, and Gaussian reductions extending the Bures formula. For monotone norms, we prove equivalence with a Benamou--Brenier formulation and obtain a gradient-flow interpretation of normalized mean-field training dynamics. Numerical experiments illustrate the resulting flows for MMD objectives, Gaussian reductions, two-layer ReLU models, and shallow attention.

math.OC↗