Search arXivSearch

arXiv · 2505.05188

Smoothed analysis in compressed sensing

Abstract

Arbitrary matrices $M \in \mathbb{R}^{m \times n}$, randomly perturbed in an additive manner using a random matrix $R \in \mathbb{R}^{m \times n}$, are shown to asymptotically almost surely satisfy the so-called {\sl robust null space property}. Whilst insisting on an asymptotically optimal order of magnitude for $m$ required to attain {\sl unique reconstruction} via $\ell_1$-minimisation algorithms, our results track the level of arbitrariness allowed for the fixed seed matrix $M$ as well as the degree of distributional irregularity allowed for the entries of the perturbing matrix $R$. Starting with sub-gaussian entries for $R$, our results culminate with these allowed to have substantially heavier tails than sub-exponential ones. Throughout this trajectory, two measures control the arbitrariness allowed for $M$; the first is $\|M\|_\infty$ and the second is a localised notion of the Frobenius norm of $M$ (which depends on the sparsity of the signal being reconstructed). A key tool driving our proofs is {\sl Mendelson's small-ball method} ({\em Learning without concentration}, J. ACM, Vol. $62$, $2015$).

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Elad Aigner-Horev, Dan Hefetz, Michael Trushkin. 2025-07-26. Smoothed analysis in compressed sensing. https://arxiv.org/abs/2505.05188

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Distribution-uniform strong laws of large numbers

We revisit the question of whether the strong law of large numbers (SLLN) holds uniformly in a rich family of distributions, culminating in a distribution-uniform generalization of the Marcinkiewicz-Zygmund SLLN. These results can be viewed as extensions of Chung's distribution-uniform SLLN to random variables with uniformly integrable $q^\text{th}$ absolute central moments for $0 < q < 2$. Furthermore, we show that uniform integrability of the $q^\text{th}$ moment is both sufficient and necessary for the SLLN to hold uniformly at the Marcinkiewicz-Zygmund rate of $n^{1/q - 1}$. These proofs centrally rely on novel distribution-uniform analogues of some familiar almost sure convergence results including the Khintchine-Kolmogorov convergence theorem, Kolmogorov's three-series theorem, a stochastic generalization of Kronecker's lemma, and the Borel-Cantelli lemmas. We also consider the non-identically distributed case.

math.PR

Malliavin Calculus for rough stochastic differential equations

In this work we show that rough stochastic differential equations (RSDEs), as introduced by Friz, Hocquet, and Lê (2021), are Malliavin differentiable. We use this to prove existence of a density when the diffusion coefficients satisfies standard ellipticity assumptions. Moreover, when the coefficients are smooth and the diffusion coefficients satisfies a Hörmander condition, the density is shown to be smooth. The key ingredient is to develop a comprehensive theory of linear rough stochastic differential equations, which could be of independent interest.

math.PR

Nonasymptotic and distribution-uniform Komlós-Major-Tusnády approximation

We present nonasymptotic concentration inequalities for sums of independent and identically distributed random variables that yield asymptotic strong Gaussian approximations of Komlós, Major, and Tusnády (KMT) [1975,1976]. The constants appearing in our inequalities are either universal or explicit, and thus as corollaries, they imply distribution-uniform generalizations of the aforementioned KMT approximations. In particular, it is shown that uniform integrability of a random variable's $q^{\text{th}}$ moment is both necessary and sufficient for the KMT approximations to hold uniformly at the rate of $o(n^{1/q})$ for $q > 2$ and that having a uniformly lower bounded Sakhanenko parameter -- equivalently, a uniformly upper-bounded Bernstein parameter -- is both necessary and sufficient for the KMT approximations to hold uniformly at the rate of $O(\log n)$. Instantiating these uniform results for a single probability space yields the analogous results of KMT exactly.

math.PR