Search arXiv⌕ Search

arXiv subjects

David Persson

Publications and source records attributed to David Persson.

At least 19 recordsLinked to original sources
arXiv2026

Optimal near-optimality bounds for the Lanczos method for matrix functions

Let $A$ be Hermitian positive definite and let $f_m$ denote the Lanczos approximation to $f(A)b$. We prove that if $f(z)$ or $f(z) / z$ is Stieltjes, then the $A^\alpha$-norm error of the Lanczos approximation is within a factor $\tfrac{1}{2}(\kappa(A)^{E/2} + \kappa(A)^{-E/2})$ of the the best possible Krylov Subspace Method, where $\kappa(A)$ is the condition number of $A$ and $E = \max\{\alpha,1-\alpha\}$. Our result strengthens and generalizes the upper bound of [Schweitzer; SIMAX, 46.3 (2025)]. Moreover, we prove that the constant $\tfrac{1}{2}(\kappa(A)^{E/2} + \kappa(A)^{-E/2})$ is optimal.

math.NA↗
arXiv2026

A recursive butterfly factorization with optimality guarantees

We formalize a recursive format for representing a butterfly matrix. This new format naturally leads to a simple recursive algorithm for computing a quasi-optimal butterfly approximation to an arbitrary $N \times N$ matrix $A$. When the entries of $A$ are explicitly available, we show that the algorithm computes a butterfly matrix $B$ in $O(N^2)$ operations with approximation error $\|A - B\|_F$ at most a $O(\sqrt{\log(N)})$ factor away from that of the best possible approximation by a butterfly matrix. We also develop a matrix-free variant of the method, which uses $\widetilde{O}(\sqrt{N})$ matrix-vector products and $\widetilde{O}(N)$ working memory and, with high probability, returns a butterfly approximation with Frobenius norm error within a $O(N^{1/4})$-factor of the optimal error. We show that the algorithm is a reformulation of the hybrid butterfly factorization approach presented in [Liu et. al.; SISC, 43 (2021)]. Our paper therefore provides the first theoretical quasi-optimality guarantee for that algorithm.

math.NA↗
arXiv2026

Linear Systems and Eigenvalue Problems: Open Questions from a Simons Workshop

This document presents a series of open questions arising in matrix computations, i.e., the numerical solution of linear algebra problems. It is a result of working groups at the workshop Linear Systems and Eigenvalue Problems, which was organized at the Simons Institute for the Theory of Computing program on Complexity and Linear Algebra in Fall 2025. The complexity and numerical solution of linear algebra problems is a crosscutting area between theoretical computer science and numerical analysis. The value of the particular problem formulations here is that they were produced via discussions between researchers from both groups. The open questions are organized in five categories: iterative solvers for linear systems, eigenvalue computation, low-rank approximation, randomized sketching, and other areas including tensors, quantum systems, and matrix functions. (Updated to reflect the status of the open problems as of August 20, 2026.)

math.NA↗
arXiv2025

Query Efficient Structured Matrix Learning

We study the problem of learning a structured approximation (low-rank, sparse, banded, etc.) to an unknown matrix $A$ given access to matrix-vector product (matvec) queries of the form $x \rightarrow Ax$ and $x \rightarrow A^Tx$. This problem is of central importance to algorithms across scientific computing and machine learning, with applications to fast multiplication and inversion for structured matrices, building preconditioners for first-order optimization, and as a model for differential operator learning. Prior work focuses on obtaining query complexity upper and lower bounds for learning specific structured matrix families that commonly arise in applications. We initiate the study of the problem in greater generality, aiming to understand the query complexity of learning approximations from general matrix families. Our main result focuses on finding a near-optimal approximation to $A$ from any finite-sized family of matrices, $\mathcal{F}$. Standard results from matrix sketching show that $O(\log|\mathcal{F}|)$ matvec queries suffice in this setting. This bound can also be achieved, and is optimal, for vector-matrix-vector queries of the form $x,y\rightarrow x^TAy$, which have been widely studied in work on rank-$1$ matrix sensing. Surprisingly, we show that, in the matvec model, it is possible to obtain a nearly quadratic improvement in complexity, to $\tilde{O}(\sqrt{\log|\mathcal{F}|})$. Further, we prove that this bound is tight up to log-log factors. Via covering number arguments, our result extends to well-studied infinite families. As an example, we establish that a near-optimal approximation from any \emph{linear matrix family} of dimension $q$ can be learned with $\tilde{O}(\sqrt{q})$ matvec queries, improving on an $O(q)$ bound achievable via sketching techniques and vector-matrix-vector queries.

cs.DS↗
arXiv2025

On the randomized SVD in infinite dimensions

Randomized methods, such as the randomized SVD (singular value decomposition) and Nystr\"om approximation, are an effective way to compute low-rank approximations of large matrices. Motivated by applications to operator learning, Boull\'e and Townsend (FoCM, 2023) recently proposed an infinite-dimensional extension of the randomized SVD for a Hilbert-Schmidt operator $A$ that invokes randomness through a Gaussian process with a covariance operator $K$. While the non-isotropy introduced by $K$ allows one to incorporate prior information on $A$, an unfortunate choice may lead to unfavorable performance and large constants in the error bounds. In this work, we introduce a novel infinite-dimensional extension of the randomized SVD that does not require such a choice and enjoys error bounds that match those for the finite-dimensional case. Our extension implicitly uses isotropic random vectors, reflecting a choice commonly made in the finite-dimensional case. In fact, the theoretical results of this work show how the usual randomized SVD applied to a discretization of $A$ approaches our infinite-dimensional extension as the discretization gets refined, both in terms of error bounds and the Wasserstein distance. We also present and analyze a novel extension of the Nystr\"om approximation for self-adjoint positive semi-definite trace class operators.

math.NA↗
arXiv2025

The Polar Express: Optimal Matrix Sign Methods and Their Application to the Muon Algorithm

Computing the polar decomposition and the related matrix sign function has been a well-studied problem in numerical analysis for decades. Recently, it has emerged as an important subroutine within the Muon optimizer for training deep neural networks. However, the requirements of this application differ sharply from classical settings: deep learning demands GPU-friendly algorithms that prioritize high throughput over high precision. We introduce Polar Express, a new method for computing the polar decomposition. Like Newton-Schulz and other classical polynomial methods, our approach uses only matrix-matrix multiplications, making it very efficient on GPUs. Inspired by earlier work of Chen & Chow and Nakatsukasa & Freund, Polar Express adapts the update rule at each iteration by solving a minimax optimization problem. We prove that this strategy minimizes error in a worst-case sense, allowing Polar Express to converge as rapidly as possible both in the early iterations and asymptotically. We also address finite-precision issues, making it practical to use in bfloat16. When integrated into Muon, our method yields consistent improvements in validation loss for a GPT-2 model trained on one to ten billion tokens from the FineWeb dataset, outperforming recent alternatives across a range of learning rates.

cs.LG↗
arXiv2025

Quasi-optimal hierarchically semi-separable matrix approximation

We present a randomized algorithm for producing a quasi-optimal hierarchically semi-separable (HSS) approximation to an $N\times N$ matrix $A$ using only matrix-vector products with $A$ and $A^T$. We prove that, using $O(k \log(N/k))$ matrix-vector products and ${O}(N k^2 \log(N/k))$ additional runtime, the algorithm returns an HSS matrix $B$ with rank-$k$ blocks whose expected Frobenius norm error $\mathbb{E}[\|A - B\|_F^2]$ is at most $O(\log(N/k))$ times worse than the best possible approximation error by an HSS rank-$k$ matrix. In fact, the algorithm we analyze in a simple modification of an empirically effective method proposed by [Levitt & Martinsson, SISC 2024]. As a stepping stone towards our main result, we prove two results that are of independent interest: a similar guarantee for a variant of the algorithm which accesses $A$'s entries directly, and explicit error bounds for near-optimal subspace approximation using projection-cost-preserving sketches. To the best of our knowledge, our analysis constitutes the first polynomial-time quasi-optimality result for HSS matrix approximation, both in the explicit access model and the matrix-vector product query model.

math.NA↗
arXiv2025

Randomized block-Krylov subspace methods for low-rank approximation of matrix functions

The randomized SVD is a method to compute an inexpensive, yet accurate, low-rank approximation of a matrix. The algorithm assumes access to the matrix through matrix-vector products (matvecs). Therefore, when we would like to apply the randomized SVD to a matrix function, $f(A)$, one needs to approximate matvecs with $f(A)$ using some other algorithm, which is typically treated as a black-box. Chen and Hallman (SIMAX 2023) argued that, in the common setting where matvecs with $f(A)$ are approximated using Krylov subspace methods (KSMs), a more efficient low-rank approximation is possible if we open this black-box. They present an alternative approach that significantly outperforms the naive combination of KSMs with the randomized SVD, although the method lacked theoretical justification. In this work, we take a closer look at the method, and provide strong and intuitive error bounds that justify its excellent performance for low-rank approximation of matrix functions.

math.NA↗
arXiv2024

Near-optimal hierarchical matrix approximation from matrix-vector products

We describe a randomized algorithm for producing a near-optimal hierarchical off-diagonal low-rank (HODLR) approximation to an $n\times n$ matrix $\mathbf{A}$, accessible only though matrix-vector products with $\mathbf{A}$ and $\mathbf{A}^{\mathsf{T}}$. We prove that, for the rank-$k$ HODLR approximation problem, our method achieves a $(1+\beta)^{\log(n)}$-optimal approximation in expected Frobenius norm using $O(k\log(n)/\beta^3)$ matrix-vector products. In particular, the algorithm obtains a $(1+\varepsilon)$-optimal approximation with $O(k\log^4(n)/\varepsilon^3)$ matrix-vector products, and for any constant $c$, an $n^c$-optimal approximation with $O(k \log(n))$ matrix-vector products. Apart from matrix-vector products, the additional computational cost of our method is just $O(n \operatorname{poly}(\log(n), k, \beta))$. We complement the upper bound with a lower bound, which shows that any matrix-vector query algorithm requires at least $\Omega(k\log(n) + k/\varepsilon)$ queries to obtain a $(1+\varepsilon)$-optimal approximation. Our algorithm can be viewed as a robust version of widely used "peeling" methods for recovering HODLR matrices and is, to the best of our knowledge, the first matrix-vector query algorithm to enjoy theoretical worst-case guarantees for approximation by any hierarchical matrix class. To control the propagation of error between levels of hierarchical approximation, we introduce a new perturbation bound for low-rank approximation, which shows that the widely used Generalized Nystr\"om method enjoys inherent stability when implemented with noisy matrix-vector products. We also introduce a novel randomly perforated matrix sketching method to further control the error in the peeling algorithm.

cs.DS↗
arXiv2024

Randomized Nystr\"om approximation of non-negative self-adjoint operators

The randomized singular value decomposition (SVD) has become a popular approach to computing cheap, yet accurate, low-rank approximations to matrices due to its efficiency and strong theoretical guarantees. Recent work by Boull\'e and Townsend (FoCM, 2023) presents an infinite-dimensional analog of the randomized SVD to approximate Hilbert-Schmidt operators. However, many applications involve computing low-rank approximations to symmetric positive semi-definite matrices. In this setting, it is well-established that the randomized Nystr\"om approximation is usually preferred over the randomized SVD. This paper explores an infinite-dimensional analog of the Nystr\"om approximation to compute low-rank approximations to non-negative self-adjoint trace-class operators. We present an analysis of the method and, along the way, improve the existing infinite-dimensional bounds for the randomized SVD. Our analysis yields bounds on the expected value and tail bounds for the Nystr\"om approximation error in the operator, trace, and Hilbert-Schmidt norms. Numerical experiments on integral operators arising from Gaussian process sampling and Bayesian inverse problems are used to validate the proposed infinite-dimensional Nystr\"om algorithm.

math.NA↗
arXiv2023

Algorithm-agnostic low-rank approximation of operator monotone matrix functions

Low-rank approximation of a matrix function, $f(A)$, is an important task in computational mathematics. Most methods require direct access to $f(A)$, which is often considerably more expensive than accessing $A$. Persson and Kressner (SIMAX 2023) avoid this issue for symmetric positive semidefinite matrices by proposing funNystr\"om, which first constructs a Nystr\"om approximation to $A$ using subspace iteration, and then uses the approximation to directly obtain a low-rank approximation for $f(A)$. They prove that the method yields a near-optimal approximation whenever $f$ is a continuous operator monotone function with $f(0) = 0$. We significantly generalize the results of Persson and Kressner beyond subspace iteration. We show that if $\widehat{A}$ is a near-optimal low-rank Nystr\"om approximation to $A$ then $f(\widehat{A})$ is a near-optimal low-rank approximation to $f(A)$, independently of how $\widehat{A}$ is computed. Further, we show sufficient conditions for a basis $Q$ to produce a near-optimal Nystr\"om approximation $\widehat{A} = AQ(Q^T AQ)^{\dagger} Q^T A$. We use these results to establish that many common low-rank approximation methods produce near-optimal Nystr\"om approximations to $A$ and therefore to $f(A)$.

math.NA↗
arXiv2022

Randomized low-rank approximation of monotone matrix functions

This work is concerned with computing low-rank approximations of a matrix function $f(A)$ for a large symmetric positive semi-definite matrix $A$, a task that arises in, e.g., statistical learning and inverse problems. The application of popular randomized methods, such as the randomized singular value decomposition or the Nystr\"om approximation, to $f(A)$ requires multiplying $f(A)$ with a few random vectors. A significant disadvantage of such an approach, matrix-vector products with $f(A)$ are considerably more expensive than matrix-vector products with $A$, even when carried out only approximately via, e.g., the Lanczos method. In this work, we present and analyze funNystr\"om, a simple and inexpensive method that constructs a low-rank approximation of $f(A)$ directly from a Nystr\"om approximation of $A$, completely bypassing the need for matrix-vector products with $f(A)$. It is sensible to use funNystr\"om whenever $f$ is monotone and satisfies $f(0) = 0$. Under the stronger assumption that $f$ is operator monotone, which includes the matrix square root $A^{1/2}$ and the matrix logarithm $\log(I+A)$, we derive probabilistic bounds for the error in the Frobenius, nuclear, and operator norms. These bounds confirm the numerical observation that funNystr\"om tends to return an approximation that compares well with the best low-rank approximation of $f(A)$. Furthermore, compared to existing methods, funNystr\"om requires significantly fewer matrix-vector products with $A$ to obtain a low-rank approximation of $f(A)$, without sacrificing accuracy or reliability. Our method is also of interest when estimating quantities associated with $f(A)$, such as the trace or the diagonal entries of $f(A)$. In particular, we propose and analyze funNystr\"om++, a combination of funNystr\"om with the recently developed Hutch++ method for trace estimation.

math.NA↗
arXiv2021

Improved variants of the Hutch++ algorithm for trace estimation

This paper is concerned with two improved variants of the Hutch++ algorithm for estimating the trace of a square matrix, implicitly given through matrix-vector products. Hutch++ combines randomized low-rank approximation in a first phase with stochastic trace estimation in a second phase. In turn, Hutch++ only requires $O\left(\varepsilon^{-1}\right)$ matrix-vector products to approximate the trace within a relative error $\varepsilon$ with high probability. This compares favorably with the $O\left(\varepsilon^{-2}\right)$ matrix-vector products needed when using stochastic trace estimation alone. In Hutch++, the number of matrix-vector products is fixed a priori and distributed in a prescribed fashion among the two phases. In this work, we derive an adaptive variant of Hutch++, which outputs an estimate of the trace that is within some prescribed error tolerance with a controllable failure probability, while splitting the matrix-vector products in a near-optimal way among the two phases. For the special case of symmetric positive semi-definite matrix, we present another variant of Hutch++, called Nystr\"om++, which utilizes the so called Nystr\"om approximation and requires only one pass over the matrix, as compared to two passes with Hutch++. We extend the analysis of Hutch++ to Nystr\"om++. Numerical experiments demonstrate the effectiveness of our two new algorithms.

math.NA↗
arXiv1999

Stabilization of Chromomagnetic Fields at High Temperature?

It is well known that a tachyonic mode appears in the spectrum of Yang--Mills theory with a static uniform magnetic field, and that the free energy has an (unstable) minimum at finite magnetic field. It is argued that spontaneous generation of magnetic field does not take place at high temperature due to nonperturbative magnetic screening. Furthermore, the dispersion relation for gauge field fluctuations in an external magnetic field at high temperature is solved. The lowest energy mode is stable against spontaneous generation of magnetic fields since it acquires a thermal mass. However, the resummed free energy (by necessity computed in the imaginary time formalism) still shows an instability, unaffected by the resummation, since the self-energy is vanishing at static Matsubara frequency.

hep-ph↗
arXiv1998

Stability of large scale chromomagnetic fields in the early universe

It is well known that Yang-Mills theory in vacuum has a perturbative instability to spontaneously form a large scale magnetic field (the Savvidy mechanism) and that a constant field is unstable so that a possible ground state has to be inhomogenous over the non-perturbative scale Lambda (the Copenhagen vacuum). We argue that this spontaneous instability does not occur at high temperature when the induced field strength gB ~ Lambda^2 is much weaker than the magnetic mass squared (g^2T)^2. At high temperature oscillations of gauge fields acquire a thermal mass M ~ gT and we show that this mass stabilizes a magnetic field which is constant over length scales shorter than the magnetic screening length (g^2T)^{-1}. We therefore conclude that there is no indication for any spontaneous generation of weak non-abelian magnetic fields in the early universe.

hep-ph↗
arXiv1998

Thermal Phase Transition in Weakly Interacting Large N_C QCD

We consider thermal QCD in the large N_C limit, mainly in 1+1 dimensions. The gauge coupling is only taken into account to minimal order, by projection onto colour singlets. An expression for the free energy, exact as N_C goes to infinity, is then obtained. A third order phase transition will occur. The critical temperature depends on the ratio N_C/L, where L is the (infinite) spatial length. In the high temperature limit, the free energy will approach the same value as in the free theory, whereas we have a mesonic like phase at low temperature. Expressions for the quark condensate, <\bar\Psi \Psi >, are also obtained.

hep-ph↗
arXiv1996

Asymptotic Freedom from Thermal and Vacuum Magnetization

We calculate the effective Lagrangian for a magnetic field in spinor, scalar and vector QED. Connections are then made to $SU(N_C)$ Yang--Mills theory and QCD. The magnetization and the corresponding effective charge are obtained from the effective Lagrangian. The renormalized vacuum magnetization will depend on the renormalization scale chosen. Regardless of this, the effective charge decreasing with the magnetic field, as in QCD, corresponds to anti- screening and asymptotic freedom. In spinor and scalar QED on the other hand, the effective charge is increasing with the magnetic field, corresponding to screening. Including effects due to finite temperature and density, we comment on the effective charge in a degenerate fermion gas, increasing linearly with the chemical potential. Neglecting the tachyonic mode, we find that in hot QCD the effective charge is decreasing as the inverse temperature, in favor for the formation of a quark-gluon plasma. However, including the real part of the contribution from the tachyonic mode, we find instead an effective charge increasing with the temperature. Including a thermal gluon mass, the effective charge in hot QCD is group invariant (unlike in the two cases above), and decreases logarithmically in accordance to the vacuum renormalization group equation, with the temperature as the momentum scale.

hep-ph↗
arXiv1995

Electron Thermal Self-Energy in a Magnetic Field

Using the general form of the static energy solutions to the Dirac equation with a magnetic field, we calculate a general self-energy matrix in the Furry-picture. In the limit of high temperatures, but even higher magnetic fields, a self-consistent dispersion relation is solved. In contrast to the high temperature limit, this merely results in a small mass shift. The electron anomalous magnetic moment is calculated. The contribution from thermal fermions is found to be different from the corresponding contribution using perturbation theory and plane-wave external states. In the low temperature limit the self-energy is shown to exhibit de Haas--van Alphen oscillations. In the limit of low temperatures and high densities, the self-energy becomes very large.

hep-ph↗