Search arXivSearch

SEARCH · Search arXiv

Results for “math.NA”

Search indexed arXiv papers on artificial intelligence, large language models, computer vision and robotics. Read source abstracts and follow links to arXiv.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

939 records · Page 4Linked to original sources

Greedy sampling designs via reduced basis methods: optimal recovery in the uniform norm

We study optimal sampling recovery in reproducing kernel Hilbert spaces (RKHS) in the uniform norm. For every RKHS with bounded kernel, we establish new comparisons between linear sampling widths and Gelfand widths that overcome the known square-root gap, without requiring a measure or a Christoffel-type condition. Our bounds rely on nested sampling designs obtained by kernel interpolation at (weak) P-greedy points. Under additional (polynomial) decay assumptions the decay rate of the Gelfand widths directly transfers to the sampling widths. With either a logarithmic oversampling or passing to the square root of the Gelfand widths we obtain a direct comparison (requiring no decay assumption) between them. This is particularly effective for super-polynomial decay, such as in Paley-Wiener spaces. Our results follow from representations of both widths in terms of kernel translates and yield, in the opposite direction, a new existence result for a sharp reduced basis selection. Numerical experiments for Legendre, mixed-Sobolev, and Paley-Wiener kernels illustrate our findings.

math.NA

Variation Spaces for Encoder--Decoder Neural Operators: Approximation and Generalization

Inspired by the function-space theory of neural networks, we formulate and analyze a variation space for nonlinear operators between Hilbert spaces, defined through vector-valued Borel measures of bounded variation. We characterize its unit ball as the closed convex hull of a vector-valued single-neuron dictionary in Bochner spaces. For the ReLU activation, the bounded linear operators in this space are precisely the Schatten-$1$ operators, with equivalent norms. For operators in this space, we establish encoder--decoder approximation bounds in the Bochner $L^q$-norm, where the error decomposes into input and output encoding errors and a finite-width term of order $N^{-1/2}$. Under sub-Gaussian assumptions on the input and noise, we further derive high-probability generalization bounds for empirical least squares over path-norm-constrained encoder--decoder networks; the finite-sample contribution to the squared prediction error is of order $K^{-1/2}$ up to logarithmic factors. The finite-width and finite-sample constants are independent of the encoding dimensions and bases, with the latter also independent of the network width. When the encoding errors decay algebraically, these bounds yield algebraic approximation and learning rates, in contrast to the complexity barriers for Lipschitz and Fréchet differentiable operator classes.

stat.ML

32-point DFT Approximations Based on Minimal Frobenius Error and DFT Symmetries

This work introduces low-complexity, multiplierless approximations for the 32-point discrete Fourier transform. The proposed methods are obtained by minimizing the Frobenius error compared against the DFT matrix over a set of trivial multipliers. A row-wise, symmetry-constrained parameterization is employed to reduce the search space size, rendering the task computationally tractable. The resulting approximations could outperform the reference method in the literature according to energy-based error measurements. A sparse matrix factorization is provided for efficient computation; the arithmetic costs are 152 real additions and 34 bit-shifts only.

eess.SP

Numerical approximation to the invariant measure of McKean-Vlasov stochastic differential equations

Inspired by the stochastic particle method, this paper develops an easily implementable explicit scheme for McKean-Vlasov stochastic differential equations (MV-SDEs) with superlinear growth coefficients. We prove that the numerical solution of the interacting particle system (IPS) attains the optimal uniform-in-time strong convergence rate of order 1/2, and that it faithfully captures the long-term dynamics of MV-SDEs, including moment boundedness, stability, and ergodicity. In particular, the existence and uniqueness of an exchangeable numerical invariant probability measure for the IPS are established via an appropriately constructed operator semigroup. Concerning the approximation of the invariant measure, we derive a non-asymptotic error bound between the distribution of the one-particle numerical solution and the marginal distribution of the IPS's invariant measure; By the uniform-in-time propagation of chaos, we further obtain an asymptotic error bound between the one-particle marginal of the IPS's numerical invariant measure and the exact invariant measure of the MV-SDE. Numerical experiments are provided to validate the theoretical results.

math.PR

Positivity loss in bandlimited spectral reproduction on spheres

How small can the positivity loss be for an $N$-bandlimited spectral operator that exactly reproduces all modes up to degree $L$? For spherical polynomial approximation on $\mathbb S^d$, we prove that the smallest possible excess of the uniform operator norm above 1, equivalently the least positivity loss, is of sharp order $\left({L}/{(N+1)}\right)^2$ when $1\le L< N$. The lower bound follows from a Fejér peak test and a concentration estimate for bandlimited kernels, while a matching upper bound is obtained by correcting a positive Jackson operator with a smooth filter. We illustrate the result in three settings. On the circle, taking $N=sL-1$, this determines the sharp order of the generalized-projection constant above 1 and identifies the gap between the $s^{-1}$ excess of delayed de la Vallée--Poussin means and the optimal $s^{-2}$ order. For filtered hyperinterpolation, whose operator norm has long been known to be uniformly bounded, we give a quantitative lower bound on its separation from the positivity threshold 1. Finally, we identify an operator-level obstruction to maximum principles.

math.NA

Feasible approximation of matching equilibria for large-scale matching for teams problems

We propose a numerical algorithm for computing feasible and approximately optimal solutions of the matching for teams problem. Specifically, we introduce the notion of approximate matching equilibrium as a feasible approximation of a matching equilibrium with relaxed rationality, and we show that a true equilibrium is recovered in the limit of a sequence of approximate matching equilibria with sub-optimality approaching 0. In our approximation scheme, we parametrize the so-called transfer functions, and we show that tackling the resulting parametric primal and dual optimization problems yields two approximate matching equilibria as well as provable and computable lower and upper bounds for the optimal social welfare. Under a flexible Euclidean setting, we show that the approximation error of our scheme can be controlled to be arbitrarily close to 0, we derive an explicit computational complexity bound, and we develop an algorithm for computing approximate matching equilibria that is efficient for large-scale problems involving a large number of agent populations. We study three problems in our numerical experiments: a retail business problem, the Wasserstein barycenter problem, and a large-scale problem involving up to 1000 agent populations. We show that the proposed algorithm can produce nearly optimal approximate matching equilibria to provide quantitative managerial insights for policymakers, and that the computed sub-optimality estimates are much less conservative than theoretical estimates.

math.OC

An improved estimate of the intermediate internal energy in the energy-consistent HLLD scheme

The robustness of approximate Riemann solutions has been a crucial topic in computational magnetohydrodynamics, from both theoretical and practical perspectives. Recently, the widely used HLLD approximate Riemann solution was revised, becoming significantly more robust under strong magnetic fields. Yet, simplifications were needed as the compressible slow magnetoacoustic mode is not included in the HLLD scheme, and as a result non-physical density distribution has been found when having strong slow shocks. In this note, a simple fix is introduced for the estimated intermediate internal energy, providing robust results in several representative test cases, preserving pressure-positivity when the magnetic field is enhanced by a factor of 1000.

math.NA

A structure-preserving implicit-explicit method for a hyperbolic approximation of fourth-order PDEs

We introduce a novel structure-preserving numerical method for a first-order hyperbolic approximation system, which approximates the solutions of general fourth-order partial differential equations. By employing an implicit-explicit (IMEX) splitting between the stiff and non-stiff terms, we rigorously prove that the proposed scheme is energy-consistent and positivity-preserving under a CFL-type condition. Furthermore, we show that the method remains robustly stable in asymptotic regimes, with a time-step restriction that is entirely independent of the relaxation parameters. Finally, we present a series of numerical examples for thin film equations to validate the theoretical properties and efficacy of the scheme.

math.NA

Asymptotic behavior of Eckhoff's method for convergence acceleration of Dirac eigenfunction expansions

The current paper considers the problem of recovering a vector-function on $[-1,1]$ from a limited number of coefficients of its expansion into a series of eigenfunctions of a one-dimensional Dirac system. The Krylov--Lanczos--Eckhoff--Gottlieb acceleration method is examined in the situation when the boundary values it requires have to be computed from the generalized Fourier coefficients themselves. This leads to a $2q\times 2q$ linear system whose matrix is a block Vandermonde matrix; its determinant and inverse are computed explicitly, and the asymptotic $L_2$-error constant of the method is found, paralleling the classical trigonometric case.

math.NA

A Variational Method for Conformable Fractional Equations Using Rank-One Updates

We make a complete variational treatment of rank-one Proper Generalised Decomposition for separable fractional partial differential equations with conformable derivatives. The setting is Hilbertian, the energy is induced by a symmetric coercive bilinear form, and the residual is placed in the dual space. A greedy rank-one update is obtained by maximizing an energy Rayleigh quotient over the rank-one manifold, followed by an exact line search. An exact one step energy decrease identity is proved, together with geometric decay of the energy error under a weak greedy condition that measures how well the search captures the Riesz representer of the residual. The alternating least squares realization is analyzed at the level of operators, including well posedness of the alternating subproblems, a characterization of stationary points, and monotonicity of the Rayleigh quotient along the inner iteration. Discretizations based on weighted finite elements and on Grünwald type schemes are described in detail, including assembly, boundary conditions, complexity, and memory. Two model problems, a stationary fractional Poisson problem and a space time fractional diffusion problem, are treated from the continuous level down to matrices.

math.NA

Well-posedness and numerical reconstruction of a source term for linear parabolic problems with an integral constraint

This work investigates a time-dependent source identification problem for linear parabolic equations subject to an integral constraint and Neumann boundary conditions in a domain of $\mathbb{R}^d$, $d\ge 1$. We establish well-posedness and higher regularity of the solution pair in parabolic Hölder spaces. A numerical algorithm based on a finite element discretization in space and an implicit time-stepping scheme is then developed for the reconstruction of the unknown source. The resulting discrete inverse problem involves a well-conditioned operator. We show that identity Tikhonov regularization provides only uniform, nonselective shrinkage in this setting, whereas Tikhonov regularization with derivative-based penalties, analyzed through the generalized singular value decomposition, provides an effective denoising strategy. The regularization parameter is selected using the Morozov discrepancy principle. Numerical errors are evaluated using full parabolic Hölder norms, which provide a more comprehensive assessment of the reconstruction by incorporating errors in the solution, its derivatives, and the associated Hölder seminorms. Numerical experiments for smooth and piecewise constant sources demonstrate accurate and robust reconstructions under increasing levels of noise.

math.AP

Families of relative periodic orbits in the planar three-body problem via consecutive alignments

Relative periodic orbits (RPOs) are solutions of the three-body problem that are periodic in a uniformly rotating reference frame and, in general, quasi-periodic in inertial coordinates. We present a numerical procedure for computing and continuing one-parameter families of RPOs of the planar Newtonian three-body problem. The method exploits consecutive syzygies, understood here as configurations in which the three bodies are aligned and their velocities satisfy the corresponding symmetry conditions. Matching the positions and momenta at two consecutive alignments reduces the computation of RPOs to a low-dimensional nonlinear problem. Its solutions are then numerically continued, and linear stability is determined from the nontrivial eigenvalues of the rotated monodromy matrix after removing the neutral directions associated with conserved quantities and continuous symmetries. The procedure is applied to several mass distributions and initial configurations, producing families of Poincaré, Hill, and binary-type solutions. These families exhibit transitions from nearly circular to highly eccentric motion, changes of stability near resonances and turning points, and absolute periodic solutions when the rotation angle is a rational multiple of 2π. In the Hill families, the continuation connects satellite configurations with circumstellar motion as the smallest body loses its gravitational binding to the intermediate body. Circumbinary and circumstellar configurations are also obtained in the binary regime. The results illustrate the dynamical diversity of RPOs and provide coherent three-body motions that can be used as prescribed trajectories in restricted four-body models.

math.DS

Separable Nonnegative Matrix Factorization Using Powered Ratio-of-Norms Regularization

Separable nonnegative matrix factorization (SNMF) has been widely used for low-rank representation and clustering of nonnegative data, owing to its ability to produce part-based and interpretable decompositions. In particular, SNMF is closely related to graph clustering and community detection. To enhance sparsity and identifiability of the learned factors, we propose an $\ell_1^p/\ell_2$-regularized SNMF model based on a powered ratio-of-norms regularizer. The resulting formulation is nonconvex and nonsmooth, which poses significant challenges for optimization. To address this, we develop efficient algorithms based on the difference-of-convex function algorithm (DCA) and the alternating direction method of multipliers (ADMM). The proposed methods decompose the original problem into tractable subproblems, leveraging closed-form proximal operators associated with the powered norm terms. We establish descent and limiting criticality properties for the DCA scheme and convergence under standard assumptions for the ADMM scheme. Extensive numerical experiments on synthetic datasets and hand gesture classification tasks demonstrate that the proposed approach achieves competitive or improved performance in anchor identification and classification accuracy compared with existing SNMF methods, while maintaining competitive computational efficiency.

math.NA

Sharp Mixed Spectral Barron Regularity of Coulombic Many-Electron Wave Functions

We establish sharp mixed spectral Barron regularity for eigenfunctions of molecular Coulomb Hamiltonians. The mixed norm is a Fourier $L^1$ norm with one isotropic weight and coordinate-product weights, and therefore detects regularity invisible to the isotropic Barron scale. For a nonempty set $I$ of electron indices on which the wave function is antisymmetric, we derive an explicit admissible region for the isotropic order $s$ and the coordinate orders $α,β$. This region is optimal as a uniform statement over the class of clamped-nuclei Coulomb Hamiltonians. For fixed-spin components with two occupied spin blocks, it reduces to $s+α+β<1$; in the fully spin-polarized class it reduces to $s+α<1$. In particular, if $\mathcal I_σ$ denotes the family of occupied same-spin blocks determined by $σ$, then every fixed-spin spatial component $ψ_σ$ satisfies, for every $0\leqα<1$, \[ \left(\sum_{I\in\mathcal I_σ}\prod_{i\in I}\langleξ_i\rangle^α\right)\widehat{ψ_σ}\in L^1(\mathbb{R}^{3N}). \] For a fully spin-polarized state, $\mathcal I_σ=\{\{1,\ldots,N\}\}$.

math.AP

High-order smoothness and high-order collocation approximation for Volterra integral equation with multiscale and nonlinear exponent kernel

We consider a Volterra integral equation with multiscale and nonlinear exponent kernel. We propose the high-order smoothing conditions, under which the initial singularity of the solutions can be eliminated up to any prescribed order. This indicates the application of the multiscale nature of the kernel on local modification of the solutions. Then a discontinuous high-order collocation method with arbitrary polynomial degree is developed and analyzed on uniform or graded meshes based on the solution regularity. This work serves as a comprehensive extension and complement to [Zheng, Qiu and Stynes, SIAM J. Numer. Anal., to appear] in both mathematical and numerical aspects.

math.NA

Unconditionally optimal error Estimate of a linearized Second-order Fully Discrete Finite Element Method for the bioconvection flows with concentration dependent viscosity

In this paper, the coupled and decoupled BDF2 finite element discrete schemes are obtained for the time-dependent bioconvection flows problem with concentration dependent viscosity, which consisting of the Navier-Stokes equation coupled with a linear convection-diffusion equation modeling the concentration of microorganisms in a culture fluid. The unconditionally optimal error estimate for the velocity and concentration in $L^2$-norm and $H^1$-norm are proved by using finite element approximations in space and finite differences in time. Finally, the numerical results for different viscosity are showed to support the theoretical analysis.

math.NA

Fast Gauss Sums via Flash Attention

Gaussian kernel sums are the computational core of maximum mean discrepancies (MMDs), kernel gradient flows, Stein variational gradient descent (SVGD), and many other kernel methods. At the same time, softmax attention has received an extraordinary amount of hardware-aware code engineering, culminating in flash attention. We show that Gauss kernel sums with arbitrary, signed weights can be evaluated via flash attention: two small input augmentations turn the normalized softmax reduction into the unnormalized Gauss sum, without writing a single line of custom GPU code. For feature dimension D>8 in fp16, this approach beats compiled PyTorch code as well as PyKeOps kernels (often significantly) in speed, memory-overhead and accuracy. Indeed, its memory scaling remains linear.

cs.LG

Convergence of a Ramshaw-Mesina Iteration

In 1991 Ramshaw and Mesina introduced a clever synthesis of penalty methods and artificial compression methods. Its form makes it an interesting option to replace the pressure update in the Uzawa iteration. The result, for the Stokes problem, is \begin{equation} \left\{ \begin{array} [c]{cc} Step\ 1: & -\triangle u^{n+1}+\nabla p^{n}=f(x),\ {\rm in}\ Ω,\ u^{n+1}|_{\partialΩ}=0,\\ Step\ 2: & p^{n+1}-p^{n}+β\nabla\cdot(u^{n+1}-u^{n})+α^{2}\nabla\cdot u^{n+1}=0. \end{array} \right. \end{equation} For saddle point problems, including Stokes, this iteration converges under a condition similar to the one required for Uzawa iteration.

math.NA