Search arXiv⌕ Search

SEARCH · Search arXiv

Search Search arXiv

Search indexed arXiv papers on artificial intelligence, large language models, computer vision and robotics. Read source abstracts and follow links to arXiv.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2Linked to original sources

A superlinear arclength endgame for corank-one singular polynomial systems

In Numerical Algebraic Geometry (NAG) isolated solutions of polynomial systems are usually computed by tracking a solution curve defined by a homotopy equation. The tracking problem becomes especially challenging close to a singular root (the ``endgame'' regime). Existing approaches include power series endgames, Cauchy endgames, and various methods that regularize the system via dual-space-based {\em deflation}. We introduce a new ``Arclength Endgame'' for corank-1 systems which combines the idea of the classical {\em pseudo-arclength continuation method} with the estimation of the Puiseux series of the curve. We formally prove that it has an R-superlinear rate of convergence in some neighborhood of the root. The method uses only evaluations of the system and its Jacobian. In contrast, previous homotopy techniques with proven superlinear convergence (such as deflation) require computing additional derivatives of the system, or need additional nondegeneracy assumptions involving higher-order derivatives of the system at the singular root. A key step in our approach (as well as in the standard power series endgame) is estimating the ratio $k_1/c$ of the Puiseux series of the curve. We present a new method for that, and discuss its advantages over previous methods.

math.NA↗

Geometry Parameterisation via a Structural Modal Basis for Aerodynamic Shape Optimisation

Aircraft outer mould lines are often heavily constrained early by payload requirements, manufacturability limits, and low-observability considerations. The remaining aerodynamic design space is typically small, highly constrained, and difficult to represent using a concise and physically meaningful set of design variables. A structural modal parameterisation method (MPM) is introduced for such problems. The method constructs a tunable pseudo-structure and solves its eigenvalue problem to obtain a modal basis, from which a selected subset of modes parameterises the geometry. Boundary conditions, stiffness distribution, density, thickness, and added masses are treated as intentional basis-design variables that shape the admissible deformation space prior to optimisation. The resulting design coordinates are independent of any specific flow solver, making the approach broadly applicable. For tightly constrained aerodynamic shape optimisation problems, it provides a practical balance of parameter conciseness, robust constraint awareness, and geometric flexibility.

math.NA↗

The Levin Method for the Summation of One-dimensional and Multidimensional Infinite Series

The Levin method transforms the evaluation of a highly oscillatory integral into the solution of a first-order linear ODE for a slowly varying auxiliary function. This ODE is typically approximated by collocation, after which the integral value is recovered from the auxiliary function at the endpoints. The present work develops a new extension of the Levin method for the summation of one-dimensional and multidimensional infinite oscillatory series. The summation problem is transformed into the solution of a functional equation involving transformed arguments of the unknown function. The resulting approach is particularly attractive in the multidimensional setting, where the range of existing numerical methods is relatively limited.

math.NA↗

Cahn-Hilliard phase-field modeling of tumor growth via locally adaptive isogeometric analysis with THB-splines

Predicting tumor dynamics in biological systems under physiologically relevant conditions using mathematical and computational models remains a challenging problem. Continuum models based on phase-field (diffuse-interface) formulations have proven to be an effective modeling strategy to govern tumor dynamics and interactions of multiple species. Within this framework, the present work investigates a tumor growth model based on the Cahn-Hilliard (CH) equation. The formulation involves a fourth-order differential operator that imposes higher continuity requirement on approximation spaces for a well-defined primal variational formulation. To address this challenge, we use isogeometric analysis (IGA), which inherently satisfies this requirement through spline-based basis functions and eliminates the need for mixed or auxiliary-variable approaches commonly used in standard finite element discretizations. Additionally, a locally adaptive IGA scheme with truncated hierarchical B-splines (THB-splines) is used to reduce computational cost while maintaining accuracy. The model is first evaluated on standard benchmark cases and then applied to an organ-scale, patient-specific geometric model of the breast reconstructed from magnetic resonance imaging (MRI) data. Our results show that the model reproduces known tumor morphologies, ranging from a spheroidal pattern to fingered growth. A series of numerical experiments further shows the diversity of tumor dynamics produced by different model parameter choices. Our findings demonstrate the predictive potential of the CH-based phase-field tumor growth model integrated with a locally adaptive IGA framework.

math.NA↗

Universal Approximation of Nonlinear Operators and Their Derivatives

We show that Universal Approximation (UA) of nonlinear operators and their derivatives via Operator Learning (OL) architectures fails in ${C^k_F}$ (Fréchet) compact-open topologies and in Fréchet--Sobolev norms (i.e. under operator norms). We solve this obstruction by restoring UA in natural weaker topologies: $C^k_B$ (Bastiani) compact-open topologies and (novel) weighted Bastiani--Sobolev spaces for general finite input measures. In full Banach-space generality, these are the first complete generalizations of the corresponding influential classical results in [Hornik, 1991] to infinite-dimensional spaces and OL. Based on our UATs, we formulate Bastiani--Sobolev training in DIOL. These results launch Derivative-Informed Operator Learning (DIOL) (i.e. learning nonlinear operators and their derivatives) on general Banach spaces. We parameterize nonlinear operators via Encoder-Decoder Architectures, classical OL architectures available in general Banach spaces; these include DeepONets, Deep-H-ONets, and PCA-Nets, which our UATs cover. A key mathematical result is that our new weighted Bastiani--Sobolev spaces generalize classical Gaussian (Malliavin) Sobolev spaces on Banach spaces. Open frontiers where DIOL and our UATs find applications are: high-order accuracy in OL; fast constrained optimization in Banach spaces (e.g. optimal control of PDEs, inverse problems) via Learn-Then-Optimize; numerical methods for infinite-dimensional PDEs (e.g. HJB PDEs on Banach spaces from infinite-dimensional optimal control via Optimize-Then-Learn, such as optimal control of PDEs, SPDEs, path-dependent systems, partially observed systems, mean-field control).

cs.LG↗

Overcoming the spatial order barrier for nonlinear SPDEs with additive space-time white noise

We introduce a fully discrete numerical scheme for semilinear SPDEs with additive space-time white noise that overcomes the previous order barrier for the spatial convergence rate. The scheme, which we refer to as the doubly accelerated exponential Euler scheme, achieves a strong convergence rate of $M^{-1+ε}$ in time and $N^{-3/2+ε}$ in space for any $ε>0$, where $M^{-1}$ and $N^{-1}$ are the temporal, respectively the spatial, meshsizes. This substantially improves the standard spatial error bounds of order $N^{-1/2}$ in the literature. Numerical simulations support the findings.

math.NA↗

Smoothed Picard Hamiltonian Monte Carlo

We develop a new low-accuracy sampler, called smoothed Picard Hamiltonian Monte Carlo, which combines Gaussian smoothing, Picard iteration, and higher-order discretization. For a log-concave target $π\propto \exp(-V)$ in dimension $d$ satisfying $0 \prec αI \preceq \nabla^2 V \preceq βI$, with condition number $κ:= β/α$, smoothed Picard HMC returns a sample with $\sqrt α\,W_2(\cdot,π) \le \varepsilon$ using $\widetilde O(κ^2 + κ^{7/6} d^{1/6}/\varepsilon^{1/3})$ gradient queries. We also prove stronger $W_q$ bounds, and then develop an algorithmic framework, the recursive warm start generator, to upgrade these $W_q$ bounds to stronger divergence guarantees. This produces a warm start for the proximal bouncy particle sampler, introduced in a companion work, leading to a high-accuracy log-concave sampler with complexity $\widetilde O((κ^{7/6} d^{1/6} + κ^{1/2} d^{1/4})\mathrm{polylog}(1/\varepsilon))$.

math.ST↗

TRACE: A spatiotemporal contact memory graph network simulator for granular dynamics

Learned graph simulators provide an efficient alternative to high-fidelity solvers for granular dynamics. However, granular motion depends strongly on inter-granular contact history, which is difficult to preserve when particle contacts form, break, and rearrange. Existing simulators mainly store temporal information in node features or node-level memory. Here we introduce TRACE, a graph-network simulator that stores interaction history directly on contact edges. Each edge maintains a persistent memory updated by attention-based message passing and a gated recurrent unit, while an edge-identity dictionary preserves this memory as the contact graph changes. A physics-structured decoder predicts inter-granular normal and tangential contact forces, enforces the Coulomb friction limit, and applies equal-and-opposite internal forces. The model is trained with single-step pretraining followed by autoregressive rollout fine-tuning. We evaluate TRACE on 2D and 3D granular column-collapse benchmarks. In both cases, TRACE produces stable, physically consistent long-horizon rollouts, closely reproducing the final deposit geometry and the kinetic energy released during collapse. Compared with graph network simulator (GNS) and node-memory graph neural simulator (NMGNS), TRACE reduces long-rollout position error by 31-62% and final-deposit error by 58-89% across the two benchmarks, while using fewer parameters and maintaining near-zero particle interpenetration. TRACE also achieves 12.2$\times$ and 8.9$\times$ speedups over the material point method (MPM) reference solver in 2D and 3D, respectively. Our code is available at https://github.com/Data-Driven-Computational-Geotechnics/TRACE.

cs.LG↗

A General Superconvergence Result for Cubature on Tesselated Polytopal Domains in Two and Three Dimensions

Cubature rules, which approximate definite integrals as a linear combination of a set of function values, are ubiquitous and necessary for computational methods in the physical sciences. A superconvergence result for cubature rules on polytopal domains in two and three dimensions is developed, whereby a rule that is exact for all bivariate polynomials of a fixed even degree realizes an extra order of convergence under a decrease in the spacing between nodes.

math.NA↗

Optimal error estimates of sequential finite element method for nonlinear thermo-poroelasticity problems

This study introduces and analyzes a three-step sequential decoupling algorithm designed to address nonlinear, fully coupled quasi-static thermo-poroelasticity systems incorporating convective transport. The finite element method is employed for spatial discretization and the backward Euler method for temporal discretization. The proposed sequential method has a higher computing efficiency than the fully implicit nonlinear numerical scheme, since it does not require any internal iterations. The well-posedness of the numerical solution is discussed by introducing a cut-off operator and the stability analysis of the algorithm is performed. Rigorous analysis yields optimal convergence order estimates for both spatial and temporal discretizations. In order to confirm the theoretical results and the effectiveness of the suggested approach, numerical experiments are finally carried out.

math.NA↗

Learning Informative Prior with Infinite-Dimensional Continuous Normalizing Flow for Bayesian Inverse Problem

This paper addresses infinite-dimensional Bayesian inference for inverse problem of partial differential equations with model parameters in infinite-dimensional Hilbert space. To effectively incorporate prior information, we propose a novel continuous normalizing flows based infinite-dimensional model. Specifically, by introducing a well-defined neural ordinary differential equation in infinite-dimensional space, a simple reference measure can be transformed into a more complex measure which encodes the prior information. A corresponding theoretical framework is established to ensure the well-posedness of our proposed Bayesian prior in infinite-dimensional space. We also provide training methods of the prior for two distinct data settings, along with two sampling algorithms for the resulting Bayesian posterior. The proposed framework is applied to three representative inverse problems: the simple smooth inverse problem, inverse scattering problem, and the inverse heat conduction problem. Numerical experiments support the theoretical analysis and demonstrate the efficiency of the proposed algorithms.

math.NA↗

Accelerated primal-dual dynamics and algorithms for convex optimization with nonlinear inequality constraints

We consider convex optimization with nonlinear inequality constraints and develop a primal-dual multiplier framework that is consistent in continuous and discrete time. We first propose continuous-time dynamics with Nesterov-type vanishing damping $α/t$, together with compatible extrapolations of the dual variable and the nonlinear constraint mapping. Under convexity assumptions and $α\geq3$, we establish $\mathcal O(t^{-2})$ convergence rates for both nonlinear feasibility and the objective residual. In the noncritical regime $α>3$, with an admissible choice of the extrapolation parameter, we further prove that the entire primal-dual trajectory converges to a KKT pair and sharpen both continuous-time estimates to $o(t^{-2})$. We then derive an inexact accelerated primal-dual algorithm through a compatible discretization of a perturbed version of the dynamic. For composite convex objectives, a weighted summability condition on the primal inexactness yields $\mathcal O(k^{-2})$ rates for feasibility and the objective residual. In the corresponding noncritical regime, the discrete primal-dual sequence converges to a KKT pair and both residual estimates improve to $o(k^{-2})$. Thus the continuous and discrete results exhibit matching accelerated rates and matching asymptotic improvements. To the best of our knowledge, this is the first Nesterov-type primal-dual multiplier framework for convex optimization with nonlinear inequality constraints.

math.OC↗

Null-Space-Free 6D Spectral Embedding with Local Rayleigh Quotient Recovery for 3D Quasiperiodic Maxwell's Eigenproblems

We develop a numerical framework for three-dimensional quasiperiodic Maxwell eigenvalue problems obtained through a six-dimensional periodic embedding. A projected Bloch--Fourier discretization yields a structured generalized eigenvalue problem with a large gradient-type kernel. Explicit orthonormal bases for the longitudinal and transverse subspaces remove this kernel exactly and reduce the original generalized eigenvalue problem to a null-space-free standard eigenvalue problem containing only the positive spectrum. An explicit inverse representation of the reduced operator avoids nested inner--outer linear solves and leads to an inverse Lanczos method whose main inner computation is a Hermitian positive definite conjugate-gradient solve with condition number bounded by that of the mass matrix; a residual estimate quantifies the effect of inner solves on the inverse Ritz pairs. To recover the computed modes in physical space, the six-dimensional Fourier eigenvectors are reconstructed on a three-dimensional Yee grid by a separated multi-center Taylor expansion, which avoids the dense Fourier-to-grid phase matrix and remains practical when direct dense reconstruction becomes prohibitively expensive. Local weighted Rayleigh quotients provide an independent physical-space validation, and their mass-weighted expectation is proved to equal the cropped Yee Rayleigh quotient under a partition-of-unity condition. Numerical experiments confirm the accuracy and computational effectiveness of the proposed framework and its physical-space recovery of three-dimensional quasiperiodic Maxwell modes.

math.NA↗

Shape Holomorphy and Sparse Approximation of the Maxwell Electric Field Integral Operator

Time-harmonic Maxwell scattering by a perfectly conducting obstacle is governed by the electric field integral equation (EFIE), whose natural energy space is $\boldsymbol H^{-1/2}(\mathrm{div}_Γ,Γ)$. For countably parametrized surface deformations, both the operator and its energy space depend on the geometry. We establish operator-valued shape holomorphy of the EFIE operator on a fixed reference space and derive dimension-independent sparse approximation rates. The main analytical difficulty is a fractional mapping property absent from existing $L^2$-based operator-valued shape-holomorphy theory for weakly singular kernels: the Maxwell graph norm requires uniform holomorphy of the complex-deformed scalar single layer as an operator from $H^{-1/2}$ to $H^{1/2}$. We prove this one-order smoothing by realizing the Laplace principal part as the trace of a uniformly sectorial complex-coefficient divergence-form problem on a fixed real ambient domain. Combined with a surface contravariant Piola transformation, which identifies the geometry-dependent Maxwell trace spaces and cancels the surface Jacobians in the pulled-back EFIE exactly, this yields $(\mathbf b,p,\varepsilon)$-holomorphy of the EFIE operator family for $\ell^p$-summable shape deformations, $0<p<1$. Under pointwise exclusion of interior electric resonances, parameter-uniform invertibility is derived rather than assumed, and the surface current and far field inherit the same parametric regularity. Their Legendre coefficients are $\ell^p$-summable, yielding dimension-independent best $N$-term approximation rates. The operator-level results also transfer to Galerkin boundary element operators on a single reference mesh, with constants independent of the discretization dimension, and provide reusable surrogates for multiple incident fields and bounded linear observables.

math.NA↗

Comparison of Algebraic Block Multi-Coloring and Leiden Methods for Parallel Preconditioning in the ICCG Method

In the application of incomplete Cholesky preconditioning to the incomplete Cholesky-conjugate gradient (ICCG) method, forward and backward substitutions exhibit sequential dependencies that constitute a major bottleneck for parallelization in multicore environments. To alleviate this bottleneck, the algebraic block multi-coloring (ABMC) method achieves both parallelism and data locality through block-wise coloring. However, ABMC requires the number of blocks to be specified as an input parameter in advance. This study evaluates the Leiden method as an alternative blocking approach for parallel preconditioning in the ICCG method. As a community detection technique that maximizes a quality function for graph partitioning, the Leiden method automatically generates blocks that reflect the matrix structure without requiring the number of blocks a priori. We partition the adjacency graphs of sparse matrices using the Leiden method and utilize the resulting blocks for parallel preconditioning. We implement the Leiden method using modularity and the constant Potts model as quality functions and compare its performance with that of the ABMC method in terms of the number of iterations, execution time, and L2 cache efficiency across eight symmetric positive definite matrices. The experimental results demonstrate that the Leiden method with the constant Potts model achieves performance comparable to that of the ABMC method configured with an optimized number of blocks.

cs.DC↗

Data sparse multilevel covariance estimation in optimal complexity

We consider the $\calH^2$-formatted compression and computational estimation of covariance functions on a compact set in $\bbR^d$. The classical sample covariance or Monte Carlo estimator is prohibitively expensive for many practically relevant problems, where often approximation spaces with many degrees of freedom and many samples for the estimator are needed. In this article, we propose and analyze a data sparse multilevel sample covariance estimator, i.e., a multilevel Monte Carlo estimator. For this purpose, we generalize the notion of asymptotically smooth kernel functions to a Gevrey type class of kernels for which we derive new variable-order $\calH^2$-approximation rates. These variable-order $\calH^2$-approximations can be considered as a variant of $hp$-approximations. Our multilevel sample covariance estimator then uses an approximate multilevel hierarchy of variable-order $\calH^2$-approximations to compress the sample covariances on each level. The non-nestedness of the different levels makes the reduction to the final estimator nontrivial and we present a suitable algorithm which can handle this task in linear complexity. This allows for a data sparse multilevel estimator of Gevrey covariance kernel functions in the best possible complexity for Monte Carlo type multilevel estimators, which is quadratic. Numerical examples which estimate covariance matrices with tens of billions of entries are presented.

math.NA↗

Sampling recovery in Bochner spaces and applications to parametric PDEs

We prove convergence rates of linear sampling recovery of functions in abstract Bochner spaces satisfying weighted summability of their generalized polynomial chaos expansion coefficients. The underlying algorithm is a function-valued extension of the least squares method widely used and thoroughly studied in scalar-valued function recovery. We apply our theory to two core problems in Computational Uncertainty Quantification. First, we address non-intrusive approximations of solutions to parametric elliptic or parabolic PDEs with log-normal or affine inputs using a finite set of particular solvers. Second, we consider approximating infinite-dimensional holomorphic functions that arise as solutions to more general parametric PDEs with Gaussian random field inputs. Our framework allows a unified treatment of the log-normal and affine input models and yields substantial improvements to the state of the art of these problems. More specifically, we obtain convergence rates that improve known results by a polynomial factor in the log-normal case and by a logarithmic factor in the affine case.

math.NA↗

Eigenvalue stability and new perturbation bounds for the extremal eigenvalues of a matrix

Let $A$ be a full ranked $ n\times n$ matrix, with singular values $σ_1 (A) \ge \dots \ge σ_n (A) >0$. The condition number $κ(A):= σ_1(A)/σ_n(A)=\|A\|\cdot \|A\|^{-1}$ is a key parameter in the analysis of algorithms taking $A$ as input. In practice, matrices (representing real data) are often perturbed by noise. Technically speaking, the real input would be a noisy variant $\tilde A =A +E$ of $A$, where $E$ represents the noise. The condition number $κ(\tilde A)$ will be used instead of $κ(A)$. Thus, it is of importance to measure the impact of noise on the condition number. In this paper, we focus on the case when the noise is random. We introduce the notion of regional stability, via which we design a new framework to estimate the perturbation of the extremal singular values and the condition number of a matrix. Our framework allows us to bound the perturbation of singular values through the perturbation of singular spaces. We then bound the latter using a novel contour analysis argument, which, as a co-product, provides an improved version of the classical Davis-Kahan theorem in many settings. Our new estimates concerning the least singular value $σ_n(A)$ complement well-known results in this area, and are more favorable in the case when the ground matrix $A$ is large compared to the noise matrix $E$.

math.NA↗