Search arXiv⌕ Search

arXiv subjects

Georg Stadler

Publications and source records attributed to Georg Stadler.

At least 19 recordsLinked to original sources

Transform before linearizing: robust Newton methods for singular $p$-Laplace and $p$-Stokes equations

For $1<p<2$, the $p$-Laplace equation and its $p$-Stokes generalization are difficult to solve numerically. Newton's method converges rapidly only close to the solution, with iteration counts that grow under mesh refinement and deteriorate as $p\to1$. The more robust Picard iteration converges only linearly. Rather than globalizing or preconditioning Newton's method, we modify the system to which it is applied. We \emph{lift} the equation by introducing the flux $|\nabla u|^{p-2}\nabla u$ as an auxiliary (or ''lifting'') variable, apply a nonlinear \emph{transformation} to the resulting constitutive relation, \emph{linearize}, and \emph{eliminate} the auxiliary variable by static condensation. Lifting alone leaves the linearization unchanged; it is the preceding transformation that yields the new method. The elimination is algebraic and pointwise at the quadrature points, so the flux variable is never discretized, no inf-sup condition or indefinite system arises, and the cost per iteration is that of a standard Newton step. Together with a pointwise feasibility bound on the lifting variable that keeps the diffusion tensor uniformly positive definite, this yields an iteration that we prove, in finite dimensions and for the $p$-Laplace equation, to converge globally and locally at a quadratic rate; a one-dimensional model problem explains why the lagged flux variable removes the zig-zag behavior of standard Newton for $p$ close to one. Firedrake-based experiments for $p$-Laplace problems in two and three dimensions and for stationary and time-dependent $p$-Stokes flows show iteration counts largely insensitive to $p$ and to mesh refinement, and up to an order of magnitude fewer iterations than standard Newton for $p$ close to one.

math.NA↗

Amortized low-rank approximation for hyperparameter marginalization in PDE-governed Bayesian inverse problems

This paper addresses the efficient solution of hierarchical Bayesian inverse problems with a high- or infinite-dimensional parameter field and a moderate number of hyperparameters. We focus on a class of problems in which the parameter-to-observable mapping is a linear PDE, so that, for fixed hyperparameters, the problem becomes conditionally Gaussian. Marginalizing the hyperparameters entails repeated evaluation of their marginal density, which in turn entails repeated large-scale log-determinant ratio computations and maximum a posteriori (MAP) estimations. To address these computational challenges, we introduce a scalable framework that relies on generalized low-rank approximations of the update from the prior to the posterior precision matrix. Though such a framework is state-of-the-art in non-hierarchical settings, in the case of nonlinear prior hyperparameters such as covariance length scales, a direct application to hierarchical problems is inefficient. We propose two amortized variants of this framework, comparing their theoretical properties and computational complexity to the direct method. In numerical experiments, we evaluate their performance on an advection-diffusion initial condition inverse problem in two and three spatial dimensions, with hyperparameters in both the prior and the noise covariance. We find that our amortized methods achieve a factor of 30-45 speedup for 100 marginal density evaluations relative to the direct method in the 3D problem.

math.NA↗

Optimal experimental design for passive imaging source problems

This work focuses on optimal experimental design (OED) methods for passive imaging. We adopt a Bayesian inverse problem framework for passive imaging source problems, primarily focusing on spatially uncorrelated sources and systems governed by the Helmholtz equation. A major challenge in passive imaging is that the use of correlation data causes the observation dimension to grow quadratically with the number of sensor locations, compounding the computational difficulty of finding optimal designs. To overcome the computational bottleneck of repeated PDE solves in optimal design algorithms, we develop a two-level, low-rank approximation of the A-optimal design objective. This effectively decouples the problem into an offline and an online phase, enabling efficient evaluation of the design objective and its gradient without additional PDE solves. Our numerical results demonstrate that the proposed algorithm efficiently scales to large problems and that the resulting optimal designs significantly outperform random sensor placements in minimizing posterior uncertainty.

math.OC↗

Learning parameter-dependent shear viscosity from data, with application to sea and land ice

Complex physical systems which exhibit fluid-like behavior are often modeled as non-Newtonian fluids. A crucial element of a non-Newtonian model is the rheology, which relates inner stresses with strain-rates. We propose a framework for inferring rheological models from data that represents the fluid's effective viscosity with a neural network. By writing the rheological law in terms of tensor invariants and tailoring the network's properties, the inferred model satisfies key physical and mathematical properties, such as isotropic frame-indifference and existence of a convex potential of dissipation. Within this framework, we propose two approaches to learning a fluid's rheology: 1) a standard regression that fits the rheological model to stress data and 2) a PDE-constrained optimization method that infers rheological models from velocity data. For the latter approach, we combine finite element and machine learning libraries. We demonstrate the accuracy and robustness of our method on land and sea ice rheologies which also depend on external parameters. For land ice, we infer the temperature-dependent Glen's law and, for sea ice, the concentration-dependent shear component of the viscous-plastic model. For these two models, we explore the effects of large data errors. Finally, we infer an unknown concentration-dependent model that reproduces Lagrangian ice floe simulation data. Our method discovers a rheology that generalizes well outside of the training dataset and exhibits both shear-thickening and thinning behaviors depending on the concentrations.

math.NA↗

Physics-informed reservoir characterization from bulk and extreme pressure events with a differentiable simulator

Accurate characterization of subsurface heterogeneity is challenging but essential for applications such as reservoir pressure management, geothermal energy extraction and CO$_2$, H$_2$, and wastewater injection operations. This challenge becomes especially acute in extreme pressure events, which are rarely observed but can strongly affect operational risk. Traditional history matching and inversion techniques rely on expensive full-physics simulations, making it infeasible to handle uncertainty and extreme events at scale. Purely data-driven models often struggle to maintain physics consistency when dealing with sparse observations, complex geology, and extreme events. To overcome these limitations, we introduce a physics-informed machine learning method that embeds a differentiable subsurface flow simulator directly into neural network training. The network infers heterogeneous permeability fields from limited pressure observations, while training minimizes both permeability and pressure losses through the simulator, enforcing physical consistency. Because the simulator is used only during training, inference remains fast once the model is learned. In an initial test, the proposed method reduces the pressure inference error by half compared with a purely data-driven approach. We then extend the test over eight distinct data scenarios, and in every case, our method produces significantly lower pressure inference errors than the purely data-driven model. We also evaluate our method on extreme events, which represent high-consequence data in the tail of the sample distribution. Similar to the bulk distribution, the physics-informed model maintains higher pressure inference accuracy in the extreme event regimes. Overall, the proposed method enables rapid, physics-consistent subsurface inversion for real-time reservoir characterization and risk-aware decision-making.

cs.LG↗

Infinite-dimensional spherical-radial decomposition for probabilistic functions, with application to constrained optimal control and Gaussian process regression

The spherical-radial decomposition (SRD) is an efficient method for estimating probabilistic functions and their gradients defined over finite-dimensional elliptical distributions. In this work, we generalize the SRD to infinite stochastic dimensions by combining subspace SRD with standard Monte Carlo methods. The resulting method, which we call hybrid infinite-dimensional SRD (hiSRD) provides an unbiased, low-variance estimator for convex sets arising, for instance, in chance-constrained optimization. We provide a theoretical analysis of the variance of finite-dimensional SRD as the dimension increases, and show that the proposed hybrid method eliminates truncation-induced bias, reduces variance, and allows the computation of derivatives of probabilistic functions. We present comprehensive numerical studies for a risk-neutral stochastic PDE optimal control problem with joint chance state constraints, and for optimizing kernel parameters in Gaussian process regression under the constraint that the posterior process satisfies joint chance constraints.

math.OC↗

Non-Newtonian viscous fluid models with learned rheology accurately reproduce Lagrangian sea ice simulations

Polar sea ice is crucial to Earth's climate system. Its dynamics also affect coastal communities, wildlife, and global shipping. Sea ice is typically modeled as a continuum fluid using a model proposed almost 50 years ago, which is moderately accurate for packed ice, but loses its predictive accuracy outside of the central ice pack. Discrete element methods (DEMs), which are commonly used for modeling granular media, offer an alternative by resolving the behavior of individual ice floes, including collisions, frictional contact, fracture, and ridging. However, DEMs are generally too costly for large-scale simulations. To address this, we present a framework for inferring rheological behavior from DEM velocity data. We characterize isotropic constitutive laws as scalar functions of the principal invariants of the strain-rate tensor. These functions are parameterized by neural networks trained on DEM data. By combining machine learning and finite element methods, we incorporate the governing partial differential equation (PDE) into the training, requiring to solve a PDE-constrained optimization problem for the network parameters. We focus on unidirectional parallel shear flows, which allow us to infer the effective shear viscosity. We find that, over a wide range of ice concentrations, the velocity fields observed in a complex sea ice DEM can be captured by a nonlinear rheology. Depending on the ice concentration, a shear-thinning or a shear-thickening behavior is observed. Moreover, the effective shear viscosity is found to increase by several orders of magnitude with changes as small as 5% in the sea ice concentration. We show that the learned rheology generalizes to different forcing scenarios, time-dependent problems, and settings in which compressibility is not a dominant factor.

physics.flu-dyn↗

Extreme event probability estimation using PDE-constrained optimization and large deviation theory, with application to tsunamis

We propose and compare methods for the analysis of extreme events in complex systems governed by PDEs that involve random parameters, in situations where we are interested in quantifying the probability that a scalar function of the system's solution is above a threshold. If the threshold is large, this probability is small and its accurate estimation is challenging. To tackle this difficulty, we blend theoretical results from large deviation theory (LDT) with numerical tools from PDE-constrained optimization. Our methods first compute parameters that minimize the LDT-rate function over the set of parameters leading to extreme events, using adjoint methods to compute the gradient of this rate function. The minimizers give information about the mechanism of the extreme events as well as estimates of their probability. We then propose a series of methods to refine these estimates, either via importance sampling or geometric approximation of the extreme event sets. Results are formulated for general parameter distributions and detailed expressions are provided when Gaussian distributions. We give theoretical and numerical arguments showing that the performance of our methods is insensitive to the extremeness of the events we are interested in. We illustrate the application of our approach to quantify the probability of extreme tsunami events on shore. Tsunamis are typically caused by a sudden, unpredictable change of the ocean floor elevation during an earthquake. We model this change as a random process, which takes into account the underlying physics. We use the one-dimensional shallow water equation to model tsunamis numerically. In the context of this example, we present a comparison of our methods for extreme event probability estimation, and find which type of ocean floor elevation change leads to the largest tsunamis on shore.

math.OC↗

A note on generating Voronoi cells with a given size distribution

This note describes a simple method to draw random points such that the cells of the corresponding Voronoi tesselation (approximately) satisfy a desired size distribution, for instance, follow a power law. The method is illustrated and numerically verified in two dimensions, and we also provide a simple implementation.

math.NA↗

Optimal control under uncertainty with joint chance state constraints: almost-everywhere bounds, variance reduction, and application to (bi-)linear elliptic PDEs

We study optimal control of PDEs under uncertainty with the state variable subject to joint chance constraints. The controls are deterministic, but the states are probabilistic due to random variables in the governing equation. Joint chance constraints ensure that the random state variable meets pointwise bounds with high probability. For linear governing PDEs and elliptically distributed random parameters, we prove existence and uniqueness results for almost-everywhere state bounds. Using the spherical-radial decomposition (SRD) of the uncertain variable, we prove that when the probability is very large or small, the resulting Monte Carlo estimator for the chance constraint probability exhibits substantially reduced variance compared to the standard Monte Carlo estimator. We further illustrate how the SRD can be leveraged to efficiently compute derivatives of the probability function, and discuss different expansions of the uncertain variable in the governing equation. Numerical examples for linear and bilinear PDEs compare the performance of Monte Carlo and quasi-Monte Carlo sampling methods, examining probability estimation convergence as the number of samples increases. We also study how the accuracy of the probabilities depends on the truncation of the random variable expansion, and numerically illustrate the variance reduction of the SRD.

math.OC↗

Modeling sea ice in the marginal ice zone as a dense granular flow with rheology inferred from discrete element model data

The marginal ice zone (MIZ) represents the periphery of the sea ice cover. In this region, the macroscale behavior of the sea ice results from collisions and enduring contact between ice floes. This configuration closely resembles that of dense granular flows, which have been modeled successfully with the $μ(I)$ rheology. Here, we present a continuum model based on the $μ(I)$ rheology which treats sea ice as a compressible fluid, with the local sea ice concentration given by a dilatancy function $Φ(I)$. We infer expressions for $μ(I)$ and $Φ(I)$ by nonlinear regression using data produced with a discrete element method (DEM) which considers polygonal-shaped ice floes. We do this by driving the sea ice with a one-dimensional shearing ocean current. The resulting continuum model is a nonlinear system of equations with the sea ice velocity, local concentration, and pressure as unknowns. The rheology is given by the sum of a plastic and a viscous term. In the context of a periodic patch of ocean, which is effectively a one dimensional problem, and under steady conditions, we prove this system to be well-posed, present a numerical algorithm for solving it, and compare its solutions to those of the DEM. These comparisons demonstrate the continuum model's ability to capture most of the DEM's results accurately. The continuum model is particularly accurate for ocean currents faster than 0.25 m/s; however, for low concentrations and slow ocean currents, the continuum model is less effective in capturing the DEM results. In the latter case, the lack of accuracy of the continuum model is found to be accompanied by the breakdown of a balance between the average shear stress and the integrated ocean drag extracted from the DEM.

physics.flu-dyn↗

Sensitivity Analysis of the Information Gain in Infinite-Dimensional Bayesian Linear Inverse Problems

We study the sensitivity of infinite-dimensional Bayesian linear inverse problems governed by partial differential equations (PDEs) with respect to modeling uncertainties. In particular, we consider derivative-based sensitivity analysis of the information gain, as measured by the Kullback-Leibler divergence from the posterior to the prior distribution. To facilitate this, we develop a fast and accurate method for computing derivatives of the information gain with respect to auxiliary model parameters. Our approach combines low-rank approximations, adjoint-based eigenvalue sensitivity analysis, and post-optimal sensitivity analysis. The proposed approach also paves way for global sensitivity analysis by computing derivative-based global sensitivity measures. We illustrate different aspects of the proposed approach using an inverse problem governed by a scalar linear elliptic PDE, and an inverse problem governed by the three-dimensional equations of linear elasticity, which is motivated by the inversion of the fault-slip field after an earthquake.

math.NA↗

Scalable Methods for Computing Sharp Extreme Event Probabilities in Infinite-Dimensional Stochastic Systems

We introduce and compare computational techniques for sharp extreme event probability estimates in stochastic differential equations with small additive Gaussian noise. In particular, we focus on strategies that are scalable, i.e. their efficiency does not degrade upon temporal and possibly spatial refinement. For that purpose, we extend algorithms based on the Laplace method for estimating the probability of an extreme event to infinite dimensional path space. The method estimates the limiting exponential scaling using a single realization of the random variable, the large deviation minimizer. Finding this minimizer amounts to solving an optimization problem governed by a differential equation. The probability estimate becomes sharp when it additionally includes prefactor information, which necessitates computing the determinant of a second derivative operator to evaluate a Gaussian integral around the minimizer. We present an approach in infinite dimensions based on Fredholm determinants, and develop numerical algorithms to compute these determinants efficiently for the high-dimensional systems that arise upon discretization. We also give an interpretation of this approach using Gaussian process covariances and transition tubes. An example model problem, for which we provide an open-source python implementation, is used throughout the paper to illustrate all methods discussed. To study the performance of the methods, we consider examples of stochastic differential and stochastic partial differential equations, including the randomly forced incompressible three-dimensional Navier-Stokes equations.

stat.CO↗

Estimating earthquake-induced tsunami height probabilities without sampling

Given a distribution of earthquake-induced seafloor elevations, we present a method to compute the probability of the resulting tsunamis reaching a certain size on shore. Instead of sampling, the proposed method relies on optimization to compute the most likely fault slips that result in a seafloor deformation inducing a large tsunami wave. We model tsunamis induced by bathymetry change using the shallow water equations on an idealized slice through the sea. The earthquake slip model is based on a sum of multivariate log-normal distributions, and follows the Gutenberg-Richter law for moment magnitudes 7--9. For a model problem inspired by the Tohoku-Oki 2011 earthquake and tsunami, we quantify annual probabilities of differently sized tsunami waves. Our method also identifies the most effective tsunami mechanisms. These mechanisms have smoothly varying fault slip patches that lead to an expansive but moderately large bathymetry change. The resulting tsunami waves are compressed as they approach shore and reach close-to-vertical leading wave edge close to shore.

physics.geo-ph↗

Large deviation theory-based adaptive importance sampling for rare events in high dimensions

We propose a method for the accurate estimation of rare event or failure probabilities for expensive-to-evaluate numerical models in high dimensions. The proposed approach combines ideas from large deviation theory and adaptive importance sampling. The importance sampler uses a cross-entropy method to find an optimal Gaussian biasing distribution, and reuses all samples made throughout the process for both, the target probability estimation and for updating the biasing distributions. Large deviation theory is used to find a good initial biasing distribution through the solution of an optimization problem. Additionally, it is used to identify a low-dimensional subspace that is most informative of the rare event probability. This subspace is used for the cross-entropy method, which is known to lose efficiency in higher dimensions. The proposed method does not require smoothing of indicator functions nor does it involve numerical tuning parameters. We compare the method with a state-of-the-art cross-entropy-based importance sampling scheme using three examples: a high-dimensional failure probability estimation benchmark, a problem governed by a diffusion equation, and a tsunami problem governed by the time-dependent shallow water system in one spatial dimension.

stat.CO↗

Direct stellarator coil optimization for nested magnetic surfaces with precise quasi-symmetry

We present a robust optimization algorithm for the design of electromagnetic coils that generate vacuum magnetic fields with nested flux surfaces and precise quasi-symmetry. The method is based on a bilevel optimization problem, where the outer coil optimization is constrained by a set of inner least-squares optimization problems whose solutions describe magnetic surfaces. The outer optimization objective targets coils that generate a field with nested magnetic surfaces and good quasi-symmetry. The inner optimization problems identify magnetic surfaces when they exist, and approximate surfaces in the presence of magnetic islands or chaos. We show that this formulation can be used to heal islands and chaos, thus producing coils that result in magnetic fields with precise quasi-symmetry. We show that the method can be initialized with coils from the traditional two stage coil design process, as well as coils from a near axis expansion optimization. We present a numerical example where island chains are healed and quasi-symmetry is optimized up to surfaces with aspect ratio 6. Another numerical example illustrates that the aspect ratio of nested flux surfaces with optimized quasi-symmetry can be decreased from 6 to approximately 4. The last example shows that our approach is robust and a cold-start using coils from a near-axis expansion optimization.

physics.plasm-ph↗

Hierarchical off-diagonal low-rank approximation of Hessians in inverse problems, with application to ice sheet model initializaiton

Obtaining lightweight and accurate approximations of Hessian applies in inverse problems governed by partial differential equations (PDEs) is an essential task to make both deterministic and Bayesian statistical large-scale inverse problems computationally tractable. The $\mathcal{O}(N^{3})$ computational complexity of dense linear algebraic routines such as that needed for sampling from Gaussian proposal distributions and Newton solves by direct linear methods, can be reduced to log-linear complexity by utilizing hierarchical off-diagonal low-rank (HODLR) matrix approximations. In this work, we show that a class of Hessians that arise from inverse problems governed by PDEs are well approximated by the HODLR matrix format. In particular, we study inverse problems governed by PDEs that model the instantaneous viscous flow of ice sheets. In these problems, we seek a spatially distributed basal sliding parameter field such that the flow predicted by the ice sheet model is consistent with ice sheet surface velocity observations. We demonstrate the use of HODLR approximation by efficiently generating Hessian approximations that allow fast generation of samples from a Gaussianized posterior proposal distribution. Computational studies are performed which illustrate ice sheet problem regimes for which the Gauss-Newton data-misfit Hessian is more efficiently approximated by the HODLR matrix format than the low-rank (LR) format. We then demonstrate that HODLR approximations can be favorable, when compared to global low-rank approximations, for large-scale problems by studying the data-misfit Hessian associated to inverse problems governed by the Stokes flow model on the Humboldt glacier and Greenland ice sheets.

math.NA↗

Stellarator coil optimization supporting multiple magnetic configurations

We present a technique that can be used to design stellarators with a high degree of experimental flexibility. For our purposes, flexibility is defined by the range of values the rotational transform can take on the magnetic axis of the vacuum field while maintaining satisfactory quasisymmetry. We show that accounting for configuration flexibility during the modular coil design improves flexibility beyond that attained by previous methods. Careful placement of planar control coils and the incorporation of an integrability objective enhance the quasisymmetry and nested flux surface volume of each configuration. We show that it is possible to achieve flexibility, quasisymmetry, and nested flux surface volume to reasonable degrees with a relatively simple coil set through an NCSX-like example. This example coil design is optimized to achieve three rotational transform targets and nested flux surface volumes in each magnetic configuration larger than the NCSX design plasma volume. Our work suggests that there is a tradeoff between flexibility, quasisymmetry, and volume of nested flux surfaces.

physics.plasm-ph↗