Structure-Preserving Dimension Reduction and Surrogates for Partially Linear Bayesian Inverse Problems

Abstract

Many Bayesian inverse problems are characterized by two parameter vectors with distinct roles. A medium property, operator coefficient, or geometry block enters the forward model nonlinearly, whereas a volumetric, initial condition, or boundary condition source enters linearly. General-purpose nonlinear surrogates must relearn this known source dependence from data and may not preserve the correct source scaling outside the training regime. We introduce a structure-preserving partially linear (SPPL) framework that constructs separate reduced spaces for outputs, (linearly appearing) sources, and (nonlinearly appearing) medium variables and represents the reduced forward map as an affine function of the retained source coordinates, with coefficients that depend on the medium variables. Here, "affine" refers to the retained, mean-centered source coordinates: the physical forward map remains linear in the source, while the affine offset is induced by the source-prior mean and vanishes when that mean is zero. The analysis first identifies the optimal blockwise ridge approximation and then derives the optimal affine-in-source approximation under independent medium and source priors. A direct decomposition of the forward error into output, source, medium, and surrogate contributions yields blockwise spectral criteria and prior-predictive expected-KL control. For a Gaussian source prior, the optimal affine-in-source approximation coincides with the optimal blockwise ridge approximation. In a coseismic numerical example, a three-model controlled ablation on common block-reduced coordinates separates the effects of coefficient-matrix supervision and structure-preserving affine-in-source parameterization. Reduced-space surrogate MCMC provides orders-of-magnitude online acceleration relative to high-fidelity posterior sampling.