Search arXiv⌕ Search

arXiv · 2610.32148

Covariance-Informed Ensemble Score Filtering: Embedding Localized Covariance Geometry into Score-Based Transport

Abstract

Background-error covariance models are central to atmospheric data assimilation because they spread partial observational information across space, variables, and dynamically coupled scales. Ensemble and variational methods exploit this covariance geometry efficiently, but their standard analysis formulations are largely built around Gaussian or locally quadratic approximations. Score-based ensemble filtering provides a framework for nonlinear distributional transport, but existing Ensemble Score Filter (EnSF) formulations lack an intrinsic covariance-mediated pathway for propagating likelihood information from observed to unobserved state components. We introduce a covariance-informed ensemble score filter (CI-EnSF) that embeds localized forecast-error covariance geometry directly into the forward diffusion and reverse transport. The proposed forward diffusion is covariance-shaped in standardized state space and becomes isotropic under the corresponding control-variable transformation. This covariance structure continuously propagates observational information from observed to unobserved state components throughout the reverse transport analysis trajectory. Experiments with Lorenz-96 and surface quasi-geostrophic (SQG) dynamics show a clear regime dependence. For linear observations, a well-tuned LETKF is more accurate, while CI-EnSF maintains stable cycling and effective covariance-mediated information propagation. Under strongly nonlinear observations and under climatological initialization, CI-EnSF achieves lower analysis error and greater cycling robustness than Gaussian ensemble benchmarks such as the LETKF, with improvements extending across spatial scales in the nonlinear SQG experiment. These results suggest that the principal benefit of CI-EnSF arises from combining nonlinear distributional transport with the mature covariance geometry used in conventional data assimilation.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Siming Liang, Peter Jan van Leeuwen, Hristo G. Chipilski, Zezhong Zhang, Feng Bao, Guannan Zhang. 2026-10-23. Covariance-Informed Ensemble Score Filtering: Embedding Localized Covariance Geometry into Score-Based Transport. https://arxiv.org/abs/2610.32148

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Puzzle Game: Prediction and Classification of Wordle Solution Words

Wordle result prediction involves both daily participation and the difficulty of the solution word. We model these quantities with ARIMA forecasts of report counts, XGBoost regressors using word frequency, letter entropy, and repetition, and a decision tree trained on K-means difficulty tiers. Experiments use 355 daily outcome distributions, with a 107-word chronological holdout and four expanding-window tests. XGBoost reduces holdout mean absolute error from 4.08 to 3.84 percentage points and improves over the training mean in every temporal window. Ridge and random forests remain competitive. XGBoost systematically underestimates failure rates on difficult words. The lexical decision tree achieves 54.2% tier accuracy, compared with 40.2% when predicted histograms are assigned to the same training centroids. Bootstrap analysis shows that cluster stability does not imply that tiers are predictable from lexical attributes. For report counts, comparisons at matched horizons reveal substantial overdispersion in full-history ARIMA intervals. These results characterize the predictive value and limitations of a compact lexical model of reported Wordle performance.

math.NA↗

Optimal Convergence of Quadratic Not-a-Knot Spline Interpolation on Arbitrary Partitions

The not-a-knot condition provides a simple spline interpolation scheme that requires no derivative data at the endpoints. Whereas the classical not-a-knot scheme using odd-degree splines selects knots that coincide with the data points, this approach does not extend to the even-degree case. In this paper we establish the well-posedness of the not-a-knot interpolation problem for even-degree splines, where knots are selected at midpoints of data values. We then show that the quadratic case, introduced in [M. J. D. Powell, Approximation Theory and Methods, Cambridge University Press, 1981], achieves $\mathcal{O}(h^3)$ convergence for $C^3$ functions on arbitrary partitions without mesh-ratio restrictions. The proof derives a linear system defining the interpolating spline, normalizes the system to bound the matrix norm of its inverse using a Neumann-series argument, and establishes global error bounds.

math.NA↗

Piecewise $P_2$ finite element space on rectangular meshes in arbitrary dimensions for the biharmonic equation

This paper develops a piecewise $P_2$ finite element space on rectangular meshes in arbitrary dimensions for the biharmonic equation. The discrete space imposes continuity of vertex sums on $(d-2)$-faces and of averaged normal derivatives across interior $(d-1)$-faces. A local algebraic characterization of $P_2$ is first established through the unisolvence of an enriched polynomial space and the resulting compatibility conditions. For each interior element, a $3^d$-element patch is then introduced, and the associated homogeneous patch space is shown to be one-dimensional. The corresponding patch functions, extended by zero, form a basis of the global homogeneous discrete space. A local quadratic interpolation operator is further constructed in arbitrary dimensions. Its approximation properties, together with a consistency estimate derived from the weak continuity conditions, lead to the optimal broken $H^2$ error estimate for the biharmonic problem.

math.NA↗