Search arXivSearch

arXiv · 2411.14677

Exploring the Use of Machine Learning Weather Models in Data Assimilation

Abstract

The use of machine learning (ML) models in meteorology has attracted significant attention for their potential to improve weather forecasting efficiency and accuracy. GraphCast and NeuralGCM, two promising ML-based weather models, are at the forefront of this innovation. However, their suitability for data assimilation (DA) systems, particularly for four-dimensional variational (4DVar) DA, remains under-explored. This study evaluates the tangent linear (TL) and adjoint (AD) models of both GraphCast and NeuralGCM to assess their viability for integration into a DA framework. We compare the TL/AD results of GraphCast and NeuralGCM with those of the Model for Prediction Across Scales - Atmosphere (MPAS-A), a well-established numerical weather prediction (NWP) model. The comparison focuses on the physical consistency and reliability of TL/AD responses to perturbations. While the adjoint results of both GraphCast and NeuralGCM show some similarity to those of MPAS-A, they also exhibit unphysical noise at various vertical levels, raising concerns about their robustness for operational DA systems. The implications of this study extend beyond 4DVar applications. Unphysical behavior and noise in ML-derived TL/AD models could lead to inaccurate error covariances and unreliable ensemble forecasts, potentially degrading the overall performance of ensemble-based DA systems, as well. Addressing these challenges is critical to ensuring that ML models, such as GraphCast and NeuralGCM, can be effectively integrated into operational DA systems, paving the way for more accurate and efficient weather predictions.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Xiaoxu Tian, Daniel Holdaway, Daryl Kleist. 2024-11-22. Exploring the Use of Machine Learning Weather Models in Data Assimilation. https://arxiv.org/abs/2411.14677

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Conservation Constraints and Distributed Advective Memory in a Reduced Model of Atlantic Overturning Hysteresis

Interbasin exchange through the Indo-Pacific gateway supplies salt to the Atlantic and is widely invoked as a control on the stability of the Atlantic overturning circulation. We ask whether that control can act on the equilibrium structure of a conceptual thermohaline model. A closed five-box model with an exact salt invariant is constructed, comprising North Atlantic, upper-limb, Indian, Pacific, and deep reservoirs, with the return flow split between a warm route through the Indian reservoir and a cold route, together with an Indonesian Throughflow branch and an Agulhas retroflection. Adding the steady-state budgets of the gateway reservoirs shows that every internal exchange cancels, so the salt they export to the Atlantic is fixed by the net Atlantic freshwater export alone. This holds independently of the warm-route fraction, the throughflow, the retroflection, and how the export is apportioned among gateway reservoirs; across a parameter sweep the largest departure is of order ten to the minus eleven. The gateway therefore enters as a purely additive forcing and cannot renormalize the salt-advection feedback. Replacing the discrete transit lag by a gamma memory kernel leaves the equilibria unchanged but yields a closed-form threshold for oscillatory instability depending only on kernel shape. Broad memory is strongly stabilizing, and a discrete lag is the least stable member of the family. Because the instantaneous feedback vanishes at the fold, oscillatory instability always precedes the saddle-node, over an interval widening more than tenfold as memory sharpens. Gateways therefore appear to act on transient rather than equilibrium dynamics

physics.ao-ph

Forecasting threshold exceedance of atmospheric variables at a specific location

Accurate short-term forecasting of extreme weather events is important for early warning and risk mitigation. We compare two approaches for predicting site-specific threshold exceedances of weather variables: direct binary probabilistic models trained on thresholded outcomes and full-distribution parametric models trained on the continuous target. Using an analytically tractable Gaussian random-location model, in which the distribution is predictably shifted by the covariates, we quantify the consequences of the information loss induced by thresholding and derive the rare-event behavior of prediction errors and forecast skill. The analysis predicts an increasing relative advantage of the full-distribution approach as event probability decreases, because binarization progressively discards information contained in the continuous response. We then compare the two approaches to forecast wind speed and accumulated rainfall at various weather station sites over southeastern France using the same hybrid neural-network architecture. Although wind speed and rainfall depart from the toy-model assumptions, its main qualitative predictions are recovered for both variables: the relative advantage of distributional modeling increases toward rarer thresholds. This agreement further suggests that a substantial fraction of the forecastable signal associated with extreme events arises from predictable shifts in the conditional distribution. For the reasonably suitable parametric families examined, the results show limited sensitivity to the selected class of distribution. Overall, the results highlight the statistical advantage of training on continuous observations rather than on thresholded binary outcomes when forecasting rare threshold exceedances.

physics.ao-ph

Blinded Evaluation of Oceanic Sound Source Locations via Sequential Bound Estimation

A non-linear, non-Bayesian method called sequential bound estimation (SBE) derived 100% confidence intervals of location (CIL) for 219 explosions in the ocean from measurements of their time differences of arrivals among five widely-spaced time-unsynchronized receivers on the ocean bottom. The explosion's locations were measured with the global positioning system. A blind evaluation revealed all 219 explosions were within their CIL. The probability this could happen by chance is $4 \times 10^{-116}$. The explosions were detonated in shallow water on the eastern continental shelf of the U.S. over the so-called New England Mud Patch.

physics.ao-ph