Search arXivSearch

arXiv · 2301.05504

Combining Dynamic Mode Decomposition with Ensemble Kalman Filtering for Tracking and Forecasting

Abstract

Data assimilation techniques, such as ensemble Kalman filtering, have been shown to be a highly effective and efficient way to combine noisy data with a mathematical model to track and forecast dynamical systems. However, when dealing with high-dimensional data, in many situations one does not have a model, so data assimilation techniques cannot be applied. In this paper, we use dynamic mode decomposition to generate a low-dimensional, linear model of a dynamical system directly from high-dimensional data, which is defined by temporal and spatial modes, that we can then use with data assimilation techniques such as the ensemble Kalman filter. We show how the dynamic mode decomposition can be combined with the ensemble Kalman filter (which we call the DMDEnKF) to iteratively update the current state and temporal modes as new data becomes available. We demonstrate that this approach is able to track time varying dynamical systems in synthetic examples, and experiment with the use of time-delay embeddings. We then apply the DMDEnKF to real world seasonal influenza-like illness data from the USA Centers for Disease Control and Prevention, and find that for short term forecasting, the DMDEnKF is comparable to the best mechanistic models in the ILINet competition.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Stephen A Falconer, David J. B. Lloyd, Naratip Santitissadeekorn. 2023-01-13. Combining Dynamic Mode Decomposition with Ensemble Kalman Filtering for Tracking and Forecasting. https://doi.org/10.1016/j.physd.2023.133741

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Equidistribution of saddle periodic points for Hénon-like maps

We prove that under a natural assumption on the dynamical degrees, the saddle periodic points of a Hénon-like map in any dimension equidistribute with respect to the equilibrium measure. Our work is a generalization of the results of Bedford-Lyubich-Smillie, Dujardin, and Dinh-Sibony along with improvements of their techniques. We also investigate some fine properties of Green currents associated with the map.

math.DS

On dissonance and orthogonal projections of self-conformal measures

Let $μ$ be a self-conformal measure on $\mathbb{R}^d$. We establish conditions for $μ$ under which $\dim(μ*ν) = \min\lbrace d,\dimμ+\dimν\rbrace$ holds when $ν$ is any Ahlfors-regular or self-conformal measure on $\mathbb{R}^d$. Our main result states the following sufficient condition: $μ$ is totally non-linear and not supported on a smooth hypersurface. We also establish sufficient (likely non-sharp) algebraic conditions for self-conformal measures which are not totally non-linear. In addition, we show that $\dim μ\circπ^{-1} = \min\{ k, \dim μ\}$ for every ortohogonal projection $π:\mathbb{R}^d\to\mathbb{R}^k$, $0<k<d$, when either $d=2$ and $μ$ is not self-similar and not supported on a line, or $d\geq 3$ and $μ$ is totally non-linear and not supported on a smooth hypersurface.

math.DS

Equation-Free Screening of Mittag-Leffler-Compatible Dynamics from Scalar Time Series via kNN Multi-Horizon Profiles

Fractional models provide a natural description of systems with memory, but a noninteger derivative should not be introduced solely because a time series is curved or slowly relaxing. We develop an equation-free preliminary screening framework that asks whether a scalar time series produces a multi-horizon k-nearest-neighbor (kNN) profile more compatible with Mittag-Leffler-type behavior than with selected conventional alternatives. In an ideal matched Caputo-relaxation benchmark, the complete generation-kNN-profile-model-comparison pipeline reproduces the expected Mittag-Leffler geometry and recovers the generating order to within approximately $10^{-3}$; this is interpreted as controlled calibration rather than as general fractional-order identification. Under 3% trajectory-specific observational noise, the held-out Mittag-Leffler preference is most consistent when the generating dynamics are well separated from the integer-order limit and becomes progressively less decisive as $α\rightarrow1$. The fitted order $α_{\mathrm{fit}}$, however, shows substantially larger realization-to-realization variability. Thus, relative model compatibility is more robust than single-realization order estimation in the present noisy benchmark. Noise-free nonfractional controls show a separate limitation of specificity: a stretched exponential can generate a strongly Mittag-Leffler-compatible profile, whereas inclusion of the generating rational/Hill family recovers that family and its parameters to numerical precision in the matched setting. A positive Mittag-Leffler-versus-exponential screen therefore does not uniquely establish fractional origin. A fractional chaotic system is treated only as an exploratory extension: the Mittag-Leffler growth family gives lower finite-window RMSE than exponential and logistic/saturating alternatives over the detected pre-transition interval.

math.DS