Search arXivSearch

arXiv · 1912.02721

Using Machine Learning to Assess Short Term Causal Dependence and Infer Network Links

Abstract

We introduce and test a general machine-learning-based technique for the inference of short term causal dependence between state variables of an unknown dynamical system from time series measurements of its state variables. Our technique leverages the results of a machine learning process for short time prediction to achieve our goal. The basic idea is to use the machine learning to estimate the elements of the Jacobian matrix of the dynamical flow along an orbit. The type of machine learning that we employ is reservoir computing. We present numerical tests on link inference of a network of interacting dynamical nodes. It is seen that dynamical noise can greatly enhance the effectiveness of our technique, while observational noise degrades the effectiveness. We believe that the competition between these two opposing types of noise will be the key factor determining the success of causal inference in many of the most important application situations.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Amitava Banerjee, Jaideep Pathak, Rajarshi Roy, Juan G. Restrepo, Edward Ott. 2019-12-05. Using Machine Learning to Assess Short Term Causal Dependence and Infer Network Links. https://doi.org/10.1063/1.5134845

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Frequency bursts in adaptive delay-coupled oscillators

We report on frequency bursting oscillations in a system of phase oscillators with adaptive and delayed coupling. Adaptation of the coupling strengths is considered slow and depends on the phase shift between the oscillators. We find due to the combined chain of adaptation, collective dynamics, and time delays, the system robustly achieves a state in which the oscillator's frequencies are nearly synchronized but detuned by an integer number of small adaptation frequencies. We demonstrate that this quantization of the detuning is caused by alternating slow and fast transitions. Moreover, the observed motions take the form of bursts of instantaneous frequency, and the number of spikes in each burst corresponds to the quantization level of the detuning. We provide a fast-slow analysis of this phenomenon and explain the mechanisms behind the emergence of bursts. Our findings indicate that these frequency bursting oscillations are robust and exist stably within finite parameter regions.

nlin.AO

Discrete-time Kuramoto model with phase lag: Linear stability analysis and onset of synchronization

We investigate the discrete-time version of the Kuramoto model with phase lag, which comprises globally-coupled phase oscillators of distributed frequencies that are evolving under a nonlinear map. In the continuum limit of an infinite number of oscillators ($N\to \infty$), we derive the exact Frobenius-Perron equation for the time evolution of the single-oscillator probability density, and study linear stability of the incoherent state. Instability signals onset of synchronization. The corresponding synchronization threshold is obtained analytically for the case of a Lorentzian distribution of the oscillator frequencies. The threshold differs from that of the continuous-time Kuramoto model, reflecting the fundamentally different stability conditions for discrete-time maps and continuous-time flows. Beyond synchronization threshold, we observe several interesting nonlinear phenomena: Unlike the classical Kuramoto model, the discrete-time version exhibits periodic and chaotic states. Numerical simulations of the finite-$N$ system confirm the analytical prediction for the synchronization threshold, while highlighting breakdown of the celebrated Ott-Antonsen ansatz invoked to conveniently study the continuous-time Kuramoto model in terms of a low-dimensional description.

nlin.AO

Deviations from global coupling in adaptive oscillator networks: a mean-field theory for the variance of coupling weights

A wide range of physical and biological systems are adaptive networks, in which the dynamics of the nodes and of the edges connecting them co-evolve. Mean-field reductions of such systems typically track only the average coupling strength, and therefore cannot determine when the coupling stays effectively homogeneous and when structured connectivity emerges. Here, we present a second-order moment closure that allows us to derive mean-field equations for the coupling-weight variance in networks of heterogeneous phase oscillators with adaptive coupling, starting from uniform coupling weights. In agreement with network simulations, we find a nonlinear, non-monotonic dependence of the relative weight variance on the oscillator heterogeneity that is mediated by the phase coherence. Moreover, we find that deviations from global coupling strongly depend on an interaction between the oscillator heterogeneity and the adaptation rule. Whereas symmetric adaptation causes a strongly coupled core of coherent oscillators to emerge and creates a bistable regime that is absent without adaptation, antisymmetric adaptation leads to antisymmetric coupling within the same core, thereby destabilizing it. Our equations therefore delineate the regimes in which adaptive networks behave like globally coupled systems from those in which more complex coupling patterns form.

nlin.AO