Search arXivSearch

arXiv · 1811.10255

Interacting reinforced stochastic processes: statistical inference based on the weighted empirical means

Abstract

This work deals with a system of interacting reinforced stochastic processes, where each process $X^j=(X_{n,j})_n$ is located at a vertex $j$ of a finite weighted direct graph, and it can be interpreted as the sequence of "actions" adopted by an agent $j$ of the network. The interaction among the dynamics of these processes depends on the weighted adjacency matrix $W$ associated to the underlying graph: indeed, the probability that an agent $j$ chooses a certain action depends on its personal "inclination" $Z_{n,j}$ and on the inclinations $Z_{n,h}$, with $h\neq j$, of the other agents according to the entries of $W$. The best known example of reinforced stochastic process is the Polya urn. The present paper characterizes the asymptotic behavior of the weighted empirical means $N_{n,j}=\sum_{k=1}^n q_{n,k} X_{k,j}$, proving their almost sure synchronization and some central limit theorems in the sense of stable convergence. By means of a more sophisticated decomposition of the considered processes adopted here, these findings complete and improve some asymptotic results for the personal inclinations $Z^j=(Z_{n,j})_n$ and for the empirical means $\overline{X}^j=(\sum_{k=1}^n X_{k,j}/n)_n$ given in recent papers (e.g. [arXiv:1705.02126, Bernoulli, Forth.]; [arXiv:1607.08514, Ann. Appl. Probab., 27(6):3787-3844, 2017]; [arXiv:1602.06217, Stochastic Process. Appl., 129(1):70-101, 2019]). Our work is motivated by the aim to understand how the different rates of convergence of the involved stochastic processes combine and, from an applicative point of view, by the construction of confidence intervals for the common limit inclination of the agents and of a test statistics to make inference on the matrix $W$, based on the weighted empirical means. In particular, we answer a research question posed in [arXiv:1705.02126, Bernoulli, Forth.]

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Giacomo Aletti, Irene Crimaldi, Andrea Ghiglietti. 2018-11-26. Interacting reinforced stochastic processes: statistical inference based on the weighted empirical means. https://doi.org/10.3150/19-bej1143

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

The extremal process of a cascading family of branching Brownian motion

We study the asymptotic behaviour of the extremal process of a cascading family of branching Brownian motions. This is a particle system on the real line such that each particle has a type in addition to his position. Particles of type $1$ move on the real line according to Brownian motions and branch at rate $1$ into two children of type $1$. Furthermore, at rate $α$, they give birth to children too of type $2$. Particles of type $2$ move according to standard Brownian motion and branch at rate $1$, but cannot give birth to descendants of type $1$. We obtain the asymptotic behaviour of the extremal process of particles of type $2$.

math.PR

Breuer-Major Theorems for Hilbert Space-Valued Random Variables

Let $\{X_k\}_{k\in\mathbb Z}$ be a stationary Gaussian process with values in a separable Hilbert space $\mathcal H_1$, and let $G:\mathcal H_1\to\mathcal H_2$ be a measurable map into another separable Hilbert space $\mathcal H_2$. We derive a central limit theorem for the centered normalized partial sums of the Hilbert space-valued subordinated process $\{G[X_k]\}_{k\in\mathbb Z}$. Our result holds under either of two sets of sufficient conditions, formulated in terms of the transformation $G$ and the temporal and cross-sectional dependence structure of $\{X_k\}_{k\in\mathbb Z}$. These conditions coincide in finite dimensions but lead to genuinely different phenomena in the infinite-dimensional setting. The proof relies on the recently developed Fourth Moment Theorem on Hilbert spaces, leveraging tools from the infinite-dimensional Malliavin-Stein framework. We also provide continuous-time and quantitative versions of the central limit theorem. In a series of examples, we recover and strengthen limit theorems for a wide array of statistics relevant in functional data analysis, and present, as an application of our result, a novel limit theorem in the framework of neural operators.

math.PR

Controlled rough SDEs, pathwise stochastic control and dynamic programming principles

We study stochastic optimal control of rough stochastic differential equations (RSDEs). This is in the spirit of the pathwise control problem (Lions--Souganidis 1998, Buckdahn--Ma 2007; also Davis--Burstein 1992), with renewed interest and recent works drawing motivation from filtering, SPDEs, and reinforcement learning. Results include regularity of rough value functions, validity of a rough dynamic programming principles and new rough stability results for HJB equations, removing excessive regularity demands previously imposed by flow transformation methods. Measurable selection is used to relate RSDEs to "doubly stochastic" SDEs under conditioning. In contrast to previous works, Brownian statistics for the to-be-conditioned-on noise are not required, aligned with the "pathwise" intuition that these should not matter upon conditioning. Depending on the chosen class of admissible controls, the involved processes may also be anticipating. The resulting stochastic value functions coincide in great generality for different classes of controls. RSDE theory offers a powerful and unified perspective on this problem class.

math.PR