Search arXivSearch

arXiv · 1804.09014

On robust stopping times for detecting changes in distribution

Abstract

Let $X_1,X_2,\ldots $ be independent random variables observed sequentially and such that $X_1,\ldots,X_{θ-1}$ have a common probability density $p_0$, while $X_θ,X_{θ+1},\ldots $ are all distributed according to $p_1\neq p_0$. It is assumed that $p_0$ and $p_1$ are known, but the time change $θ\in \mathbb{Z}^+$ is unknown and the goal is to construct a stopping time $τ$ that detects the change-point $θ$ as soon as possible. The existing approaches to this problem rely essentially on some a priori information about $θ$. For instance, in Bayes approaches, it is assumed that $θ$ is a random variable with a known probability distribution. In methods related to hypothesis testing, this a priori information is hidden in the so-called average run length. The main goal in this paper is to construct stopping times which do not make use of a priori information about $θ$, but have nearly Bayesian detection delays. More precisely, we propose stopping times solving approximately the following problem: \begin{equation*} \begin{split} &\quad Δ(θ;τ^α)\rightarrow\min_{τ^α}\quad \textbf{subject to}\quad α(θ;τ^α)\le α\ \textbf{ for any}\ θ\ge1, \end{split} \end{equation*} where $α(θ;τ)=\mathbf{P}_θ\bigl\{τ<θ\bigr\}$ is \textit{the false alarm probability} and $Δ(θ;τ)=\mathbf{E}_θ(τ-θ)_+$ is \textit{the average detection delay}, %In this paper, we construct $\widetildeτ^α$ such that %\[ % \max_{θ\ge 1}α(θ;\widetildeτ^α)\le α \text{and}\ %Δ(θ;\widetildeτ^α)\le (1+o(1))\log(θ/α), \ \text{as} \ θ/α%\rightarrow\infty, %\] and explain why such stopping times are robust w.r.t. a priori information about $θ$.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Yuri Golubev, Mher Safarian. 2018-04-24. On robust stopping times for detecting changes in distribution. https://arxiv.org/abs/1804.09014

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Functional independent component analysis by choice of norm: a framework for near-perfect classification

We develop a theory for functional independent component analysis in an infinite-dimensional framework using Sobolev spaces that accommodate smoother functions. The notion of penalized kurtosis is introduced motivated by Silverman's method for smoothing principal components. This approach allows for a classical definition of independent components obtained via projection onto the eigenfunctions of a smoothed kurtosis operator mapping a whitened functional random variable. We discuss the theoretical properties of this operator in relation to a generalized Fisher discriminant function and the relationship it entails with the Feldman-Hájek dichotomy for Gaussian measures, both of which are critical to the principles of functional classification. The proposed estimators are a particularly competitive alternative in binary classification of functional data and can eventually achieve the so-called near-perfect classification, which is a genuine phenomenon of high-dimensional data. Our methods are illustrated through simulations, various real datasets, and used to model electroencephalographic biomarkers for the diagnosis of depressive disorder.

math.ST

Trace-Class Results for MCMC Algorithms for Student-$t$ Regression Models

In this paper, we consider MCMC algorithms for Student-$t$ regression models. In three cases, we investigate the efficiency of Markov chains based on the algorithms in terms of whether trace-class results hold or not. First, we consider the case where the parameters follow a matrix-normal-inverse-Wishart distribution and show that the Markov operator associated with a standard data augmentation algorithm is trace-class. Second, we consider the case of an improper prior and univariate outcomes. In this case, the standard Markov operator is not trace-class but the Markov operator associated with a collapsed Gibbs algorithm is trace-class. Third, we consider the case of an improper prior and multivariate outcomes. We obtain a trace-class result for a parameter expanded data augmentation algorithm which is based on a univariate working parameter. Finally, we consider the problem of numerially estimating a convergence rate of the trace-class Markov operator in the second case.

math.ST

The Manifold Hypothesis under Unknown Gaussian Noise:Conditional Certificates and Consistent Dimension Estimation

We study what noisy data can establish about the Manifold Hypothesis under explicit identification and regularity conditions. A population residual certificate combines independent-view localization, Gaussian concentration, membership uncertainty, and population transfer. Existing rectifiability criteria then yield a covered-scale consequence. For a local smooth manifold with positive Hölder density, the actual-ball covariance limit identifies the spectral crossing with geometric dimension. We prove almost-sure eventual recovery under repeated observations. Reusing accurate localization averages improves the sufficient point-sample condition from $Nr^{d+4}\gg\log N$ to $Nr^d\gg\log N$, with replication $kr^2\gg\log N$. A two-mass certificate controls incorrect geometric-dimension emissions under declared class bounds. For single observations with unknown Gaussian noise, affine-support or known coordinate-bound restrictions provide noise intervals and consistent Gaussian correlation-dimension estimators. Ahlfors regularity identifies this exponent with Hausdorff dimension and with the geometric dimension of a homogeneous smooth class. Exact Cantor calculations delineate the limits of integer spectral counts and adjacent-radius slopes. We credit established local PCA, rectifiability, concentration, binomial inference, and deconvolution results before specifying our constructions. Reproducible experiments distinguish point estimation, finite-scale coverage, and certificate emission.

math.ST