Search arXivSearch

arXiv · cond-mat/0207321

Data compression and learning in time sequences analysis

Abstract

Motivated by the problem of the definition of a distance between two sequences of characters, we investigate the so-called learning process of typical sequential data compression schemes. We focus on the problem of how a compression algorithm optimizes its features at the interface between two different sequences $A$ and $B$ while zipping the sequence $A+B$ obtained by simply appending $B$ after $A$. We show the existence of a universal scaling function (the so-called learning function) which rules the way in which the compression algorithm learns a sequence $B$ after having compressed a sequence $A$. In particular it turns out that it exists a crossover length for the sequence $B$, which depends on the relative entropy between $A$ and $B$, below which the compression algorithm does not learn the sequence $B$ (measuring in this way the relative entropy between $A$ and $B$) and above which it starts learning $B$, i.e. optimizing the compression using the specific features of $B$. We check the scaling function on three main classes of systems: Bernoulli schemes, Markovian sequences and the symbolic dynamic generated by a non trivial chaotic system (the Lozi map). As a last application of the method we present the results of a recognition experiment, namely recognize which dynamical systems produced a given time sequence. We finally point out the potentiality of these results for segmentation purposes, i.e. the identification of homogeneous sub-sequences in heterogeneous sequences (with applications in various fields from genetic to time-series analysis).

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

A. Puglisi, D. Benedetto, E. Caglioti, V. Loreto, A. Vulpiani. 2002-07-12. Data compression and learning in time sequences analysis. https://doi.org/10.1016/s0167-2789(03)00047-2

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Nonuniform asymmetric exclusion process: Stationary densities and domain walls

We compute the stationary densities in totally asymmetric exclusion processes (TASEP) with open boundary conditions and spatially nonuniform hopping rates. The stationary densities in the low and and high density phases can be discontinuous, only when the space-dependent hopping rate is spatially discontinuous. In contrast, the stationary density profile in the maximal current phase can be discontinuous, even when the space-dependent hopping rate is continuous. We further investigate the domain walls, which are delocalised with complex shapes. In striking contrast to a delocalised domain wall (DDW) in an open, uniform TASEP, these DDWs can also form at the transitions between the low or high density phases and maximal current phase, and can cover the entire TASEP channel or a part of it, depending upon the specific forms of the site-dependence of the hopping rates and the associated phase transitions. We calculate their envelopes, which are curved lines, revealing their dependence on the spatial nonuniformity of the hopping rates. The phase diagrams in the plane of the control parameters show universal topology. The associated phase transitions are explored, which can be different from their counterparts in an open uniform TASEP.

cond-mat.stat-mech

Intermittency in Wind-Driven Fires

We construct a wind-driven forest-fire model in one dimension in which a fire can jump gaps between trees to ignite disjoint downwind forests. The size of a gap that a fire can jump depends on the fire intensity, which increases as the fire propagates through trees and diminishes as the fire jumps gaps. Trees grow on empty sites at rate $r$ and lightning strikes each site with rate $f$. When $f\ll r/L$, where $L$ is the system length, lightning is sufficiently rare that quasi-deterministic dynamics arises where all trees are consumed when a lightning-induced fire occurs. For $f\gg L^{-μ}$ with $μ\approx 0.8$, lightning is sufficiently frequent that a steady state is reached, but with unexpected behaviors for the forest- and gap-size distributions. Intermittency arises in between these regimes, with coexisting temporal domains of deterministic and chaotic dynamics.

cond-mat.stat-mech

Uphill and downhill first passage of an active Brownian particle: Asymmetry and exact path reweighting

First passage processes in active systems combine stochastic transport with self-propulsion and orientational persistence, making motion along and against an external bias sensitive to the internal active dynamics. For passive biased diffusion, opposite exits can have different splitting probabilities while their conditional first passage time distributions remain identical. We study how this relation changes for an active Brownian particle driven by a constant external force between two absorbing boundaries. Self-propulsion breaks the equality of the uphill and downhill first passage time distributions and modifies the splitting probabilities. Nevertheless, the two directional path ensembles remain exactly related by spatial reflection, which pairs downhill and uphill first passage paths of the same duration while preserving their orientational history. The log-ratio of the probabilities of a path and its reflected partner defines a path-dependent asymmetry functional and provides an exact reweighting between the two ensembles. In the symmetric half-weighted representation, the uphill and downhill first passage time distributions coincide for arbitrary orientational persistence. The same path relation also allows rare uphill statistics to be reconstructed from the more frequently sampled downhill trajectories. Numerical simulations confirm the weighted equality across the explored bias and persistence regimes, while perturbative and asymptotic analyses clarify how orientational persistence produces the directional asymmetry of the unweighted statistics. The exact relation between the two directional path ensembles suggests that similar symmetry-based reconstruction protocols may be found in other nonequilibrium first-passage problems.

cond-mat.stat-mech