Search arXiv⌕ Search

arXiv · cond-mat/0007109

Dynamics and Critical Behaviour of the q-model

Abstract

The $q$-model, a random walk model rich in behaviour and applications, is investigated. We introduce and motivate the $q$-model via its application proposed by Coppersmith {\em et al.} to the flow of stress through granular matter at rest. For a special value of its parameters the $q$-model has a critical point that we analyse. To characterise the critical point we imagine that a uniform load has been applied to the top of the granular medium and we study the evolution with depth of fluctuations in the distribution of load. Close to the critical point explicit calculation reveals that the evolution of load exhibits scaling behaviour analogous to thermodynamic critical phenomena. The critical behaviour is remarkably tractable: the harvest of analytic results includes scaling functions that describe the evolution of the variance of the load distribution close to the critical point and of the entire load distribution right at the critical point, values of the associated critical exponents, and determination of the upper critical dimension. These results are of intrinsic interest as a tractable example of a random critical point. Of the many applications of the q-model, the critical behaviour is particularly relevant to network models of river basins, as we briefly discuss. Finally we discuss circumstances under which quantum network models that describe the surface electronic states of a quantum Hall multilayer can be mapped onto the classical $q$-model. For mesoscopic multilayers of finite circumference the mapping fails; instead a mapping to a ferromagnetic supersymmetric spin chain has proved fruitful. We discuss aspects of the superspin mapping and give a new elementary derivation of it making use of operator rather than functional methods.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Marta Lewandowska, H. Mathur, Y. -K. Yu. 2000-07-10. Dynamics and Critical Behaviour of the q-model. https://doi.org/10.1103/physreve.64.026107

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Deep-layered machines have a built-in Occam's razor

Many complex systems map vast numbers of microscopic descriptions onto far fewer macroscopic outcomes. Surprisingly, these input-output maps strongly favor simple outputs. In an exactly solvable deep-layered machine, we prove that simplicity bias strengthens with every layer. The probability of an output function $F$ approaches $\Pr(F)\propto 2^{-K(F)}$, where $K$ is the Kolmogorov complexity. Our results show that hierarchical composition alone can generate an intrinsic Occam's razor, suggesting a general mechanism for simplicity bias in learning and evolution.

cond-mat.dis-nn↗

Neural Networks with Exciton-Polariton Waveguides

We propose and numerically study a scheme for neural networks using exciton-polariton waveguide meshes. These enable arbitrary programmable interlayer couplings suited to a restricted Boltzmann machine architecture where polariton phases act as stochastic network variables. We show that such a network can be trained using unsupervised Hebbian and anti-Hebbian updates. This allows the implementation of an associative memory, where the network recovers learned patterns from imperfect inputs.

cond-mat.dis-nn↗

Finite-width shift of the edge of chaos in deep neural networks

Deep neural networks train best when they are initialised at the edge of chaos, the critical line in the plane of weight and bias variances on which the distance between two inputs neither grows nor shrinks with depth. The line is known for infinitely wide networks; at finite width it moves, and how it moves has been disputed. We treat the logarithm of the distance between two inputs through a network of width $N$ as a random walk and compute its drift and variance to order $1/N$. The edge of chaos moves to a larger weight variance, by $Δσ_w^2=-a_1/(N\,\partial_{σ_w^2}\lnχ_1)$, about $8/N$ for $\tanh$ networks at a bias variance of $0.05$, confirmed by simulations of the exact finite-width recursion. The shift describes a typical network; the average over many networks is dominated by rare networks in which the distance grows, and its critical point moves the other way, which explains why calculations and simulations have disagreed. Backpropagation follows the same random walk, so the shift applies to gradients unchanged. Along the edge of chaos, the information about the similarity of two inputs is constant until the compression over the depth exceeds about one nat, which fixes where to sit on the line. The results give an initialisation rule, Crinit, that places a network on its finite-width edge of chaos without a search. On MNIST and Fashion-MNIST at width $64$ it is more accurate than the standard rules at their usual settings, by a small margin in shallow networks and a large one in deep networks, where most standard rules fail; it trains in fewer steps, and it matches or beats the standard rules with a tuned gain.

cond-mat.dis-nn↗