On the Renyi entropy, Boltzmann Principle, Levy and power-law distributions and Renyi parameter

Andrei G. Bashkirov

Home/Archive/arXiv

arXiv · cond-mat/0211685

On the Renyi entropy, Boltzmann Principle, Levy and power-law distributions and Renyi parameter

Andrei G. Bashkirov

View original source ↗Read source document ↗Export metadata ↓

Abstract

The Renyi entropy with a free Renyi parameter $q$ is the most justified form of information entropy, and the Tsallis entropy may be regarded as a linear approximation to the Renyi entropy when $q\simeq 1$. When $q\to 1$, both entropies go to the Boltzmann--Shannon entropy. The application of the principle of maximum of information entropy (MEP) to the Renyi entropy gives rise to the microcanonical (homogeneous) distribution for an isolated system. Whatever the value of the Renyi parameter $q$ is, in this case the Renyi entropy becomes the Boltzmann entropy $S_B=k_B\ln W$, that provides support for universality of the Boltzmann's principle of statistical mechanics. For a system being in contact with a heat bath, the application of MEP to the Renyi entropy gives rise to Levy distribution (or, $q$-distribution) accepted as one of the main results of the so-called nonextensive statistics. The same distribution is derived here for a small physical system experiencing temperature fluctuations. The long--range "tail" of the Levy distribution is the power--law (Zipf-Pareto) distribution with the exponent $s$ expressed via $q$. The exponent and free Renyi parameter $q$ can be uniquely determined with the use of a further extension of MEP. Then typical values of $s$ are found within the range $1.3÷2$ and of $q$ within the range $0.25÷0.5$, in dependence on parameters of stochastic systems.

Explore related subjects

cond-mat.stat-mech

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Andrei G. Bashkirov. 2003-02-10. On the Renyi entropy, Boltzmann Principle, Levy and power-law distributions and Renyi parameter. https://arxiv.org/abs/cond-mat/0211685

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

The meaning of entropy (demonstration of a much needed theorem)

The association of information with entropy has been argued on plausibility arguments involving the operation of imaginary engines and beings, and it is not a universal theorem. In this paper, a theorem by Charles Bennett on reversible computation that associates entropy with erasure of information is recognized as this much needed theorem. It is proposed a real, non thermal engine, operated by humans. It is proved: (1) The engine obeys two laws, identical {\it mutatis mutandis} to the two laws of thermodynamics; therefore, the entropy that arises in the operation of the engine has the same meaning of the entropy that arises in the operation of thermal engines. (2) The engine operates in stages similar to the stages in Bennett's three tapes reversible computer; therefore the entropy in the engine has the same meaning of the entropy in computation. The conclusion is that also the thermal entropy is a measure of erased or missing information. As a side result, information is measured in physical units, which complies with Landauer's principle. A prototype at work is shown in video.

cond-mat.stat-mech↗

arXiv2026

Information geometry of perturbed gradient flow systems on hypergraphs: A perspective towards nonequilibrium physics

This article serves to concisely review the link between gradient flow systems on hypergraphs and information geometry which has been established within the last five years. Gradient flow systems describe a wealth of physical phenomena and provide powerful analytical technquies which are based on the variational energy-dissipation principle. Modern nonequilbrium physics has complemented this classical principle with thermodynamic uncertaintly relations, speed limits, entropy production rate decompositions, and many more. In this article, we formulate these modern principles within the framework of perturbed gradient flow systems on hypergraphs. In particular, we discuss the geometry induced by the Bregman divergence, the physical implications of dual foliations, as well as the corresponding infinitesimal Riemannian geometry for gradient flow systems. Through the geometrical perspective, we are naturally led to new concepts such as moduli spaces for perturbed gradient flow systems and thermodynamical area which is crucial for understanding speed limits. We hope to encourage the readers working in either of the two fields to further expand on and foster the interaction between the two fields.

cond-mat.stat-mech↗

arXiv2026

Anomalous diffusion and singular transport from hydrodynamic recoupling

In charge neutral fluids, such as the Dirac fluid in graphene at the Dirac point, charge transport remains diffusive despite the presence of ballistically propagating sound waves: sound waves ``hydrodynamically decouple'' from the slower charge fluctuations. For quasi-one-dimensional charge neutral fluids, we show that this convective charge diffusion is not smoothly connected to the normal diffusion that arises when momentum conservation is broken by noise (or static impurities). Instead, the charge diffusion constant is a discontinuous function of noise, which (in the weak-noise limit) depends only on the ratio of momentum and energy relaxation rates. In the special limit of momentum-conserving noise (e.g., spatially uniform fluctuations of the Hamiltonian), the diffusion constant diverges in the presence of noise. We describe the resulting superdiffusion in terms of coupled Burgers equations. We present a general mechanism---hydrodynamic recoupling---by which weak noise can induce singular changes in transport coefficients. Our results highlight the limits of zero-noise extrapolation for predicting dynamical quantities like diffusion constants.

cond-mat.stat-mech↗