Search arXiv⌕ Search
Home/Archive/arXiv

arXiv · 1801.07172

Scale-invariant Feature Extraction of Neural Network and Renormalization Group Flow

Satoshi Iso·Shotaro Shiba·Sumito Yokoo
View original source ↗Read source document ↗Export metadata ↓

Abstract

Theoretical understanding of how deep neural network (DNN) extracts features from input images is still unclear, but it is widely believed that the extraction is performed hierarchically through a process of coarse-graining. It reminds us of the basic concept of renormalization group (RG) in statistical physics. In order to explore possible relations between DNN and RG, we use the Restricted Boltzmann machine (RBM) applied to Ising model and construct a flow of model parameters (in particular, temperature) generated by the RBM. We show that the unsupervised RBM trained by spin configurations at various temperatures from $T=0$ to $T=6$ generates a flow along which the temperature approaches the critical value $T_c=2.27$. This behavior is opposite to the typical RG flow of the Ising model. By analyzing various properties of the weight matrices of the trained RBM, we discuss why it flows towards $T_c$ and how the RBM learns to extract features of spin configurations.

Explore related subjects

hep-thcond-mat.stat-mechcs.LGstat.ML

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Satoshi Iso, Shotaro Shiba, Sumito Yokoo. 2018-01-22. Scale-invariant Feature Extraction of Neural Network and Renormalization Group Flow. https://doi.org/10.1103/physreve.97.053304

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

arXiv2026

Introduction to Generalized Symmetries

These notes were prepared for a series of intensive lectures delivered at Hokkaido University, Nagoya University, Kyoto University, and Kyushu University. We begin with a brief review of higher-form symmetries, anomalies, and discrete gauge theories, before introducing non-invertible symmetries in $(1+1)$-dimensional systems. The basic structure of fusion categories is then discussed, including a discussion of categorical analogs of discrete gauging and representation theory. We subsequently turn to $(3+1)$-dimensional theories, where several physical applications of non-invertible symmetries are discussed. These notes are intended to be largely self-contained, and require no prior familiarity with subjects such as conformal field theory or lattice models.

hep-th↗
arXiv2026

Planar loop integrands from cuts in $D$ dimensions

We present a direct reconstruction formula for planar loop integrands from $D$-dimensional generalized unitarity cuts in any colored theory. The reconstruction combinatorics is separated from the theory-dependent tree amplitudes entering the cuts: for the $L$-loop $n$-point color-ordered amplitude, the integrand is expressed as a sum over admissible non-scaleless scalar graphs dressed by corresponding cuts in $D$ dimensions; the coefficients are given by the universal Möbius-inversion formula of the refinement poset, or equivalently one minus the Euler characteristics of associated complexes. As an application we write down closed-formulas for loop integrands in pure Yang--Mills theory, where the required cuts are generated by gluing $D$-dimensional tree amplitudes and summing over internal gluon states. We also use the two-loop five-point case as a validation, comparing with known integrand data and after integration-by-parts reduction, with known integrated helicity amplitudes. The same framework also produces compact cut-organized data for larger examples, including the two-loop six-point and three-loop four-point cases. We also describe the corresponding simplification in maximally supersymmetric Yang--Mills theory, where the absence of bubble and triangle subgraphs reduces the relevant cut poset substantially.

hep-th↗
arXiv2026

Free Field Realization of $\mathcal{W}$-Algebra Associated with Exceptional Lie Algebras

We study the free field realization of the $\mathcal{W}$-algebra associated with the exceptional Lie algebras $E_6$, $E_7$, $E_8$, and $F_4$. We develop a recursive construction in which a $\mathcal{W}$-algebra of rank $r$ is obtained from a $\mathcal{W}$-algebra of rank $r-1$ together with a free boson. The $\mathcal{W}$-currents are constructed from the zero commutation relation with the screening charges. The $\mathcal{W}E_6/\mathcal{W}E_7$ algebra is constructed from the $\mathcal{W}D_5/\mathcal{W}D_6$ algebra and is shown to be the same as that realized from the $\mathcal{W}A_5/\mathcal{W}E_6$ algebra, up to a change of the free field basis. The spin-$8$ generator of the $\mathcal{W}E_8$ algebra is built from the $\mathcal{W}D_7$ algebra. The recursive construction of the $\mathcal{W}BC_r$ algebras is also studied. We then realize the $\mathcal{W}F_4$ algebra based on the $\mathcal{W}BC_3$ algebra. Furthermore, the $\mathcal{W}$-charges of the generators of the $\mathcal{W}E_{6,7}$, $\mathcal{W}BC_{2,3}$, and $\mathcal{W}F_4$ algebras are calculated and expressed in terms of the Casimir invariants.

hep-th↗