arXiv · 2106.08978
Pattern recognition in Deep Boltzmann machines
Abstract
We consider a multi-layer Sherrington-Kirkpatrick spin-glass as a model for deep restricted Boltzmann machines and we solve for its quenched free energy, in the thermodynamic limit and allowing for a first step of replica symmetry breaking. This result is accomplished rigorously exploiting interpolating techniques and recovering the expression already known for the replica-symmetry case. Further, we drop the restriction constraint by introducing intra-layer connections among spins and we show that the resulting system can be mapped into a modular Hopfield network, which is also addressed rigorously via interpolating techniques up to the first step of replica symmetry breaking.
Explore related subjects
Keep this discovery
Elena Agliari, Linda Albanese, Francesco Alemanno, Alberto Fachechi. 2021-06-16. Pattern recognition in Deep Boltzmann machines. https://arxiv.org/abs/2106.08978
Cite the original work for its findings. Save a collection to share your selection of sources.