arXiv · 2409.18329
Harnessing and modulating chaos to sample from neural generative models
Abstract
Chaos is generic in strongly-coupled recurrent networks of model neurons, and thought to be an easily accessible dynamical regime in the brain. While neural chaos is typically seen as an impediment to robust computation, we show how such chaos might play a functional role in allowing the brain to learn and sample from generative models. We construct architectures that combine a classic model of neural chaos either with a canonical generative modeling architecture or with energy-based models of neural memory. We show that these architectures have appealing properties for sampling, including easy biologically-plausible control of sampling rates via overall gain modulation.
Explore related subjects
Keep this discovery
Rishidev Chaudhuri, Vivek Handebagh. 2024-09-26. Harnessing and modulating chaos to sample from neural generative models. https://arxiv.org/abs/2409.18329
Cite the original work for its findings. Save a collection to share your selection of sources.