Search arXiv⌕ Search

arXiv · 2610.14922

Full Lyapunov Spectra of Random Neural Networks, Part I: Finite-Time and Asymptotic Theory

Abstract

We develop a dynamical mean-field framework for the full finite-time and stationary asymptotic Lyapunov spectra of random recurrent neural networks. At finite observation time, an exact log-determinant representation of tangent-propagator singular values leads to a closed-contour matrix Dyson equation for the smoothed spectral tail. In the stationary setting, a cocycle representation yields an operator equation for the asymptotic cumulative spectrum. Both formulations retain complete local gain histories and the repeated action of quenched connectivity. Direct singular-value calculations and network QR spectra support the predictions in the regimes examined, with sampling uncertainty and numerical cutoffs assessed separately. The stationary equation also recovers the known maximal exponent, and controlled gain-history replay illustrates how temporal correlations redistribute instability. This work was carried out in collaboration with ChatGPT 5.6 Sol. Toward the end of preparation we became aware of David G. Clark's contemporaneous work, \emph{Lyapunov spectrum of random neural networks}[arXiv:2610.12426], which reports overlapping mean-field results for the full Lyapunov spectrum using a cavity approach.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Haoyu Albert Wang, Wei P. Dai. 2026-10-10. Full Lyapunov Spectra of Random Neural Networks, Part I: Finite-Time and Asymptotic Theory. https://arxiv.org/abs/2610.14922

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related papers

Information in a recurrent Retina-V1 network with realistic noise, feedback and nonlinearities

Quantitative estimation of information flow in early vision with psychophysically realistic networks is still an open issue. This is because, up to date, the necessary elements (general and plausible network, accurate noise, and reliable information measures) have not been put together. As a result, previous works made different approximations that limit the generality of their results. This work combines the following elements for the first time: (1) General and plausible recurrent net: a cascade of linear+nonlinear psychophysically tuned layers [IEEE TIP.06, J.Neurophysiol.19, J.Math.Neurosci.20, Neurocomp.24], augmented to consider top-down feedback following [Nat.Neurosci.21,Neurips.22]. (2) Accurate noise in every layer, which is tuned to reproduce psychometric functions both in contrast detection and discrimination following [J.Vision 25]. (3) Reliable information measures that have been checked with analytical results, both in general [IEEE PAMI 24], and in similar visual neuroscience contexts [Neurocomp.24], and hence can be applied in this (more general) case where analytical results are difficult to obtain. The joint use of these elements allows a reliable study of information flow depending on different connectivity schemes (different nonlinearities and interactions), different noise sources, and different stimuli. Results show the benefits of feedback in two ways: (1) the information loss in the data processing inequality along the pathway is reduced by the V1 -- > LGN recurrence for values of feedback that give stable steady state solutions, and (2) the stability of the net is assessed though standard Poincaré analysis and we find an optimal value for the feedback in terms of the accuracy of the reconstructed signal from the cortical representation.

q-bio.NC↗

Rethinking World Models for Biosignals

World models promise to learn how systems evolve and respond to actions, enabling simulation, planning and decision-making. Bringing this promise to biosignals requires more than accurate prediction of physiological recordings. We examine existing biosignal world models through two requirements for intervention use: a genuine action and evidence of its causal effect. We identify three fundamental bottlenecks rooted in physiology: Temporal Latency, the variable delay between an action and its observable effect; System Openness, the influence of drivers beyond the modelled intervention; and Endogenous Dynamics, the system's ongoing evolution without that intervention. Drawing on published evidence, we outline corresponding research directions and propose an Intervention-Effect Validation Checklist to guide evaluation. The aim is to help the biosignal community realise the core promise of world models by learning the latent mechanisms that govern physiological evolution and responses to interventions.

q-bio.NC↗

Rewiring of adult neural networks - learning from structural plasticity across multiple scales

Synaptic connections are continuously formed and eliminated even in adult neuronal networks. This process - called structural plasticity - allows networks to change their topology to learn and adapt to their environment or compensate for lesions. Yet, in contrast to synaptic plasticity, structural plasticity is less well studied and understood. We here present the current state of knowledge as well as open problems in the field along three guiding questions: (1) What regulates structural plasticity in biological neural networks? (2) What are the functional consequences and advantages of structural plasticity in adult neural networks? (3) How can our understanding of structural plasticity be translated into clinical and technological applications? We argue that understanding structural plasticity is a problem involving multiple temporal and spatial scales. Solving this problem thus requires collaborative efforts of experimentalists, theoreticians as well as computational modelers, and has the potential for comprehensive neuroscientific insights that can guide the development of medical applications, artificial neural networks as well as neuromorphic computing.

q-bio.NC↗