A Heterogeneous General Model for Neuromorphic-Inspired Computation

Matteo Mirigliano

Home/Archive/arXiv

arXiv · 2609.05482

A Heterogeneous General Model for Neuromorphic-Inspired Computation

Matteo Mirigliano

View original source ↗Read source document ↗Export metadata ↓

Abstract

In recent years, both academia and industry have focused on the development of computational architectures inspired by the distributed, adaptive, and event-driven characteristics of biological neural systems, with the aim of reducing the computational cost associated with conventional training approaches [1]. However, a major challenge is the lack of general models and design guidelines for emerging computational systems and hardware. This work introduces a general model based on an input-dependent stochastic weight network, referred to as a substrate. The substrate weights evolve through input-triggered stochastic updates, with correlations between weight coefficients described by a matrix-valued covariance kernel. The proposed framework is implemented using quadratic polynomial weight functions, where the input amplitude controls the magnitude of the stochastic perturbation and a substrate-dependent distance determines the correlation structure. Numerical simulations show that correlations in the stochastic weight evolution significantly affect the system response, suggesting a potential mechanism for neuromorphic-inspired computation without conventional weight training. The aim of this work is to provide a general formulation of the model and identify its main properties and characteristics. 1 H. Jaeger, Towards a generalized theory comprising digital, neuromorphic and unconventional computing, Neuromorphic Comput. Eng., vol. 1, no. 1, p. 012002, Sep. 2021

Explore related subjects

cond-mat.dis-nn cs.NE

Keep this discovery

BibTeX RIS

Matteo Mirigliano. 2026-08-23. A Heterogeneous General Model for Neuromorphic-Inspired Computation. https://arxiv.org/abs/2609.05482

Cite the original work for its findings. Save a collection to share your selection of sources.

Discover connections

cond-mat.dis-nn subject cs.NE subject

Connections use source metadata and explicit phrase matches, not verified experimental comparisons.

KEEP EXPLORING

Related papers

arXiv2026

Memory as an Energy Landscape---Hopfield

This chapter reconstructs the Hopfield network as a physical theory of memory rather than merely an early neural-network algorithm. It begins with the problem as it stood before 1982-threshold logic, Hebbian association, correlation memories, and recurrent binary networks-and isolates what Hopfield's synthesis added: a dynamical definition of content-addressable memory, a symmetric recurrent architecture with a Lyapunov function, a Hebbian embedding of patterns in its couplings, and a physical account of basins, robustness, and graceful degradation. The binary and graded-response energy functions are derived in full, together with the signal-crosstalk decomposition governing pattern stability, the mean-field theory of retrieval at extensive load, and the zero-temperature retrieval spinodal at (alpha 0.138) established by Amit, Gutfreund, and Sompolinsky. The energy-based program is then followed through analog optimization networks, polynomial dense associative memories, exponential interactions, and modern continuous Hopfield updates, including the precise conditions under which the update becomes scaled dot-product attention. Throughout, capacity claims are tied to their disorder ensemble, scaling limit, and success criterion, showing why numerically different storage limits need not conflict. A closing assessment distinguishes established results from surviving principles, assumption-bound limitations, and open problems, treating the Hopfield network as an effective theory whose symmetry, locality, and point-neuron assumptions delimit its biological reach. Fixed-seed numerical experiments expose the mechanisms discussed but do not substitute for analytical results.

cs.NE↗

arXiv2026

Neural Logic, Invariance, and the Retina---McCulloch and Pitts

This chapter reconstructs the McCulloch-Pitts program as a physics of neural computation rather than the familiar cartoon of a binary neuron. The 1943 logical calculus is developed in both directions: given a net, characterize the propositions realized by its activity; given an admissible logical expression, construct a net that realizes it. We recover the original distinction between thresholded excitatory summation and absolute inhibitory veto-one the weighted-threshold form cannot preserve for arbitrarily large excitatory inputs-and read unit-time delay as the physical realization of logical depth. Recurrence is treated exactly: an autonomous, deterministic network of finitely many binary units has a finite state space, so every trajectory eventually enters a periodic orbit-a fact about finite-state dynamics, not unbounded Turing computation. A single threshold element realizes only linearly separable Boolean functions, whereas finite feedforward networks of them synthesize any Boolean function on a finite domain. We then follows McCulloch and Pitts beyond threshold logic. The 1945 heterarchy paper turns cyclic preference into an obstruction to representation by a scalar utility. The 1947 work on universals asks how a physical network can identify inputs related by nuisance transformations, developed here via group averaging and feedback canonicalization. The 1959 frog-retina study makes the adequate-stimulus question experimental, revealing parallel invariant operations before the brain proper. Spike-triggered analysis shows how a nonlinearly driven neuron can have a vanishing first-order average while second-order statistics recover its hidden selectivity: methodological failure can masquerade as physiological absence. Modern mathematical tools are used without projecting their notation onto the historical papers, and limitations of the idealization are stated explicitly.

q-bio.NC↗

arXiv2026

Percolation Dynamics in Optimization : Variance Cascades and Discrete Scale Invariance

We study the dynamics of Stochastic Gradient Descent (SGD), which is known to steer deep neural networks toward invariant sets that correspond to simpler subnetworks. How this steering unfolds over time remains poorly understood. We answer this by modeling the stochastic gradient flow (SGF) as a percolation process, in which architectural symmetries force subnetworks to merge in discrete simultaneous blocks rather than one at a time. These structural transitions register as variance spikes in a macroscopic order parameter, echoing physical phase transitions. We further show this trapping mechanism and its associated scaling cascade extend to Adam and AdamW under an explicit heavy-tailed noise model.

cs.LG↗