Increasing Capacity of Association Memory by Means of Synaptic Clustering

Abstract : Making association is an essential property of human cognition. Systems that try to mimic this process and to make a coherent model of the world should have robust and high capacity association memory. Findings of nonlinear properties of dendritic tree suggest an alternative way how neurons can store associations. In this paper, we present a minimalistic neuron model with clustered synapses and show that it provides much higher association memory capacity compared to traditional models. Due to properties of sparse activation and tracking higher-order correlations in the input pattern an individual neuron can recognize thousands of patterns. Theoretical examination shows that this high capacity is reached because learning exact combinations of active neurons extends the dimension of an input space and thus increases pattern separability. We argue that such beneficial computational properties is realized in biological neural networks through synaptic clustering and sustaining sparse activity in memory-related areas.
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-02143550
Contributor : Patrick Henaff <>
Submitted on : Wednesday, May 29, 2019 - 2:47:13 PM
Last modification on : Thursday, June 13, 2019 - 3:09:24 PM

Identifiers

Collections

Citation

Viacheslav Osaulenko, Bernard Girau, Oleksandr Makarenko, Patrick Henaff. Increasing Capacity of Association Memory by Means of Synaptic Clustering. Neural Processing Letters, Springer Verlag, 2019, ⟨10.1007/s11063-019-10051-7⟩. ⟨hal-02143550⟩

Share

Metrics

Record views

17