doi: 10.1016/s0893-6080(98)00035-5.
Information storage capacity of incompletely connected associative memories
Affiliations
- PMID: 12662789
- DOI: 10.1016/s0893-6080(98)00035-5
Item in Clipboard
Information storage capacity of incompletely connected associative memories
Neural Netw.
1998 Jul.
Abstract
In this paper, the memory capacity of incompletely connected associative memories is investigated. First, the capacity is derived for memories with fixed parameters. Optimization of the parameters yields a maximum capacity between 0.53 and 0.69 for hetero-association and half of it for autoassociation improving previously reported results. The maximum capacity grows with increasing connectivity of the memory and requires sparse input and output patterns. Further, parameters can be chosen in such a way that the information content per pattern asymptotically approaches 1 with growing size of the memory.
Similar articles
-
Notions of Associative Memory and Sparse Coding.Neural Netw. 1996 Nov;9(8):1429-1458. doi: 10.1016/s0893-6080(96)00044-5. Neural Netw. 1996. PMID: 12662544
-
Gray-scale morphological associative memories.IEEE Trans Neural Netw. 2006 May;17(3):559-70. doi: 10.1109/TNN.2006.873280. IEEE Trans Neural Netw. 2006. PMID: 16722162
-
Storage capacity of networks with discrete synapses and sparsely encoded memories.Phys Rev E. 2022 May;105(5-1):054408. doi: 10.1103/PhysRevE.105.054408. Phys Rev E. 2022. PMID: 35706193
-
Associative memory in networks of spiking neurons.Neural Netw. 2001 Jul-Sep;14(6-7):825-34. doi: 10.1016/s0893-6080(01)00064-8. Neural Netw. 2001. PMID: 11665774 Review.
-
Tree-like hierarchical associative memory structures.Neural Netw. 2011 Mar;24(2):143-7. doi: 10.1016/j.neunet.2010.09.012. Epub 2010 Oct 7. Neural Netw. 2011. PMID: 20970304 Review.
Cited by
-
Distinctive properties of biological neural networks and recent advances in bottom-up approaches toward a better biologically plausible neural network.Front Comput Neurosci. 2023 Jun 28;17:1092185. doi: 10.3389/fncom.2023.1092185. eCollection 2023. Front Comput Neurosci. 2023. PMID: 37449083 Free PMC article. Review.
-
Structural Plasticity, Effectual Connectivity, and Memory in Cortex.Front Neuroanat. 2016 Jun 16;10:63. doi: 10.3389/fnana.2016.00063. eCollection 2016. Front Neuroanat. 2016. PMID: 27378861 Free PMC article.
-
Structural synaptic plasticity has high memory capacity and can explain graded amnesia, catastrophic forgetting, and the spacing effect.PLoS One. 2014 May 23;9(5):e96485. doi: 10.1371/journal.pone.0096485. eCollection 2014. PLoS One. 2014. PMID: 24858841 Free PMC article.
LinkOut - more resources
Full Text Sources
