Impact of noise structure and network topology on tracking speed of neural networks
- PMID: 21724371
- DOI: 10.1016/j.neunet.2011.05.018
Impact of noise structure and network topology on tracking speed of neural networks
Abstract
Understanding why neural systems can process information extremely fast is a fundamental question in theoretical neuroscience. The present study investigates the effect of noise on accelerating neural computation. To evaluate the speed of network response, we consider a computational task in which the network tracks time-varying stimuli. Two noise structures are compared, namely, the stimulus-dependent and stimulus-independent noises. Based on a simple linear integrate-and-fire model, we theoretically analyze the network dynamics, and find that the stimulus-dependent noise, whose variance is proportional to the mean of external inputs, has better effect on speeding up network computation. This is due to two good properties in the transient network dynamics: (1) the instant firing rate of the network is proportional to the mean of external inputs, and (2) the stationary state of the network is robust to stimulus changes. We investigate two network models with varying recurrent interactions, and find that recurrent interactions tend to slow down the tracking speed of the network. When the biologically plausible Hodgkin-Huxley model is considered, we also observe that the stimulus-dependent noise accelerates neural computation, although the improvement is smaller than that in the case of linear integrate-and-fire model.
Copyright © 2011 Elsevier Ltd. All rights reserved.
Similar articles
-
How noise affects the synchronization properties of recurrent networks of inhibitory neurons.Neural Comput. 2006 May;18(5):1066-110. doi: 10.1162/089976606776241048. Neural Comput. 2006. PMID: 16595058
-
Response of integrate-and-fire neurons to noisy inputs filtered by synapses with arbitrary timescales: firing rate and correlations.Neural Comput. 2010 Jun;22(6):1528-72. doi: 10.1162/neco.2010.06-09-1036. Neural Comput. 2010. PMID: 20100073
-
Dynamics and computation of continuous attractors.Neural Comput. 2008 Apr;20(4):994-1025. doi: 10.1162/neco.2008.10-06-378. Neural Comput. 2008. PMID: 18085986
-
A review of the integrate-and-fire neuron model: II. Inhomogeneous synaptic input and network properties.Biol Cybern. 2006 Aug;95(2):97-112. doi: 10.1007/s00422-006-0082-8. Epub 2006 Jul 5. Biol Cybern. 2006. PMID: 16821035 Review.
-
Is the integrate-and-fire model good enough?--a review.Neural Netw. 2001 Jul-Sep;14(6-7):955-75. doi: 10.1016/s0893-6080(01)00074-0. Neural Netw. 2001. PMID: 11665785 Review.
Cited by
-
Classifying Chewing and Rumination in Dairy Cows Using Sound Signals and Machine Learning.Animals (Basel). 2023 Sep 10;13(18):2874. doi: 10.3390/ani13182874. Animals (Basel). 2023. PMID: 37760274 Free PMC article.
-
Excitation-Inhibition Balanced Neural Networks for Fast Signal Detection.Front Comput Neurosci. 2020 Sep 3;14:79. doi: 10.3389/fncom.2020.00079. eCollection 2020. Front Comput Neurosci. 2020. PMID: 33013343 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
