Function approximation in inhibitory networks
- PMID: 26963256
- DOI: 10.1016/j.neunet.2016.01.010
Function approximation in inhibitory networks
Abstract
In performance-optimized artificial neural networks, such as convolutional networks, each neuron makes excitatory connections with some of its targets and inhibitory connections with others. In contrast, physiological neurons are typically either excitatory or inhibitory, not both. This is a puzzle, because it seems to constrain computation, and because there are several counter-examples that suggest that it may not be a physiological necessity. Parisien et al. (2008) showed that any mixture of excitatory and inhibitory functional connections could be realized by a purely excitatory projection in parallel with a two-synapse projection through an inhibitory population. They showed that this works well with ratios of excitatory and inhibitory neurons that are realistic for the neocortex, suggesting that perhaps the cortex efficiently works around this apparent computational constraint. Extending this work, we show here that mixed excitatory and inhibitory functional connections can also be realized in networks that are dominated by inhibition, such as those of the basal ganglia. Further, we show that the function-approximation capacity of such connections is comparable to that of idealized mixed-weight connections. We also study whether such connections are viable in recurrent networks, and find that such recurrent networks can flexibly exhibit a wide range of dynamics. These results offer a new perspective on computation in the basal ganglia, and also perhaps on inhibitory networks within the cortex.
Keywords: Basal ganglia; Dale’s principle; Function approximation; Inhibition; Recurrent dynamics.
Copyright © 2016 Elsevier Ltd. All rights reserved.
Similar articles
-
Assessing the Role of Inhibition in Stabilizing Neocortical Networks Requires Large-Scale Perturbation of the Inhibitory Population.J Neurosci. 2017 Dec 6;37(49):12050-12067. doi: 10.1523/JNEUROSCI.0963-17.2017. Epub 2017 Oct 26. J Neurosci. 2017. PMID: 29074575 Free PMC article.
-
Analysis of synchronization between two modules of pulse neural networks with excitatory and inhibitory connections.Neural Comput. 2006 May;18(5):1111-31. doi: 10.1162/089976606776241039. Neural Comput. 2006. PMID: 16595059
-
Training dynamically balanced excitatory-inhibitory networks.PLoS One. 2019 Aug 8;14(8):e0220547. doi: 10.1371/journal.pone.0220547. eCollection 2019. PLoS One. 2019. PMID: 31393909 Free PMC article.
-
Inhibitory stabilization and cortical computation.Nat Rev Neurosci. 2021 Jan;22(1):21-37. doi: 10.1038/s41583-020-00390-z. Epub 2020 Nov 11. Nat Rev Neurosci. 2021. PMID: 33177630 Review.
-
Neural systems for control of voluntary action--a hypothesis.Adv Biophys. 1998;35:81-102. Adv Biophys. 1998. PMID: 9949766 Review.
Cited by
-
Distinctive properties of biological neural networks and recent advances in bottom-up approaches toward a better biologically plausible neural network.Front Comput Neurosci. 2023 Jun 28;17:1092185. doi: 10.3389/fncom.2023.1092185. eCollection 2023. Front Comput Neurosci. 2023. PMID: 37449083 Free PMC article. Review.
-
MouseNet: A biologically constrained convolutional neural network model for the mouse visual cortex.PLoS Comput Biol. 2022 Sep 6;18(9):e1010427. doi: 10.1371/journal.pcbi.1010427. eCollection 2022 Sep. PLoS Comput Biol. 2022. PMID: 36067234 Free PMC article.
-
Toward an Integration of Deep Learning and Neuroscience.Front Comput Neurosci. 2016 Sep 14;10:94. doi: 10.3389/fncom.2016.00094. eCollection 2016. Front Comput Neurosci. 2016. PMID: 27683554 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources
