The Brain as an Efficient and Robust Adaptive Learner
- PMID: 28595053
- DOI: 10.1016/j.neuron.2017.05.016
The Brain as an Efficient and Robust Adaptive Learner
Abstract
Understanding how the brain learns to compute functions reliably, efficiently, and robustly with noisy spiking activity is a fundamental challenge in neuroscience. Most sensory and motor tasks can be described as dynamical systems and could presumably be learned by adjusting connection weights in a recurrent biological neural network. However, this is greatly complicated by the credit assignment problem for learning in recurrent networks, e.g., the contribution of each connection to the global output error cannot be determined based only on locally accessible quantities to the synapse. Combining tools from adaptive control theory and efficient coding theories, we propose that neural circuits can indeed learn complex dynamic tasks with local synaptic plasticity rules as long as they associate two experimentally established neural mechanisms. First, they should receive top-down feedbacks driving both their activity and their synaptic plasticity. Second, inhibitory interneurons should maintain a tight balance between excitation and inhibition in the circuit. The resulting networks could learn arbitrary dynamical systems and produce irregular spike trains as variable as those observed experimentally. Yet, this variability in single neurons may hide an extremely efficient and robust computation at the population level.
Keywords: adaptive control; balanced excitation/inhibition; efficient coding; error feedback; learning; prediction errors; recurrent networks; robustness; spike coding.
Copyright © 2017 Elsevier Inc. All rights reserved.
Similar articles
-
Local dendritic balance enables learning of efficient representations in networks of spiking neurons.Proc Natl Acad Sci U S A. 2021 Dec 14;118(50):e2021925118. doi: 10.1073/pnas.2021925118. Proc Natl Acad Sci U S A. 2021. PMID: 34876505 Free PMC article.
-
Learning in neural networks by reinforcement of irregular spiking.Phys Rev E Stat Nonlin Soft Matter Phys. 2004 Apr;69(4 Pt 1):041909. doi: 10.1103/PhysRevE.69.041909. Epub 2004 Apr 30. Phys Rev E Stat Nonlin Soft Matter Phys. 2004. PMID: 15169045
-
Oscillation-Driven Spike-Timing Dependent Plasticity Allows Multiple Overlapping Pattern Recognition in Inhibitory Interneuron Networks.Int J Neural Syst. 2016 Aug;26(5):1650020. doi: 10.1142/S0129065716500209. Epub 2016 Apr 15. Int J Neural Syst. 2016. PMID: 27079422
-
Disinhibition in learning and memory circuits: New vistas for somatostatin interneurons and long-term synaptic plasticity.Brain Res Bull. 2018 Jul;141:20-26. doi: 10.1016/j.brainresbull.2017.11.012. Epub 2017 Nov 23. Brain Res Bull. 2018. PMID: 29174732 Review.
-
Spike timing-dependent plasticity: a Hebbian learning rule.Annu Rev Neurosci. 2008;31:25-46. doi: 10.1146/annurev.neuro.31.060407.125639. Annu Rev Neurosci. 2008. PMID: 18275283 Review.
Cited by
-
Training dynamically balanced excitatory-inhibitory networks.PLoS One. 2019 Aug 8;14(8):e0220547. doi: 10.1371/journal.pone.0220547. eCollection 2019. PLoS One. 2019. PMID: 31393909 Free PMC article.
-
A roadmap to integrate astrocytes into Systems Neuroscience.Glia. 2020 Jan;68(1):5-26. doi: 10.1002/glia.23632. Epub 2019 May 6. Glia. 2020. PMID: 31058383 Free PMC article. Review.
-
Degeneracy in the robust expression of spectral selectivity, subthreshold oscillations, and intrinsic excitability of entorhinal stellate cells.J Neurophysiol. 2018 Aug 1;120(2):576-600. doi: 10.1152/jn.00136.2018. Epub 2018 May 2. J Neurophysiol. 2018. PMID: 29718802 Free PMC article.
-
Theta-frequency selectivity in the somatic spike-triggered average of rat hippocampal pyramidal neurons is dependent on HCN channels.J Neurophysiol. 2017 Oct 1;118(4):2251-2266. doi: 10.1152/jn.00356.2017. Epub 2017 Aug 2. J Neurophysiol. 2017. PMID: 28768741 Free PMC article.
-
Shared Cortex-Cerebellum Dynamics in the Execution and Learning of a Motor Task.Cell. 2019 Apr 18;177(3):669-682.e24. doi: 10.1016/j.cell.2019.02.019. Epub 2019 Mar 28. Cell. 2019. PMID: 30929904 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources