{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,12,30]],"date-time":"2024-12-30T18:58:15Z","timestamp":1735585095472},"reference-count":39,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2021,3,11]],"date-time":"2021-03-11T00:00:00Z","timestamp":1615420800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003693","name":"Korea Institute of Science and Technology","doi-asserted-by":"publisher","award":["2E31031"],"id":[{"id":"10.13039\/501100003693","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","award":["2019M3F3A1A02072175","2020R1A6A3A01096318"],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Comput. Neurosci."],"abstract":"Among many artificial neural networks, the research on Spike Neural Network (SNN), which mimics the energy-efficient signal system in the brain, is drawing much attention. Memristor is a promising candidate as a synaptic component for hardware implementation of SNN, but several non-ideal device properties are making it challengeable. In this work, we conducted an SNN simulation by adding a device model with a non-linear weight update to test the impact on SNN performance. We found that SNN has a strong tolerance for the device non-linearity and the network can keep the accuracy high if a device meets one of the two conditions: 1. symmetric LTP and LTD curves and 2. positive non-linearity factors for both LTP and LTD. The reason was analyzed in terms of the balance between network parameters as well as the variability of weight. The results are considered to be a piece of useful prior information for the future implementation of emerging device-based neuromorphic hardware.<\/jats:p>","DOI":"10.3389\/fncom.2021.646125","type":"journal-article","created":{"date-parts":[[2021,3,11]],"date-time":"2021-03-11T05:58:51Z","timestamp":1615442331000},"update-policy":"http:\/\/dx.doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":48,"title":["Spiking Neural Network (SNN) With Memristor Synapses Having Non-linear Weight Update"],"prefix":"10.3389","volume":"15","author":[{"given":"Taeyoon","family":"Kim","sequence":"first","affiliation":[]},{"given":"Suman","family":"Hu","sequence":"additional","affiliation":[]},{"given":"Jaewook","family":"Kim","sequence":"additional","affiliation":[]},{"given":"Joon Young","family":"Kwak","sequence":"additional","affiliation":[]},{"given":"Jongkil","family":"Park","sequence":"additional","affiliation":[]},{"given":"Suyoun","family":"Lee","sequence":"additional","affiliation":[]},{"given":"Inho","family":"Kim","sequence":"additional","affiliation":[]},{"given":"Jong-Keuk","family":"Park","sequence":"additional","affiliation":[]},{"given":"YeonJoo","family":"Jeong","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2021,3,11]]},"reference":[{"key":"B1","doi-asserted-by":"crossref","first-page":"929","DOI":"10.1109\/IJCNN.2016.7727298","article-title":"\u201cResistive memory device requirements for a neural algorithm accelerator,\u201d","volume-title":"2016 International Joint Conference on Neural Networks (IJCNN)","author":"Agarwal","year":"2016"},{"key":"B2","doi-asserted-by":"publisher","first-page":"9","DOI":"10.3389\/fnbot.2016.00009","article-title":"Deep learning with convolutional neural networks applied to electromyography data: a resource for the classification of movements for prosthetic hands","volume":"10","author":"Atzori","year":"2016","journal-title":"Front. Neurorobot."},{"key":"B3","doi-asserted-by":"publisher","first-page":"015102","DOI":"10.1088\/1361-6528\/aae81c","article-title":"Extended memory lifetime in spiking neural networks employing memristive synapses with nonlinear conductance dynamics","volume":"30","author":"Brivio","year":"2018","journal-title":"Nanotechnology"},{"key":"B4","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1006\/jtbi.1998.0782","article-title":"Firing frequency of leaky intergrate-and-fire neurons with synaptic current dynamics","volume":"195","author":"Brunel","year":"1998","journal-title":"J. Theor. Biol."},{"key":"B5","doi-asserted-by":"publisher","first-page":"445205","DOI":"10.1088\/1361-6528\/ab3480","article-title":"Improving linearity by introducing Al in HfO 2 as a memristor synapse device","volume":"30","author":"Chandrasekaran","year":"2019","journal-title":"Nanotechnology"},{"key":"B6","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1109\/MCAS.2013.2256260","article-title":"Building neuromorphic circuits with memristive devices","volume":"13","author":"Chang","year":"2013","journal-title":"IEEE Circ. Syst. Mag."},{"key":"B7","doi-asserted-by":"publisher","first-page":"091105","DOI":"10.1063\/1.5108654","article-title":"Exploiting the switching dynamics of HfO 2 -based ReRAM devices for reliable analog memristive behavior","volume":"7","author":"C\u00fcppers","year":"2019","journal-title":"APL Mater"},{"key":"B8","doi-asserted-by":"crossref","first-page":"1185","DOI":"10.1109\/ICMLA.2015.205","article-title":"\u201cA survey of machine learning applications for energy-efficient resource management in cloud computing environments,\u201d","volume-title":"2015 IEEE 14th International Conference on Machine Learning and Applications (ICMLA)","author":"Demirci","year":"2015"},{"key":"B9","doi-asserted-by":"publisher","first-page":"99","DOI":"10.3389\/fncom.2015.00099","article-title":"Unsupervised learning of digit recognition using spike-timing-dependent plasticity","volume":"9","author":"Diehl","year":"2015","journal-title":"Front. Comput. Neurosci."},{"key":"B10","unstructured":"\u201cNeuromorphic accelerators: a comparison between neuroscience and machine-learning approaches,\u201d494507 DuZ. RubinD. D. B.-D. ChenY. HeL. ChenT. ZhangL. 48th Annual IEEE\/ACM International Symposium on Microarchitecture (MICRO) (Waikiki, HI)2015"},{"key":"B11","doi-asserted-by":"publisher","first-page":"556","DOI":"10.1016\/j.neuron.2012.08.001","article-title":"The spike-timing dependence of plasticity","volume":"75","author":"Feldman","year":"2012","journal-title":"Neuron"},{"key":"B12","doi-asserted-by":"publisher","first-page":"7178","DOI":"10.1038\/s41598-018-25376-x","article-title":"Evidence of soft bound behaviour in analogue memristive devices for neuromorphic computing","volume":"8","author":"Frascaroli","year":"2018","journal-title":"Sci. Rep."},{"key":"B13","doi-asserted-by":"publisher","first-page":"313","DOI":"10.3390\/s19020313","article-title":"Development of a recognition system for spraying areas from unmanned aerial vehicles using a machine learning approach","volume":"19","author":"Gao","year":"2019","journal-title":"Sensors"},{"key":"B14","doi-asserted-by":"publisher","first-page":"295","DOI":"10.1142\/S0129065709002002","article-title":"Spiking neural networks","volume":"19","author":"Ghosh-Dastidar","year":"2009","journal-title":"Int. J. Neural Syst."},{"key":"B15","doi-asserted-by":"publisher","first-page":"152127","DOI":"10.1063\/1.5042452","article-title":"Magnetic domain wall neuron with lateral inhibition","volume":"124","author":"Hassan","year":"2018","journal-title":"J. Appl. Phys."},{"key":"B16","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1109\/ICECS.2016.7841138","article-title":"\u201cImproved winner-take-all circuit for neural network based on frequency-modulated signals,\u201d","volume-title":"2016 IEEE International Conference on Electronics, Circuits and Systems (ICECS)","author":"Hikawa","year":"2016"},{"key":"B17","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1038\/s42256-020-0159-4","article-title":"Rapid online learning and robust recall in a neuromorphic olfactory circuit","volume":"2","author":"Imam","year":"2020","journal-title":"Nat. Mach. Intell."},{"key":"B18","doi-asserted-by":"publisher","first-page":"73","DOI":"10.3389\/fnins.2011.00073","article-title":"Neuromorphic silicon neuron circuits","volume":"5","author":"Indiveri","year":"2011","journal-title":"Front. Neurosci."},{"key":"B19","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1109\/LED.2015.2418342","article-title":"Optimization of conductance change in Pr1\u2212xCaxMnO3-based synaptic devices for neuromorphic systems","volume":"36","author":"Jang","year":"2015","journal-title":"IEEE Electron Device Lett."},{"key":"B20","doi-asserted-by":"publisher","first-page":"1600090","DOI":"10.1002\/aelm.201600090","article-title":"Memristors for energy-efficient new computing paradigms","volume":"2","author":"Jeong","year":"2016","journal-title":"Adv. Electron. Mater."},{"key":"B21","doi-asserted-by":"publisher","first-page":"173105","DOI":"10.1063\/1.4934818","article-title":"Utilizing multiple state variables to improve the dynamic range of analog switching in a memristor","volume":"107","author":"Jeong","year":"2015","journal-title":"Appl. Phys. Lett."},{"key":"B22","doi-asserted-by":"publisher","first-page":"184","DOI":"10.1109\/TNANO.2017.2784364","article-title":"Parasitic effect analysis in memristor-array-based neuromorphic systems","volume":"17","author":"Jeong","year":"2017","journal-title":"IEEE Trans. Nanotechnol."},{"key":"B23","doi-asserted-by":"publisher","first-page":"12971301","DOI":"10.1021\/nl904092h","article-title":"Nanoscale memristor device as synapse in neuromorphic systems","volume":"10","author":"Jo","year":"2010","journal-title":"Nano Lett."},{"key":"B24","doi-asserted-by":"publisher","first-page":"1904020","DOI":"10.1002\/adma.202070259","article-title":"Flexible piezoelectric acoustic sensors and machine learning for speech processing","volume":"32","author":"Jung","year":"2020","journal-title":"Adv. Mater."},{"key":"B25","doi-asserted-by":"publisher","first-page":"1800866","DOI":"10.1002\/aelm.201800866","article-title":"Various Threshold Switching Devices for Integrate and Fire Neuron Applications","author":"Lee","year":"","journal-title":"Adv Electron Mater"},{"key":"B26","doi-asserted-by":"publisher","first-page":"6050","DOI":"10.1166\/jnn.2019.17025","article-title":"Unsupervised online learning with multiple postsynaptic neurons based on spike-timing-dependent plasticity using a thin-film transistor-type nor flash memory array","volume":"19","author":"Lee","year":"","journal-title":"J. Nanosci. Nanotechnol."},{"key":"B27","doi-asserted-by":"publisher","first-page":"2385","DOI":"10.1038\/s41467-018-04484-2","article-title":"Efficient and self-adaptive in-situ learning in multilayer memristor neural networks","volume":"9","author":"Li","year":"2018","journal-title":"Nat. Commun."},{"key":"B28","doi-asserted-by":"publisher","first-page":"443","DOI":"10.1515\/ntrev-2018-0045","article-title":"Optimization of non-linear conductance modulation based on metal oxide memristors","volume":"7","author":"Liu","year":"2018","journal-title":"Nanotechnol. Rev."},{"key":"B29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/ACCESS.2020.3021590","article-title":"Image recognition technology based on machine learning","author":"Liu","year":"2020","journal-title":"IEEE Access"},{"key":"B30","doi-asserted-by":"publisher","first-page":"668","DOI":"10.1126\/science.1254642","article-title":"A million spiking-neuron integrated circuit with a scalable communication network and interface","volume":"345","author":"Merolla","year":"2014","journal-title":"Science"},{"key":"B31","doi-asserted-by":"publisher","first-page":"152135","DOI":"10.1063\/1.5042408","article-title":"A phase-change memory model for neuromorphic computing","volume":"124","author":"Nandakumar","year":"2018","journal-title":"J. Appl. Phys."},{"key":"B32","doi-asserted-by":"crossref","first-page":"409","DOI":"10.55782\/ane-2011-1862","article-title":"Introduction to spiking neural networks: information processing, learning, and applications","volume":"71","author":"Ponulak","year":"2011","journal-title":"Acta Neurobiol. Exp."},{"key":"B33","doi-asserted-by":"publisher","first-page":"288","DOI":"10.1109\/TNANO.2013.2250995","article-title":"Immunity to device variations in a spiking neural network with memristive nanodevices","volume":"12","author":"Querlioz","year":"2013","journal-title":"IEEE Trans. Nanotechnol."},{"key":"B34","unstructured":"\u201cSWAT: an unsupervised SNN training algorithm for classification problems,\u201d26482655 WadeJ. J. McDaidL. J. SantosJ. A. SayersH. M. proceed in 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence) (Hong Kong)2008"},{"key":"B35","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1038\/s41928-018-0023-2","article-title":"Fully memristive neural networks for pattern classification with unsupervised learning","volume":"1","author":"Wang","year":"2018","journal-title":"Nat. Electron."},{"key":"B36","doi-asserted-by":"publisher","first-page":"107741","DOI":"10.1016\/j.sse.2019.107741","article-title":"Implementation of homeostasis functionality in neuron circuit using double-gate device for spiking neural network","volume":"165","author":"Woo","year":"2019","journal-title":"Solid State Electron."},{"key":"B37","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1038\/s41427-021-00282-3","article-title":"Integrated neuromorphic computing networks by artificial spin synapses and spin neurons","volume":"13","author":"Yang","year":"2021","journal-title":"NPG Asia Mater."},{"key":"B38","doi-asserted-by":"publisher","first-page":"641","DOI":"10.1038\/s41586-020-1942-4","article-title":"Fully hardware-implemented memristor convolutional neural network","volume":"577","author":"Yao","year":"2020","journal-title":"Nature"},{"key":"B39","doi-asserted-by":"publisher","first-page":"62","DOI":"10.3389\/fncom.2015.00062","article-title":"Input-output relation and energy efficiency in the neuron with different spike threshold dynamics","volume":"9","author":"Yi","year":"2015","journal-title":"Front. Comput. Neurosci."}],"container-title":["Frontiers in Computational Neuroscience"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fncom.2021.646125\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,25]],"date-time":"2024-08-25T20:40:36Z","timestamp":1724618436000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fncom.2021.646125\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,11]]},"references-count":39,"alternative-id":["10.3389\/fncom.2021.646125"],"URL":"https:\/\/doi.org\/10.3389\/fncom.2021.646125","relation":{},"ISSN":["1662-5188"],"issn-type":[{"type":"electronic","value":"1662-5188"}],"subject":[],"published":{"date-parts":[[2021,3,11]]}}}