{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,22]],"date-time":"2025-02-22T00:35:44Z","timestamp":1740184544938,"version":"3.37.3"},"reference-count":21,"publisher":"IOP Publishing","issue":"1","license":[{"start":{"date-parts":[[2024,3,15]],"date-time":"2024-03-15T00:00:00Z","timestamp":1710460800000},"content-version":"vor","delay-in-days":14,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,3,15]],"date-time":"2024-03-15T00:00:00Z","timestamp":1710460800000},"content-version":"tdm","delay-in-days":14,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"funder":[{"name":"Electronic Components and Systems for European Leadership","award":["826655"]},{"DOI":"10.13039\/100006541","name":"Scientific Education and Research Institute","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100006541","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100013348","name":"Innosuisse - Schweizerische Agentur f\u00fcr Innovationsf\u00f6rderung","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100013348","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100019457","name":"Key Digital Technologies Joint Undertaking","doi-asserted-by":"crossref","award":["101097300"],"id":[{"id":"10.13039\/100019457","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["Neuromorph. Comput. Eng."],"published-print":{"date-parts":[[2024,3,1]]},"abstract":"Abstract<\/jats:title>\n Mixed-signal neuromorphic processors provide extremely low-power operation for edge inference workloads, taking advantage of sparse asynchronous computation within spiking neural networks (SNNs). However, deploying robust applications to these devices is complicated by limited controllability over analog hardware parameters, as well as unintended parameter and dynamical variations of analog circuits due to fabrication non-idealities. Here we demonstrate a novel methodology for offline training and deployment of SNNs to the mixed-signal neuromorphic processor DYNAP-SE2. Our methodology applies gradient-based training to a differentiable simulation of the mixed-signal device, coupled with an unsupervised weight quantization method to optimize the network\u2019s parameters. Parameter noise injection during training provides robustness to the effects of quantization and device mismatch, making the method a promising candidate for real-world applications under hardware constraints and non-idealities. This work extends Rockpool, an open-source deep-learning library for SNNs, with support for accurate simulation of mixed-signal SNN dynamics. Our approach simplifies the development and deployment process for the neuromorphic community, making mixed-signal neuromorphic processors more accessible to researchers and developers.<\/jats:p>","DOI":"10.1088\/2634-4386\/ad2ec3","type":"journal-article","created":{"date-parts":[[2024,2,29]],"date-time":"2024-02-29T22:23:49Z","timestamp":1709245429000},"page":"014011","update-policy":"https:\/\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Gradient-descent hardware-aware training and deployment for mixed-signal neuromorphic processors"],"prefix":"10.1088","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1025-0903","authenticated-orcid":false,"given":"Ugurcan","family":"Cakal","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0009-0009-9706-5989","authenticated-orcid":false,"family":"Maryada","sequence":"additional","affiliation":[]},{"given":"Chenxi","family":"Wu","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0863-7116","authenticated-orcid":false,"given":"Ilkay","family":"Ulusoy","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3856-826X","authenticated-orcid":true,"given":"Dylan Richard","family":"Muir","sequence":"additional","affiliation":[]}],"member":"266","published-online":{"date-parts":[[2024,3,15]]},"reference":[{"article-title":"Dynap-se2: a scalable multi-core dynamic neuromorphic asynchronous spiking neural network processor","year":"2023","author":"Richter","key":"ncead2ec3bib1"},{"key":"ncead2ec3bib2","doi-asserted-by":"publisher","first-page":"1575","DOI":"10.1109\/TBCAS.2019.2953001","article-title":"Real-time ultra-low power ECG anomaly detection using an event-driven neuromorphic processor","volume":"13","author":"Bauer","year":"2019","journal-title":"IEEE Trans. Biomed. Circuits Syst."},{"key":"ncead2ec3bib3","first-page":"pp 1","article-title":"Processing emg signals using reservoir computing on an event-based neuromorphic system","author":"Donati","year":"2018"},{"key":"ncead2ec3bib4","doi-asserted-by":"publisher","first-page":"795","DOI":"10.1109\/TBCAS.2019.2925454","article-title":"Discrimination of EMG signals using a neuromorphic implementation of a spiking neural network","volume":"13","author":"Donati","year":"2019","journal-title":"IEEE Trans. Biomed. Circuits Syst."},{"key":"ncead2ec3bib5","doi-asserted-by":"publisher","first-page":"2531","DOI":"10.1162\/089976602760407955","article-title":"Real-time computing without stable states: a new framework for neural computation based on perturbations","volume":"14","author":"Maass","year":"2002","journal-title":"Neural Comput."},{"key":"ncead2ec3bib6","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-021-02779-x","article-title":"Supervised training of spiking neural networks for robust deployment on mixed-signal neuromorphic processors","volume":"11","author":"B\u00fcchel","year":"2021","journal-title":"Sci. Rep."},{"key":"ncead2ec3bib7","doi-asserted-by":"crossref","DOI":"10.1101\/2022.10.26.513846","article-title":"Brain-inspired methods for achieving robust computation in heterogeneous mixed-signal neuromorphic processing systems","author":"Zendrikov","year":"2022"},{"key":"ncead2ec3bib8","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.3773845","article-title":"Rockpool documentaton","author":"Muir","year":"2019"},{"key":"ncead2ec3bib9","doi-asserted-by":"publisher","first-page":"106","DOI":"10.1109\/TBCAS.2017.2759700","article-title":"A scalable multicore architecture with heterogeneous memory structures for dynamic neuromorphic asynchronous processors (DYNAPs)","volume":"12","author":"Moradi","year":"2018","journal-title":"IEEE Trans. Biomed. Circuits Syst."},{"key":"ncead2ec3bib10","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1109\/MSP.2019.2931595","article-title":"Surrogate gradient learning in spiking neural networks: Bringing the power of gradient-based optimization to spiking neural networks","volume":"36","author":"Neftci","year":"2019","journal-title":"IEEE Signal Process. Mag."},{"key":"ncead2ec3bib11","doi-asserted-by":"publisher","first-page":"1016","DOI":"10.1109\/JPROC.2023.3308088","article-title":"Training spiking neural networks using lessons from deep learning","volume":"111","author":"Eshraghian","year":"2023"},{"key":"ncead2ec3bib12","doi-asserted-by":"publisher","first-page":"508","DOI":"10.3389\/fnins.2016.00508","article-title":"Training deep spiking neural networks using backpropagation","volume":"10","author":"Lee","year":"2016","journal-title":"Front. Neurosci."},{"key":"ncead2ec3bib13","doi-asserted-by":"publisher","first-page":"1514","DOI":"10.1162\/neco_a_01086","article-title":"SuperSpike: supervised learning in multilayer spiking neural networks","volume":"30","author":"Zenke","year":"2018","journal-title":"Neural Comput."},{"key":"ncead2ec3bib14","doi-asserted-by":"publisher","first-page":"1608","DOI":"10.3389\/fnins.2020.00424","article-title":"Synaptic plasticity dynamics for deep continuous local learning (DECOLLE)","volume":"14","author":"Kaiser","year":"2020","journal-title":"Front. Neurosci."},{"article-title":"DynapSIM: a fast, optimizable, and mismatch aware mixed-signal neuromorphic chip simulator","year":"2022","author":"\u00c7akal","key":"ncead2ec3bib15"},{"key":"ncead2ec3bib16","first-page":"pp 2898","article-title":"A current-mode conductance-based silicon neuron for address-event neuromorphic systems","author":"Livi","year":"2009"},{"key":"ncead2ec3bib17","doi-asserted-by":"publisher","first-page":"2581","DOI":"10.1162\/neco.2007.19.10.2581","article-title":"Synaptic dynamics in analog VLSI","volume":"19","author":"Bartolozzi","year":"2007","journal-title":"Neural Comput."},{"key":"ncead2ec3bib18","doi-asserted-by":"publisher","first-page":"1367","DOI":"10.1109\/JPROC.2014.2313954","article-title":"Neuromorphic electronic circuits for building autonomous cognitive systems","volume":"102","author":"Chicca","year":"2014","journal-title":"Proc. IEEE"},{"article-title":"JAX: composable transformations of Python+NumPy programs","year":"2018","author":"Bradbury","key":"ncead2ec3bib19"},{"article-title":"Adam: a method for stochastic optimization","year":"2015","author":"Kingma","key":"ncead2ec3bib20"},{"key":"ncead2ec3bib21","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1109\/TVLSI.2019.2951493","article-title":"Mapping spiking neural networks to neuromorphic hardware","volume":"28","author":"Balaji","year":"2020","journal-title":"IEEE Trans. Very Large Scale Integr. (VLSI) Syst."}],"container-title":["Neuromorphic Computing and Engineering"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ad2ec3","content-type":"text\/html","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ad2ec3\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ad2ec3","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ad2ec3\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ad2ec3\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ad2ec3\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ad2ec3\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"similarity-checking"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ad2ec3\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,15]],"date-time":"2024-03-15T10:34:32Z","timestamp":1710498872000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ad2ec3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,1]]},"references-count":21,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,3,15]]},"published-print":{"date-parts":[[2024,3,1]]}},"URL":"https:\/\/doi.org\/10.1088\/2634-4386\/ad2ec3","relation":{},"ISSN":["2634-4386"],"issn-type":[{"type":"electronic","value":"2634-4386"}],"subject":[],"published":{"date-parts":[[2024,3,1]]},"assertion":[{"value":"Gradient-descent hardware-aware training and deployment for mixed-signal neuromorphic processors","name":"article_title","label":"Article Title"},{"value":"Neuromorphic Computing and Engineering","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2024 The Author(s). Published by IOP Publishing Ltd","name":"copyright_information","label":"Copyright Information"},{"value":"2023-10-18","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2024-02-29","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2024-03-15","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}