{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,7,21]],"date-time":"2024-07-21T15:52:32Z","timestamp":1721577152751},"reference-count":25,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2018,8,15]],"date-time":"2018-08-15T00:00:00Z","timestamp":1534291200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computers"],"abstract":"The scale of modern neural networks is growing rapidly, with direct hardware implementations providing significant speed and energy improvements over their software counterparts. However, these hardware implementations frequently assume global connectivity between neurons and thus suffer from communication bottlenecks. Such issues are not found in biological neural networks. It should therefore be possible to develop new architectures to reduce the dependence on global communications by considering the connectivity of biological networks. This paper introduces two reconfigurable locally-connected architectures for implementing biologically inspired neural networks in real time. Both proposed architectures are validated using the segmented locomotive model of the C. elegans, performing a demonstration of forwards, backwards serpentine motion and coiling behaviours. Local connectivity is discovered to offer up to a 17.5\u00d7 speed improvement over hybrid systems that use combinations of local and global infrastructure. Furthermore, the concept of locality of connections is considered in more detail, highlighting the importance of dimensionality when designing neuromorphic architectures. Convolutional Neural Networks are shown to map poorly to locally connected architectures despite their apparent local structure, and both the locality and dimensionality of new neural processing systems is demonstrated as a critical component for matching the function and efficiency seen in biological networks.<\/jats:p>","DOI":"10.3390\/computers7030043","type":"journal-article","created":{"date-parts":[[2018,8,15]],"date-time":"2018-08-15T14:40:07Z","timestamp":1534344007000},"page":"43","source":"Crossref","is-referenced-by-count":1,"title":["An Analytical Comparison of Locally-Connected Reconfigurable Neural Network Architectures Using a C. elegans Locomotive Model"],"prefix":"10.3390","volume":"7","author":[{"given":"Jonathan","family":"Graham-Harper-Cater","sequence":"first","affiliation":[{"name":"Department of Electronic and Electrical Engineering, University of Bath, Bath BA2 7AY, UK"}]},{"ORCID":"http:\/\/orcid.org\/0000-0003-4279-8930","authenticated-orcid":false,"given":"Benjamin","family":"Metcalfe","sequence":"additional","affiliation":[{"name":"Department of Electronic and Electrical Engineering, University of Bath, Bath BA2 7AY, UK"}]},{"given":"Peter","family":"Wilson","sequence":"additional","affiliation":[{"name":"Department of Electronic and Electrical Engineering, University of Bath, Bath BA2 7AY, UK"}]}],"member":"1968","published-online":{"date-parts":[[2018,8,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2352","DOI":"10.1162\/neco_a_00990","article-title":"Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review","volume":"29","author":"Rawat","year":"2017","journal-title":"Neural Comput."},{"key":"ref_2","first-page":"13","article-title":"Neuromorphic computing gets ready for the (really) big time","volume":"57","author":"Monroe","year":"2014","journal-title":"Commun. ACM"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1629","DOI":"10.1109\/5.58356","article-title":"Neuromorphic electronic systems","volume":"78","author":"Mead","year":"1990","journal-title":"Proc. IEEE"},{"key":"ref_4","first-page":"1","article-title":"The Structure of the Nervous System of the Nematode Caenorhabditis elegans","volume":"314","author":"White","year":"1986","journal-title":"Philos. Trans. R. Soc. B Biol. Sci."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"537","DOI":"10.1007\/s11063-015-9425-6","article-title":"Neural Mechanism of Corticofugal Modulation of Tuning Property in Frequency Domain of Bat\u2019s Auditory System","volume":"43","author":"Fujita","year":"2016","journal-title":"Neural Process. Lett."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1943","DOI":"10.1109\/JSSC.2013.2259038","article-title":"SpiNNaker: A 1-W 18-Core System-on-Chip for Massively-Parallel Neural Network Simulation","volume":"48","author":"Painkras","year":"2013","journal-title":"IEEE J. Solid-State Circuits"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Arthur, J.V., Merolla, P.A., Akopyan, F., Alvarez, R., Cassidy, A., Chandra, S., Esser, S.K., Imam, N., Risk, W., and Rubin, D.B.D. (2012, January 10\u201315). Building block of a programmable neuromorphic substrate: A digital neurosynaptic core. Proceedings of the 2012 International Joint Conference on Neural Networks (IJCNN), Brisbane, Australia.","DOI":"10.1109\/IJCNN.2012.6252637"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1021\/nl203687n","article-title":"A functional hybrid memristor crossbar-array\/CMOS system for data storage and neuromorphic applications","volume":"12","author":"Kim","year":"2012","journal-title":"Nano Lett."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1537","DOI":"10.1109\/TCAD.2015.2474396","article-title":"TrueNorth: Design and Tool Flow of a 65 mW 1 Million Neuron Programmable Neurosynaptic Chip","volume":"34","author":"Akopyan","year":"2015","journal-title":"IEEE Trans. Comput. Aided Des. Integr. Circuits Syst."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Bassett, D.S., Greenfield, D.L., Meyer-Lindenberg, A., Weinberger, D.R., Moore, S.W., and Bullmore, E.T. (2010). Efficient Physical Embedding of Topologically Complex Information Processing Networks in Brains and Computer Circuits. PLoS Comput. Biol., 6.","DOI":"10.1371\/journal.pcbi.1000748"},{"key":"ref_11","unstructured":"Bailey, J.A. (2010). Towards the Neurocomputer: An Investigation of VHDL Neuron Models. [Ph.D. Thesis, University of Southampton]."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Wilson, P., Metcalfe, B., Graham-Harper-Cater, J., and Bailey, J.A. (2017, January 7\u20138). A Reconfigurable Architecture for Real-Time Digital Simulation of Neurons. Proceedings of the 2017 Intelligent Systems Conference (IntelliSys), London, UK.","DOI":"10.1109\/IntelliSys.2017.8324340"},{"key":"ref_13","unstructured":"Graham-Harper-Cater, J., Clarke, C.T., Metcalfe, B.W., and Wilson, P.R. (2018, January 10\u201312). A Reconfigurable Architecture for Implementing Locally Connected Neural Arrays. Proceedings of the 2018 SAI Computing Conference, London, UK."},{"key":"ref_14","unstructured":"Claverol, E., Cannon, R., Chad, J., and Brown, A. (1999). Event based neuron models for biological simulation. A model of the locomotion circuitry of the nematode C. Elegans. World Scientific Engineering Society Press."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Bailey, J.A., Wilson, P.R., Brown, A.D., and Chad, J. (2007, January 20\u201321). Behavioral simulation of biological neuron systems using VHDL and VHDL-AMS. Proceedings of the 2007 IEEE International Behavioral Modeling and Simulation Workshop, San Jose, CA, USA.","DOI":"10.1109\/BMAS.2007.4437543"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Bailey, J.A., Wilson, P.R., Brown, A.D., and Chad, J.E. (2008, January 25\u201326). Behavioural simulation and synthesis of biological neuron systems using VHDL. Proceedings of the 2008 IEEE International Behavioral Modeling and Simulation Workshop, San Jose, CA, USA.","DOI":"10.1109\/BMAS.2008.4751231"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2392","DOI":"10.1016\/j.neucom.2011.04.001","article-title":"Behavioral simulation and synthesis of biological neuron systems using synthesizable VHDL","volume":"74","author":"Bailey","year":"2011","journal-title":"Neurocomputing"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1007\/s10827-007-0054-6","article-title":"Systems level circuit model of C. elegans undulatory locomotion: mathematical modeling and molecular genetics","volume":"24","author":"Karbowski","year":"2008","journal-title":"J. Comput. Neurosci."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Mailler, R., Avery, J., Graves, J., and Willy, N. (2010, January 7\u201313). A Biologically Accurate 3D Model of the Locomotion of Caenorhabditis Elegans. Proceedings of the 2010 International Conference on Biosciences, Cancun, Mexico.","DOI":"10.1109\/BioSciencesWorld.2010.18"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1132","DOI":"10.1016\/S0006-3495(91)82149-X","article-title":"Theory of the locomotion of nematodes","volume":"60","author":"Niebur","year":"1991","journal-title":"Biophys. J."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3389\/fncom.2012.00010","article-title":"Gait Modulation in C. elegans: An Integrated Neuromechanical Model","volume":"6","author":"Boyle","year":"2012","journal-title":"Front. Comput. Neurosci."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Zhang, C., Li, P., Sun, G., Guan, Y., Xiao, B., and Cong, J. (2015, January 22\u201324). Optimizing FPGA-based Accelerator Design for Deep Convolutional Neural Networks. Proceedings of the 2015 ACM\/SIGDA International Symposium on Field-Programmable Gate Arrays, Monterey, CA, USA.","DOI":"10.1145\/2684746.2689060"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Zhang, C., Fang, Z., Zhou, P., Pan, P., and Cong, J. (2016, January 7\u201310). Caffeine: Towards Uniformed Representation and Acceleration for Deep Convolutional Neural Networks. Proceedings of the 35th International Conference on Computer-Aided Design, Austin, TX, USA.","DOI":"10.1145\/2966986.2967011"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2220","DOI":"10.1109\/TVLSI.2017.2688340","article-title":"Deep Convolutional Neural Network Architecture With Reconfigurable Computation Patterns","volume":"25","author":"Tu","year":"2017","journal-title":"IEEE Trans. Very Large Scale Integr. Syst."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"968","DOI":"10.1109\/JSSC.2017.2778281","article-title":"A High Energy Efficient Reconfigurable Hybrid Neural Network Processor for Deep Learning Applications","volume":"53","author":"Yin","year":"2018","journal-title":"IEEE J. Solid-State Circuits"}],"container-title":["Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-431X\/7\/3\/43\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,12]],"date-time":"2024-06-12T03:29:15Z","timestamp":1718162955000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-431X\/7\/3\/43"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,8,15]]},"references-count":25,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2018,9]]}},"alternative-id":["computers7030043"],"URL":"https:\/\/doi.org\/10.3390\/computers7030043","relation":{},"ISSN":["2073-431X"],"issn-type":[{"value":"2073-431X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,8,15]]}}}