Abstract
One of the most pervading concepts underlying computational models of information processing in the brain is linear input integration of rate coded uni-variate information by neurons. After a suitable learning process this results in neuronal structures that statically represent knowledge as a vector of real valued synaptic weights. Although this general framework has contributed to the many successes of connectionism, in this paper we argue that for all but the most basic of cognitive processes, a more complex, multi-variate dynamic neural coding mechanism is required - knowledge should not be spacially bound to a particular neuron or group of neurons. We conclude the paper with discussion of a simple experiment that illustrates dynamic knowledge representation in a spiking neuron connectionist system.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Abbot, L.: Learning in Neural Network Memories, Network: Computation in Neural Systems 1, (1990) 105–122
Ahmad, S.: VISIT: An efficient computational model of human visual attention, PhD Thesis, University of Illinois, USA (1991)
Barnden, J., Pollack, J. (eds.): High-Level Connectionist Models, Ablex, Norwood NJ, USA (1990)
Bishop, J.M.: Stochastic Searching Networks, Proc. 1st IEE Int. Conf. on Artificial Neural Networks, London, UK (1989) 329–331
Dinsmore, J.: Symbolism and Connectionism: a difficult marriage, Technical Report TR 90-8, Southern University of Carbondale, USA (1990)
Fodor, J.A., Pylyshyn, Z.W.: Connectionism and Cognitive Architecture: a critical analysis, Cognition 28, (1988) 3–72
Hubel, D.H., Wiesel, T.N.: Receptive fields, binocular interaction and functional architecture in the cat’s visual cortex, Journal of Physiology 160 (1962) 106–154
James, W.: Psychology (briefer course), Holt, New York, USA (1891)
Maass, Bishop, C. (eds.): Pulsed Neural Networks, The MIT Press, Cambridge MA, USA (1999)
McCulloch, W.S., Pitts, W.: A logical calculus immanent in nervous activity, Bulletin of Mathematical Biophysics 5 (1943) 115–133
Mumford, D.: Neural Architectures for Pattern-theoretic Problems. In: Koch, Ch., Davies, J.L. (eds.): Large Scale Neuronal Theories of the Brain. The MIT Press, London, England (1994)
Nasuto, S.J., Bishop, J.M., Lauria, S.: Time Complexity Analysis of the Stochastic Diffusion Search, Neural Computation’ 98, Vienna, Austria (1998)
Nasuto, S.J., Bishop, J.M.: Neural Stochastic Diffusion Search Network-a theoretical solution to the binding problem, Proc. ASSC2, Bremen, Germany (1988) 19–20
Nasuto, S.J., Bishop, J.M.: Convergence of the Stochastic Diffusion Search, Parallel Algorithms 14:2, (1999) 89–107.
Pinker, S., Prince, A.: On Language and Connectionism: Analysis of a Parallel Distributed Processing Model of Language Acquisition. In: Pinker, S., Mahler, J. (eds.): Connections and Symbols, The MIT Press, Cambridge MA, (1988)
Rumelhart, D.E., McClelland, J.L.: Parallel Distributed Processing: Explorations in the Microstructure of Cognition, The MIT Press, Cambridge MA (1986)
Russel, B.: On Denoting, Mind, (1905); repr. in Marsh, R.C. (ed.): Bertrand Russel: Logic and Knowledge. Essays 1901-1950. London, UK (1965)
Sejnowski, T.J., Rosenberg, C.R.: Parallel networks that learn to pronounce English text. Complex Systems 1 (1987) 145–168
Tarassenko, L.: A Guide to Neural Computing Applications, Arnold, London (1998)
Van Gelder, T., Port, R.F.: It’s About Time: an overview of the dynamical approach to cognition. In Port, R.F., Van Gelder, T. (eds.): Mind as Motion. The MIT Press, Cambridge MA (1995) 1–45
Van de Velde, F.: On the use of computation in modelling behaviour, Network: Computation in Neural Systems 8 (1997) R1–R32
Wittgenstein, L.: Last Writings on the Philosophy of Pyschology (vol. 1). Blackwell Oxford, UK (1948)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bishop, J.M., Nasuto, S.J., De Meyer, K. (2002). Dynamic Knowledge Representation in Connectionist Systems. In: Dorronsoro, J.R. (eds) Artificial Neural Networks — ICANN 2002. ICANN 2002. Lecture Notes in Computer Science, vol 2415. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-46084-5_51
Download citation
DOI: https://doi.org/10.1007/3-540-46084-5_51
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-44074-1
Online ISBN: 978-3-540-46084-8
eBook Packages: Springer Book Archive