Abstract
Usually, the back-propagation learning rule is widely used for complex-valued neural networks as well. On the other hand, in this paper, learning rule for complex-valued neural networks using the simultaneous perturbation optimization method is proposed. Comparison between the back-propagation method and the proposed.simultaneous perturbation learning rule is made for some test problems. Simplicity of the proposed method results in faster learning speed.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Hirose, A.: Dynamics of Fully Complex-valued Neural Networks. Electronics Letters 28, 1492–1494 (1992)
Jankowski, S., Lozowski, A., Zurada, J.M.: Complex-valued Multistate Neural Associative Memory. IEEE Trans. Neural Networks 7, 1491–1496 (1996)
Nitta, T. (ed.): Complex-valued Neural Networks. Information Science Reference, Hershey (2009)
Nitta, T.: An Extension of the Back-propagation Algorithm to Complex Numbers. Neural Networks 10, 1391–1415 (1997)
Hirose, A.: Continuous Complex-valued Back-propagation Learning. Electronics Letters 28, 1854–1855 (1992)
Georgiou, G.M., Koutsougeras, C.: Complex Domain Backpropagation. IEEE Trans. Circuits and Systems II: Analog and Digital Signal Processing 39, 330–334 (1992)
Spall, J.C.: A Stochastic Approximation Technique for Generating Maximum Likelihood Parameter Estimates. In: Proc. of the 1987 American Control Conference, pp. 1161–1167 (1987)
Spall, J.C.: Multivariable Stochastic Approximation Using a Simultaneous Perturbation Gradient Approximation. IEEE Trans. Automatic Control, AC 37, 332–341 (1992)
Maeda, Y., Kanata, Y.: Learning Rules for Recurrent Neural Networks Using Perturbation and Their Application to Neuro-control. Trans. of the Institute of Electrical Engineers of Japan 113-C, 402–408 (1993) (in Japanese)
Maeda, Y., Kanata, Y.: A Learning Rule of Neural Networks for Neuro-controller. In: Proc. of the 1995 World Congress of Neural Networks, vol. 2, p. II-402–II-405(1995)
Maeda, Y., de Figueiredo, R.J.P.: Learning Rules for Neuro-controller Via Simultaneous Perturbation. IEEE Trans. Neural Networks 8, 1119–1130 (1997)
Maeda, Y., Hirano, H., Kanata, Y.: A Learning Rule of Neural Networks Via Simultaneous Perturbation and Its Hardware Implementation. Neural Networks 8, 251–259 (1995)
Cauwenberghs, G.: An Analog VLSI Recurrent Neural Network Learning a Continuous-time Trajectory. IEEE Trans. Neural Networks 7, 346–361 (1996)
Maeda, Y., Nakazawa, A., Kanata, Y.: Hardware Implementation of a Pulse Density Neural Network Using Simultaneous Perturbation Learning Rule. Analog Integrated Circuits and Signal Processing 18, 1–10 (1999)
Maeda, Y., Tada, T.: FPGA Implementation of a Pulse Density Neural Network with Learning Ability Using Simultaneous Perturbation. IEEE Trans. Neural Networks 14, 688–695 (2003)
Maeda, Y., Wakamura, M.: Simultaneous Perturbation Learning Rule for Recurrent Neural Networks and Its FPGA Implementation. IEEE Trans. Neural Networks 16, 1664–1672 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Maeda, Y., Yamada, T., Miyoshi, S., Hikawa, H. (2011). Learning Scheme for Complex Neural Networks Using Simultaneous Perturbation. In: Honkela, T., Duch, W., Girolami, M., Kaski, S. (eds) Artificial Neural Networks and Machine Learning – ICANN 2011. ICANN 2011. Lecture Notes in Computer Science, vol 6792. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21738-8_59
Download citation
DOI: https://doi.org/10.1007/978-3-642-21738-8_59
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-21737-1
Online ISBN: 978-3-642-21738-8
eBook Packages: Computer ScienceComputer Science (R0)