Abstract
The integrated technology of the artificial neural network is a research focus of the neural computing technology, which possesses ripe applications in a lot of fields. The neural network ensemble studies the same question with limited neural networks. The output of the ensemble under some input example is determined by all the output of the neural network forming the ensemble under the same input example. The negative correlation learning, which encourages different individual network to study and train different parts of the ensemble in order to make the whole ensemble study the whole training data better, is a training method for the neural network ensemble in this paper. Using a BP algorithm with impulse in the error function is an improvement of the method of negative correlation learning in the paper. The method is an algorithm in batches with more powerful generalization ability and studying of speed, because it combines primitive correlation learning with BP algorithm of impulse.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Hornik, K.M., Stinchcombe, M., White, H.: Multiayer Feedforward Networks are Universal Approximators. Neural Networks 2, 359–366 (2002)
Hansen, L.K., Salamon, P.: Neural Network Ensembles. IEEE Transactions on Pattern Analysis and Machine Intellience 12, 993–1001 (1999)
Rumelhar, D.E., Hinton, G.E., Williams, R.J.: Learning Internal Representations by Error Propagation. In: Rumlhart, D.E., Mcclell, J.L. (eds.) MIT Press, pp. 318–362. MIT Press, Cambridge (2001)
Sollich, P., Krogh, A.: Learning with Ensembles: How Overfitting can be Useful. In: Touretzky, D., Mozer, M. (eds.) Hasselmo Meds Advance in Neural Information processing Systems, pp. 190–196. MIT Press, Cambridge (1996)
Cooper, L.N.: Hybrid Neural Network Architectures: Equilibrium Systems that Pay Attention. In: Mamone, R.J., Zeevi, Y.Y. (eds.) Neural Network: Theory and Applications, pp. 81–96. Acaddem ic Press, New York (1991)
Liu, Y., Yao, X.: Simultaneous Training of Negatively Correlated Neural Networks in An Ensemble. IEEE Transactions on Systems 29, 297–310 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ding, Y., Peng, X., Fu, X. (2009). The Research of Negative Correlation Learning Based on Artificial Neural Network. In: Yu, W., He, H., Zhang, N. (eds) Advances in Neural Networks – ISNN 2009. ISNN 2009. Lecture Notes in Computer Science, vol 5551. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-01507-6_90
Download citation
DOI: https://doi.org/10.1007/978-3-642-01507-6_90
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-01506-9
Online ISBN: 978-3-642-01507-6
eBook Packages: Computer ScienceComputer Science (R0)