Abstract
This study demonstrates a system and methods for optimizing a pattern classification task. A genetic algorithm method was employed to optimize a Fuzzy ARTMAP pattern classification task, followed by another genetic algorithm to assemble an ensemble of classifiers. Two parallel tracks were performed in order to assess a diversity-enhanced classifier and ensemble optimization methodology in comparison with a more straightforward method that does not rely on diverse classifiers and ensembles. Ensembles designed with diverse classifiers outperformed diversity-neutral classifiers in 62.50% of the tested cases. Using a negative correlation method to manipulate inter-classifier diversity, diverse ensembles performed better than non-diverse ensembles in 81.25% of the tested cases.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Ruta, D., Gabrys, B.: Application of the Evolutionary Algorithms for Classifier Selection in Multiple Classifier Systems with Majority Voting. In: Kittler, J., Roli, F. (eds.) MCS 2001. LNCS, vol. 2096, pp. 399–408. Springer, Heidelberg (2001)
Zhou, Z.H., Wu, J.X., Jiang, Y., Chen, S.F.: Genetic Algorithm based Selective Neural Network Ensemble. In: 17th Int. Conf. on Artificial Intelligence, pp. 797–802. Morgan Kaufmann Publishers (2001)
Kuncheva, L.I., Whitaker, C.J.: Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy. Machine Learning 51(2), 181–207 (2003)
Lofstrom, T., Johansson, U., Bostrom, H.: Comparing Methods for Generating Diverse Ensembles of Artificial Neural Networks. In: 2010 IEEE Int. Conf. on Neural Networks, pp. 1–6. IEEE (2010)
Carpenter, G.A., Grossberg, S., Marzukon, N., Reynolds, J.H., Rosen, D.B.: Fuzzy ARTMAP: A Neural Network Architecture for Incremental Supervised Learning of Analog Multidimensional Maps. IEEE Trans. on Neural Networks 3(5), 698–713 (1992)
Carpenter, G.A., Grossberg, S.: Adaptive Resonance Theory. CAS/CNS Technical Report Series 008 (2010)
Lee, H., Kim, E., Pedrycz, W.: A New Selective Neural Network Ensemble with Negative Correlation. Applied Intelligence, 1–11 (2012)
Liu, Y., Yao, X., Higuchi, T.: Evolutionary Ensembles with Negative Correlation Learning. IEEE Trans. on Evolutionary Computation 4(4), 380–387 (2000)
Lin, X., Yacoub, S., Burns, J., Simske, S.: Performance Analysis of Pattern Classifier Combination by Plurality Voting. Pattern Recognition Letters 24(12), 1959–1969 (2003)
Loo, C.K., Rao, M.V.C.: Accurate and Reliable Diagnosis and Classification Using Probabilistic Ensemble Simplified Fuzzy ARTMAP. IEEE Trans. on Knowledge and Data Engineering 17(11), 1589–1593 (2005)
UCI Machine Learning Repository, http://archive.ics.uci.edu/ml
Cantú-Paz, E.: A survey of parallel genetic algorithms. Calculateurs Paralleles, Reseaux et Systems Repartis 10(2), 141–171 (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Loo, C.K., Liew, W.S., Lim, E. (2013). Optimizing Fuzzy ARTMAP Ensembles Using Hierarchical Parallel Genetic Algorithms and Negative Correlation. In: Guo, C., Hou, ZG., Zeng, Z. (eds) Advances in Neural Networks – ISNN 2013. ISNN 2013. Lecture Notes in Computer Science, vol 7951. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-39065-4_49
Download citation
DOI: https://doi.org/10.1007/978-3-642-39065-4_49
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-39064-7
Online ISBN: 978-3-642-39065-4
eBook Packages: Computer ScienceComputer Science (R0)