Abstract
In this paper we investigate the properties of novel systems for handwritten character recognition which are based on input space transformations to exploit the advantages of multiple classifier structures. These systems provide an effective solution to the problem of utilising the power of n-tuple based classifiers while, simultaneously, addressing successfully the issues of the trade-off between the memory requirements and the accuracy achieved. Utilizing the flexibility offered by multi-classifier schemes we can subsequently exploit this complementarity of different transformations of the original feature space while at the same time decompose it to simpler input spaces, thus reducing the resources requirements of the sn-tuple classifiers used. Our analysis of the observed behaviour based on Mutual Information estimators between the original and the transformed input spaces showed a direct correspondence of the values of this information measure and the accuracy obtained. This suggests Mutual Information as a useful tool for the analysis and design of multi-classifier systems. The paper concludes with a number of comparisons with results on the same data set achieved by a diverse set of classifiers. Our findings clearly demonstrate the significant gains that can be obtained, simultaneously in performance and memory space reduction, by the proposed systems.
The authors gratefully acknowledge the support of the EPSRC, UK.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
L. Breiman. Bagging predictors. Machine Learning, 24(2):123–140, 1996.
M. C. Fairhurst and M. S. Hoque. Moving window classifier: Approach to off-line image recognition. Electronics Letters, 36(7):628–630, March 2000.
M. C. Fairhurst and H. M. S. Abdel Whab. An approach to performance optimisation in frequency-weighted memory network pattern classifiers. Electronics Letters, 23:1116–1118, 1987.
H. Freeman. Computer processing of line-drawing images. ACM Computing Surveys, 6(1):57–98, March 1974.
Y. Freund and R.E. Schapire. Experiments with a new boosting algorithm. In Machine Learning: Proceedings of the 13th Int. Conference, pages 148–156, 1996.
T. K. Ho. The random subspace method for constructing decision forests. IEEE Trans Pattern Analysis and Machine Intelligence, 20(8):832–844, 1998.
M. S. Hoque and M. C. Fairhurst. Face recognition using the moving window classifier. In Proceedings of the 11th British Machine Vision Conference (BMVC2000), volume 1, pages 312–321, Bristol, UK., September 2000.
S. Hoque, K. Sirlantzis, and M. C. Fairhurst. Bit plane decomposition and the scanning n-tuple classifier. In Proc. of 8th Intl. Workshop on Frontiers in Handwriting Recognition, pages 207–211, NOTL, Ontario, Canada, 6–8 August 2002.
S. Hoque, K. Sirlantzis, and M. C. Fairhurst. Intelligent chain-code quantization for multiple classifier-based shape recognition. In John A. Bullinaria, editor, Proc. of the 2002 U.K. Workshop on Computational Intelligence (UKCI-02), pages 61–67, Birmingham, UK, September 2002.
A. K. Jain, J. Mao, and K. M. Mohiuddin. Artificial neural networks: A tutorial. Computer, pages 31–44, March 1996.
Digital Systems Research Group (DSRG), Department of Electronics, University of Kent, Canterbury CT2 7NT, United Kingdom.
J. Kittler, M. Hatef, R. P. Duin, and J. Matas. On combining classifiers. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(3):226–239, 1998.
S. Lucas and A. Amiri. Statistical syntactic methods for high performance ocr. IEE Proceedings Vision, Image and Signal Processing, 143(1):23–30, February 1996.
D. Michie, D. J. Spiegelhalter, and C. C. Taylor, editors. Machine Learning, Neural and Statistical Classification. Ellis Horwood, New York, 1994.
R. Schalkoff. Pattern Recognition: Statistical, Structural and Neural Approaches. John Wiley and Sons, New York, 1992.
K. Sirlantzis, M. C. Fairhurst, and M. S. Hoque. Genetic algorithms for multi-classifier system configuration: A case study in character recognition. In J. Kittler and F. Roli, editors, Multiple Clasifier Systems, pages 99–108. Springer, 2001.
K. Sirlantzis, S. Hoque, and M. C. Fairhurst. Classifier diversity estimation in a multiclassifier recognition system based on binary feature quantization. In Proceedings of 4th International Conference on Recent Advances in Soft Computing (RASC 2002), pages 97–101, Nottingham, UK., 12–13 December 2002.
K. Torkkola. Nonlinear feature transforms using maximum mutual information. In Proceedings of the International Joint Conference on Neural Networks (IJCNN’01), pages 2756–2761, Washington D.C., USA., 15–19 July 2001.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sirlantzis, K., Hoque, S., Fairhurst, M.C. (2003). Input Space Transformations for Multi-classifier Systems Based on n-tuple Classifiers with Application to Handwriting Recognition. In: Windeatt, T., Roli, F. (eds) Multiple Classifier Systems. MCS 2003. Lecture Notes in Computer Science, vol 2709. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44938-8_36
Download citation
DOI: https://doi.org/10.1007/3-540-44938-8_36
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-40369-2
Online ISBN: 978-3-540-44938-6
eBook Packages: Springer Book Archive