Parsimonious Feature Extraction Based on Genetic Algorithms and Support Vector Machines | SpringerLink
Skip to main content
Springer Nature Link
Log in

Parsimonious Feature Extraction Based on Genetic Algorithms and Support Vector Machines

  • Conference paper
Advances in Neural Networks - ISNN 2006 (ISNN 2006)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 3971))

Included in the following conference series:

  • 96 Accesses

Abstract

Most existing feature extraction algorithms aim at best preserving information in the original data or at improving the separability of data, but fail to consider the possibility of further reducing the number of used features. In this paper, we propose a parsimonious feature extraction algorithm. Its motivation is using as few features as possible to achieve the same or even better classification performance. It searches for the optimal features using a genetic algorithm and evaluates the features referring to Support Vector Machines. We tested the proposed algorithm by face recognition on the Yale and FERET databases. The experimental results proved its effectiveness and demonstrated that parsimoniousness should be a significant factor in developing efficient feature extraction algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Jolliffe, I.T.: Principle Component Analysis, 2nd edn. Springer, New York (2002)

    Google Scholar 

  2. Fukunaga, K.: Introduction to Statistical Pattern Recognition, 2nd edn. Academic Press, Inc., London (1990)

    MATH  Google Scholar 

  3. Turk, M., Pentland, A.: Eigenfaces for Recognition. J. Cognitive Neuroscience 13(1), 71–86 (1991)

    Article  Google Scholar 

  4. Belhumeur, P.N., HesPanha, J.P., Kriegman, D.J.: Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection. IEEE Trans. PAMI 19(7), 711–720 (1997)

    Google Scholar 

  5. Liu, C., Wechsler, H.: Evolutionary Pursuit and Its Application to Face Recognition. IEEE Trans. PAMI 22(6), 570–582 (2000)

    Google Scholar 

  6. Goldberg, D.: Genetic Algorithms in Search, Optimization, and Machine Learning. Addison-Wesley, Reading (1989)

    MATH  Google Scholar 

  7. Zheng, W., Lai, J., Yuen, P.C.: GA-Fisher: A New LDA-Based Face Recognition Algorithm With Selection of Principal Components. IEEE Trans. Systems, Man, and Cybernetics - Part B: Cybernetics 35(5), 1065–1078 (2005)

    Article  Google Scholar 

  8. Vapnik, V.: The Nature of Statistical Learning Theory. Springer, New York (1995)

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai, 200030, China

    Qijun Zhao & Hongtao Lu

  2. Department of Computing, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong

    David Zhang

Authors
  1. Qijun Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hongtao Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. David Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Mechanical and Automation Engineering, The Chinese University of Hong Kong, Shatin, New Territories, Hong Kong, China

    Jun Wang

  2. Computational Intelligence Laboratory, School of Computer Science and Engineering, University of Electronic Science and Technology of China, 610054, Chengdu, P.R. China

    Zhang Yi

  3. Department of Electrical Engineering, University of Louisville, 40292, Louisville, KY, U.S.A

    Jacek M. Zurada

  4. Laboratory for Computational Biology, Shanghai Center for Systems Biomedicine, 800 Dong Chuan Rd., 200240, Shanghai, China

    Bao-Liang Lu

  5. School of Electrical and Electronic Engineering, University of Manchester, UK

    Hujun Yin

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Zhao, Q., Lu, H., Zhang, D. (2006). Parsimonious Feature Extraction Based on Genetic Algorithms and Support Vector Machines. In: Wang, J., Yi, Z., Zurada, J.M., Lu, BL., Yin, H. (eds) Advances in Neural Networks - ISNN 2006. ISNN 2006. Lecture Notes in Computer Science, vol 3971. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11759966_206

Download citation

  • DOI: https://doi.org/10.1007/11759966_206

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-34439-1

  • Online ISBN: 978-3-540-34440-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics