Parameter selection of support vector machines and genetic algorithm based on change area search | Neural Computing and Applications Skip to main content

Advertisement

Log in

Parameter selection of support vector machines and genetic algorithm based on change area search

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Generalization performance of support vector machines (SVM) with Gaussian kernel is influenced by its model parameters, both the error penalty parameter and the Gaussian kernel parameter. After researching the characteristics and properties of the parameter simultaneous variation of support vector machines with Gaussian kernel by the parameter analysis table, a new area distribution model is proposed, which consists of optimal straight line, reference point of area boundary, optimal area, transition area, underfitting area, and overfitting area. In order to improve classification performance of support vector machines, a genetic algorithm based on change area search is proposed. Comparison experiments show that the test accuracy of the genetic algorithm based on change area search is better than that of the two-linear search method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Japan)

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Hsu C-W, Chang C-C, Lin C-J (2003) A practical guide to support vector classification. http://www.csie.ntu.edu.tw/~cjlin/papers/guide/guide.pdf

  2. Keerthi SS, Lin C-J (2003) Asymptotic behaviors of support vector machines with Gaussian kernel. Neural Comput 15(7):1667–1689

    Article  MATH  Google Scholar 

  3. Ding S, Liu X (2009) Evolutionary computing optimization for parameter determination and feature selection of support vector machines. In: Proceedings of the CISE 2009 on computational intelligence and software engineering, Wuhan, China, 1–5

  4. Huang C-L, Wang C-J (2006) A GA-based feature selection and parameters optimization for support vector machines. Expert Syst Appl 31(2):231–240

    Article  Google Scholar 

  5. Lin S-W, Ying K-C, Chen S-C, Lee Z-J (2008) Particle swarm optimization for parameter determination and feature selection of support vector machines. Expert Syst Appl 35:1817–1824

    Article  Google Scholar 

  6. Ren Y, Bai G (2010) Determination of optimal SVM parameters by using GA/PSO. J Comput 5(8):1160–1168

    Google Scholar 

  7. Huang H-L, Chang F-L (2007) ESVM: evolutionary support machine for automatic feature selection and classification of microarray data. Biosystems 90:516–528

    Article  Google Scholar 

  8. Li S, Wu X, Hu X (2008) Gene selection using genetic algorithm and support vectors machines. Soft Comput 12:693–698

    Article  Google Scholar 

  9. Debnath R, Kurita T (2010) An evolutionary approach for gene selection and classification of microarray data based on SVM error-bound theories. Biosystems 100(1):39–46

    Article  Google Scholar 

  10. Vapnik V (1998) Statistical learning theory. Wiley, New York

    MATH  Google Scholar 

  11. Rätsch G (1999) Benchmark data sets. http://ida.first.gmd.de/~raetsch/data/benchmarks.htm

  12. Murphy PM, Aha DW (1994) UCI repository of machine learning database. http://www.ics.uci.edu/~mlearn/MLRepository.html

  13. Chang C-C, Lin C-J (2001) LIBSVM: a library for support vector machines. http://www.csie.ntu.edu.tw/~cjlin/libsvm

  14. Chapelle O, Vapnik V, Bousquet O, Mukherjee S (2002) Choosing multiple parameters for support vector machines. Mach Learn 46:131–158

    Article  MATH  Google Scholar 

  15. Keerthi SS (2002) Efficient tuning or SVM hyperparameters using radius/margin bound and iterative algorithm. IEEE Trans Neural Netw 13(5):1225–1229

    Article  Google Scholar 

Download references

Acknowledgments

The work was supported partially by the National Science Foundation (NSF) of China under the contract number 60702075, and the Doctoral Research Foundation of the Ministry of Education of China under the contract number 20090185120009, and the Fundamental Research Funds for the Central Universities under Grant No. ZYGX2009J057.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mingyuan Zhao.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Zhao, M., Ren, J., Ji, L. et al. Parameter selection of support vector machines and genetic algorithm based on change area search. Neural Comput & Applic 21, 1–8 (2012). https://doi.org/10.1007/s00521-011-0603-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-011-0603-9

Keywords

Navigation