Can Evolutionary Computation Handle Large Datasets? A Study into Network Intrusion Detection | SpringerLink
Skip to main content

Can Evolutionary Computation Handle Large Datasets? A Study into Network Intrusion Detection

  • Conference paper
AI 2005: Advances in Artificial Intelligence (AI 2005)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 3809))

Included in the following conference series:

Abstract

XCS is currently considered as the state of the art Evolutionary Learning Classifier Systems (ELCS). XCS has not been tested on large datasets, particularly in the intrusion detection domain. This work investigates the performance of XCS on the 1999 KDD Cup intrusion detection dataset, a real world dataset approximately five million records, more than 40 fields and multiple classes with non-uniform distribution. We propose several modifications to XCS to improve its detection accuracy. The overall accuracy becomes equivalent to that of traditional machine learning algorithms, with the additional advantages of being evolutionary and with O(n) complexity learner.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Bacardit, J., Butz, M.V.: Data Mining in Learning Classifier Systems: Comparing XCS with GAssist. Illinois Genetic Algorithms Laboratory, University of Illinois at Urbana-Champaign, IlliGAL Report No. 2004030 (June 2004)

    Google Scholar 

  2. Bernadó, E., Llorà, X., Garrell, J.M.: XCS and GALE: a comparative study of two learning classifier systems with six other learning algorithms on classification tasks. In: Proceedings of the 4th International Workshop on Learning Classifier Systems (IWLCS 2001), pp. 337–341 (2001)

    Google Scholar 

  3. Dam, H.H., Shafi, K., Abbass, H.A.: Can evolutionary computation handle large dataset? Technical Report TR-ALAR-2005070001 (2005), http://seal.tst.adfa.edu.au/~alar/techrep.html

  4. Dixon, P.W., Corne, D., Oates, M.J.: A preliminary investigation of modified XCS as a generic data mining tool. In: Advances in Learning Classifier Systems: 4th International Workshop, IWLCS, pp. 133–150. Springer, Heidelberg (2001)

    Google Scholar 

  5. Hettich, S., Bay, S.D.: The uci kdd archive (1999), http://kdd.ics.uci.edu/databases/kddcup99/kddcup99.html

  6. Holland, J.H.: Escaping Brittleness: The Possibilities of General-Purpose Learning Algorithms Applied to Parallel Rule-Based Systems. In: Mitchell, Michalski, Carbonell (eds.) Machine Learning, an Artificial Intelligence Approach, vol. II, ch. 20, pp. 593–623. Morgan Kaufmann, San Francisco (1986)

    Google Scholar 

  7. Saxon, S., Barry, A.: XCS and the Monk’s problems. In: Learning Classifier Systems, From Foundations to Applications, London, UK, pp. 223–242. Springer, Heidelberg (2000)

    Chapter  Google Scholar 

  8. Wilson, S.W.: Classifier fitness based on accuracy. Evolutionary Computation 3(2), 149–175 (1995)

    Article  Google Scholar 

  9. Wilson, S.W.: Generalization in the XCS classifier system. In: Genetic Programming 1998: Proceedings of the Third Annual Conference, University of Wisconsin, Madison, Wisconsin, USA, pp. 665–674. Morgan Kaufmann, San Francisco (1998)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Dam, H.H., Shafi, K., Abbass, H.A. (2005). Can Evolutionary Computation Handle Large Datasets? A Study into Network Intrusion Detection. In: Zhang, S., Jarvis, R. (eds) AI 2005: Advances in Artificial Intelligence. AI 2005. Lecture Notes in Computer Science(), vol 3809. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11589990_146

Download citation

  • DOI: https://doi.org/10.1007/11589990_146

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-30462-3

  • Online ISBN: 978-3-540-31652-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics