Artificial Intelligence Review

, Volume 24, Issue 3–4, pp 379–395 | Cite as

The Genetic Kernel Support Vector Machine: Description and Evaluation

Article

Abstract

The Support Vector Machine (SVM) has emerged in recent years as a popular approach to the classification of data. One problem that faces the user of an SVM is how to choose a kernel and the specific parameters for that kernel. Applications of an SVM therefore require a search for the optimum settings for a particular problem. This paper proposes a classification technique, which we call the Genetic Kernel SVM (GK SVM), that uses Genetic Programming to evolve a kernel for a SVM classifier. Results of initial experiments with the proposed technique are presented. These results are compared with those of a standard SVM classifier using the Polynomial, RBF and Sigmoid kernel with various parameter settings

Keywords

classification genetic Kernel SVM genetic programming Mercer Kernel model selection support vector machine 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bahlmann C., Haasdonk B., Burkhardt H. (2002). On-line Handwriting Recognition with Support Vector Machines – A Kernel Approach. In Proceedings of the 8th International Workshop on Frontiers in Handwriting Recognition, 49–54Google Scholar
  2. Banzhaf W., Nordin P., Keller R., Francone F. (1998). Genetic Programming – An Introduction. Morgan KaufmannGoogle Scholar
  3. Blake C., Merz C. (1998). UCI Repository of machine learning databases, http://www.ics.uci.edu/~ mlearn/MLRepository.html. University of California, Irvine, Department of Information and Computer SciencesGoogle Scholar
  4. Bleckmann A., Meiler J. (2003). Epothilones: Quantitative Structure Activity Relations Studied by Support Vector Machines and Artificial Neural Networks. QSAR & Combinatorial Science 22:722–728CrossRefGoogle Scholar
  5. Boser B., Guyon I., Vapnik V. (1992a). A Training Algorithm for Optimal Margin Classifiers. In Haussler, D. (ed.) Proceedings of the 5th Annual ACM Workshop on Computational Learning Theory, 144–152, ACM PressGoogle Scholar
  6. Boser B., Guyon I., Vapnik V. (1992b). A Training Algorithm for Optimal Margin Classifiers. In Haussler, D. (ed.) Proceedings of the 5th Annual ACM Workshop on Computational Learning Theory, 144–152, ACM Press.Google Scholar
  7. Cristianini N., Campbell C., Shawe-Taylor J. (1998). Dynamically Adapting Kernels in Support Vector Machines. Technical Report NC2-TR-1998-017, NeuroCOLT2Google Scholar
  8. Cristianini N., Shawe-Taylor J. (2000). An Introduction to Support Vector Machines. Cambridge University PressGoogle Scholar
  9. Eads D., Hill D., Davis S., Perkins S., Ma J., Porter R., Theiler J. (2002). Genetic Algorithms and Support Vector Machines for Times Series Classification. In Proceedings of the Fifth Conference on the Applications and Science of Neural Networks, Fuzzy Systems, and Evolutionary Computation. Symposium on Optical Science and Technology of the 2002 SPIE Annual Meeting, 74–85Google Scholar
  10. Friedrichs F., Igel C. (2004). Evolutionary Tuning of Multiple SVM Parameters. In Proceedings of the 12th European Symposium on Artificial Neural Network, 519–524Google Scholar
  11. Frolich H., Chapelle O., Scholkopf B. (2003). Feature Selection for Support Vector Machines by Means of Genetic Algorithms. In Proceedings of the International IEEE Conference on Tools with AI, 142–148Google Scholar
  12. Hastie T., Tibshirani R., Friedman J. (2001). The Elements of Statistical Learning. SpringerGoogle Scholar
  13. Hearst M. (1998). Using SVMs for Text Categorisation. IEEE Intelligent Systems 13(4):18–28CrossRefGoogle Scholar
  14. Hennessy K., Madden M., Conroy J., Ryder A. (2005). An Improved Genetic Programming Technique for the Classification of Raman Spectra. Knowledge Based Systems Google Scholar
  15. Hsu C., Chang C., Lin C. (2003). A Practical Guide to Support Vector Classification, http://www.csie.ntu.edu.tw/cjlin/guide/guide.pdf. Department of Computer Science and Information Engineering, National Taiwan UniversityGoogle Scholar
  16. Joachims T. (1998). Text categorisation with support vector machines. In Proceedings of European Conference on Machine Learning (ECML) Google Scholar
  17. Koza J. (1992) Genetic Programming. MIT PressGoogle Scholar
  18. Lin H., Lin C. (2003). A Study on Sigmoid Kernels for SVM and the Training of non-PSD Kernels by SMO-type Methods. Technical report, Department of Computer Science and Information Engineering, National Taiwan UniversityGoogle Scholar
  19. Lodhi H., Saunders C., Shawe-Taylor J., Cristianini N., Watkins C. (2002). Text Classification Using String Kernels. Journal of Machine Learning Research 2:419–444CrossRefMATHGoogle Scholar
  20. Osuna E., Freund R., Girosi F. (1997). Training Support Vector Machines: An Application to Face Detection. In Proceedings of Computer Vision and Pattern Recognition, 130–136Google Scholar
  21. Platt J. (1999). Using Analytic QP and Sparseness to Speed Training of Support Vector Machines. In Proceedings of Neural Information Processing Systems (NIPS), 557–563Google Scholar
  22. Runarsson T., Sigurdsson S. (2004). Asynchronous Parallel Evolutionary Model Selection for Support Vector Machines. Neural Information Processing – Letters and Reviews 3:59–67Google Scholar
  23. Russell S., Norvig P. (2003). Artificial Intelligence A Modern Approach. Prentice-HallGoogle Scholar
  24. Scholkopf B. (1998). Support Vector Machines – A Practical Consequence of Learning Theory. IEEE Intelligent Systems 13(4):18–28CrossRefGoogle Scholar
  25. Scholkopf B. (2000). Statistical Learning and Kernel Methods. Technical Report MSR-TR-2000–23, Microsoft Research, Microsoft CorporationGoogle Scholar
  26. Staelin C. (2002). Parameter selection for support vector machines. Technical Report HPL-2002-354, HP Laboratories, IsraelGoogle Scholar
  27. Whitley D. (2001). An Overview of Evolutionary Algorithms: Practical Issues and Common Pitfalls. Information and Software Technology 43(14):817–831CrossRefGoogle Scholar

Copyright information

© Springer 2005

Authors and Affiliations

  1. 1.Department of Information TechnologyNational University of IrelandGalwayIreland

Personalised recommendations