An Evolutionary Approximation for the Coefficients of Decision Functions within a Support Vector Machine Learning Strategy

  • Ruxandra Stoean
  • Mike Preuss
  • Catalin Stoean
  • Elia El-Darzi
  • D. Dumitrescu
Part of the Studies in Computational Intelligence book series (SCI, volume 201)

Abstract

Support vector machines represent a state-of-the-art paradigm, which has nevertheless been tackled by a number of other approaches in view of the development of a superior hybridized technique. It is also the proposal of present chapter to bring support vector machines together with evolutionary computation, with the aim to offer a simplified solving version for the central optimization problem of determining the equation of the hyperplane deriving from support vector learning. The evolutionary approach suggested in this chapter resolves the complexity of the optimizer, opens the ‘blackbox’ of support vector training and breaks the limits of the canonical solving component.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Bosch, R.A., Smith, J.A.: Separating hyperplanes and the authorship of the disputed federalist papers. American Mathematical Monthly 105, 601–608 (1998)MATHCrossRefMathSciNetGoogle Scholar
  2. 2.
    Vapnik, V.: The Nature of Statistical Learning Theory. Springer, Heidelberg (1995)MATHGoogle Scholar
  3. 3.
    Haykin, S.: Neural Networks: A Comprehensive Foundation. Prentice-Hall, New Jersey (1999)MATHGoogle Scholar
  4. 4.
    Cortes, C., Vapnik, V.: Support vector networks. Machine Learning 1, 273–297 (1995)Google Scholar
  5. 5.
    Mierswa, I.: Evolutionary learning with kernels: A generic solution for large margin problems. In: Proc. of the Genetic and Evolutionary Computation Conference, vol. 1, pp. 1553–1560 (2006)Google Scholar
  6. 6.
    Burges, C.J.C.: A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery 2, 121–167 (1998)CrossRefGoogle Scholar
  7. 7.
    Boser, B.E., Guyon, I.M., Vapnik, V.: A training algorithm for optimal margin classifiers. In: Proceedings of the 5th Annual ACM Workshop on Computational Learning Theory, vol. 1, pp. 11–152 (1992)Google Scholar
  8. 8.
    Courant, R., Hilbert, D.: Methods of Mathematical Physics. Wiley Interscience, Hoboken (1970)Google Scholar
  9. 9.
    Mercer, J.: Functions of positive and negative type and their connection with the theory of integral equations. Transactions of the London Philosophical Society (A) 209, 415–446 (1908)CrossRefGoogle Scholar
  10. 10.
    Hsu, C.-W., Lin, C.-J.: A comparison of methods for multi-class support vector machines. IEEE Transactions on Neural Networks 13, 415–425 (2004)Google Scholar
  11. 11.
    Platt, J.C., Cristianini, N., Shawe-Taylor, J.: Large margin dags for multiclass classification. In: Proc. of Neural Information Processing Systems, vol. 1, pp. 547–553 (2000)Google Scholar
  12. 12.
    Smola, A.J., Scholkopf, B.: A tutorial on support vector regression. Technical Report NC2-TR-1998-030. NeuroCOLT2 Technical Report Series (1998)Google Scholar
  13. 13.
    Rosipal, R.: Kernel-based Regression and Objective Nonlinear Measures to Access Brain Functioning. PhD thesis Applied Computational Intelligence Research Unit School of Information and Communications Technology University of Paisley, Scotland (2001)Google Scholar
  14. 14.
    Stoean, R.: Support vector machines. An evolutionary resembling approach. Universitaria Publishing House Craiova (2008)Google Scholar
  15. 15.
    Friedrichs, F., Igel, C.: Evolutionary tuning of multiple svm parameters. In: Proc. 12th European Symposium on Artificial Neural Networks, vol. 1, pp. 519–524 (2004)Google Scholar
  16. 16.
    Howley, T., Madden, M.G.: The genetic evolution of kernels for support vector machine classifiers. In: Proc. of 15th Irish Conference on Artificial Intelligence and Cognitive Science, vol. 1 (2004), http://www.it.nuigalway.ie/m_madden/profile/pubs.html
  17. 17.
    Jun, S.H., Oh, K.W.: An evolutionary statistical learning theory. International Journal of Computational Intelligence 3, 249–256 (2006)Google Scholar
  18. 18.
    Eiben, A.E., Smith, J.E.: Introduction to Evolutionary Computing. Springer, Heidelberg (2003)MATHGoogle Scholar
  19. 19.
    Stoean, R., Preuss, M., Stoean, C., Dumitrescu, D.: Concerning the potential of evolutionary support vector machines. In: Proc. of the IEEE Congress on Evolutionary Computation, vol. 1, pp. 1436–1443 (2007)Google Scholar
  20. 20.
    Stoean, R., Dumitrescu, D., Preuss, M., Stoean, C.: Different techniques of multi-class evolutionary support vector machines. In: Proc. of Bio-Inspired Computing: Theory and Applications, vol. 1, pp. 299–306 (2006)Google Scholar
  21. 21.
    Stoean, R., Stoean, C., Preuss, M., Dumitrescu, D.: Evolutionary multi-class support vector machines for classification. In: Proceedings of International Conference on Computers and Communications - ICCC 2006, Baile Felix Spa - Oradea, Romania, vol. 1, pp. 423–428 (2006)Google Scholar
  22. 22.
    Stoean, R., Dumitrescu, D., Stoean, C.: Nonlinear evolutionary support vector machines. application to classification. Studia Babes-Bolyai, Seria Informatica LI, 3–12 (2006)Google Scholar
  23. 23.
    Stoean, R., Dumitrescu, D.: Evolutionary linear separating hyperplanes within support vector machines. In: Scientific Bulletin, University of Pitesti. Mathematics and Computer Science Series, vol. 11, pp. 75–84 (2005)Google Scholar
  24. 24.
    Stoean, R., Dumitrescu, D.: Linear evolutionary support vector machines for separable training data. In: Annals of the University of Craiova. Mathematics and Computer Science Series, vol. 33, pp. 141–146 (2006)Google Scholar
  25. 25.
    Stoean, R., Preuss, M., Dumitrescu, D., Stoean, C.: ε - evolutionary support vector regression. In: Symbolic and Numeric Algorithms for Scientific Computing, SYNASC 2006, vol. 1, pp. 21–27 (2006)Google Scholar
  26. 26.
    Stoean, R., Preuss, M., Dumitrescu, D., Stoean, C.: Evolutionary support vector regression machines. In: IEEE Postproc. of the 8th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing, vol. 1, pp. 330–335 (2006)Google Scholar
  27. 27.
    Stoean, R.: An evolutionary support vector machines approach to regression. In: Proc. of 6th International Conference on Artificial Intelligence and Digital Communications, vol. 1, pp. 54–61 (2006)Google Scholar
  28. 28.
    Stoean, R., Stoean, C., Preuss, M., El-Darzi, E., Dumitrescu, D.: Evolutionary support vector machines for diabetes mellitus diagnosis. In: Proceedings of IEEE Intelligent Systems 2006, London, UK, vol. 1, pp. 182–187 (2006)Google Scholar
  29. 29.
    Stoean, R., Stoean, C., Preuss, M., Dumitrescu, D.: Evolutionary support vector machines for spam filtering. In: Proc. of RoEduNet IEEE International Conference, vol. 1, pp. 261–266 (2006)Google Scholar
  30. 30.
    Stoean, R., Stoean, C., Preuss, M., Dumitrescu, D.: Evolutionary detection of separating hyperplanes in e-mail classification. Acta Cibiniensis LV, 41–46 (2007)Google Scholar
  31. 31.
    Stoean, R., Stoean, C., Preuss, M., Dumitrescu, D.: Forecasting soybean diseases from symptoms by means of evolutionary support vector machines. Phytologia Balcanica 12 (2006)Google Scholar
  32. 32.
    Mierswa, I.: Making indefinite kernel learning practical, technical report. Technical report. Artificial Intelligence Unit, Department of Computer Science, University of Dortmund (2006)Google Scholar
  33. 33.
    Bartz-Beielstein, T.: Experimental research in evolutionary computation - the new experimentalism. Natural Computing Series. Springer, Heidelberg (2006)MATHGoogle Scholar
  34. 34.
    Perez-Cruz, F., Figueiras-Vidal, A.R., Artes-Rodriguez, A.: Double chunking for solving svms for very large datasets. In: Proceedings of Learning 2004, Elche, Spain, vol. 1 (2004), eprints.pascal-network.org/archive/00001184/01/learn04.pdf
  35. 35.
    DeJong, K.A.: An Analysis of the Behavior of a Class of Genetic Adaptive Systems. PhD thesis University of Michigan, Ann Arbor (1975)Google Scholar
  36. 36.
    Cristianini, N., Shawe-Taylor, J.: An Introduction to Support Vector Machines. Cambridge University Press, Cambridge (2000)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Ruxandra Stoean
    • 1
  • Mike Preuss
    • 2
  • Catalin Stoean
    • 1
  • Elia El-Darzi
    • 3
  • D. Dumitrescu
    • 4
  1. 1.Department of Computer ScienceUniversity of CraiovaRomania
  2. 2.Department of Computer ScienceUniversity of DortmundGermany
  3. 3.Department of Computer ScienceUniversity of WestminsterUK
  4. 4.Department of Computer ScienceUniversity of Cluj-NapocaRomania

Personalised recommendations