Genetically Constructed Kernels for Support Vector Machines

  • Stefan Lessmann
  • Robert Stahlbock
  • Sven Crone
Conference paper
Part of the Operations Research Proceedings book series (ORP, volume 2005)


Data mining for customer relationship management involves the task of binary classification, e.g. to distinguish between customers who are likely to respond to direct mail and those who are not. The support vector machine (SVM) is a powerful learning technique for this kind of problem. To obtain good classification results the selection of an appropriate kernel function is crucial for SVM. Recently, the evolutionary construction of kernels by means of meta-heuristics has been proposed to automate model selection. In this paper we consider genetic algorithms (GA) to generate SVM kernels in a data driven manner and investigate the potential of such hybrid algorithms with regard to classification accuracy, generalisation ability of the resulting classifier and computational efficiency. We contribute to the literature by: (1) extending current approaches for evolutionary constructed kernels; (2) investigating their adequacy in a real world business scenario; (3) considering runtime issues together with measures of classification effectiveness in a mutual framework.


Support Vector Machine Customer Relationship Management Direct Marketing Support Vector Machine Parameter Bayesian Neural Network 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    Baesens B, Viaene S, Van den Poel D, Vanthienen J, Dedene G (2002) Bayesian neural network learning for repeat purchase modelling in direct marketing. European Journal of Operational Research 138(1):191–211CrossRefzbMATHGoogle Scholar
  2. [2]
    Berry MJA, Linoff G (2004) Data mining techniques: for marketing, sales and customer relationship management, 2. edn. Wiley, New YorkGoogle Scholar
  3. [3]
    Cristianini N, Shawe-Taylor J (2000) An introduction to support vector machines and other kernel-based learning methods. Cambridge University Press, CambridgeGoogle Scholar
  4. [4]
    Goldberg DE (1989) Genetic Algorithms in Search, Optimization and Machine Learning. Addison-Wesley, ReadingzbMATHGoogle Scholar
  5. [5]
    Keerthi SS, Lin C-J (2003) Asymptotic Behaviours of Support Vector Machines with Gaussian Kernel. Neural Computation 15(7):1667–1689PubMedCrossRefzbMATHGoogle Scholar
  6. [6]
    Kubat M, Holte RC, Matwin S (1998) Machine Learning for the Detection of Oil Spills in Satellite Radar Images. Machine Learning 30(2–3):195–215CrossRefGoogle Scholar
  7. [7]
    Nguyen H-N, Ohn S-Y, Choi W-J (2004) Combined Kernel Function for Support Vector Machine and Learning Method Based on Evolutionary Algorithm. In: Pal NR, Kasabov N, Mudi RK (eds) Proc. of the 11th Intern. Conf. on Neural Information Processing, Calcutta, India, pp 1273–1278Google Scholar
  8. [8]
    Stahlbock R (2002) Evolutionäre Entwicklung künstlicher neuronaler Netze zur Lösung betriebswirtschaftlicher Klassifikationsprobleme. WiKu, BerlinGoogle Scholar
  9. [9]
    Vapnik VN (1995) The Nature of Statistical Learning Theory. Springer, New YorkzbMATHGoogle Scholar
  10. [10]
    Viaene S, Baesens B, Van Gestel T, Suykens JAK, Van den Poel D, Vanthienen J, De Moor B, Dedene G (2001) Knowledge discovery in a direct marketing case using least squares support vector machines. International Journal of Intelligent Systems 16(9):1023–1036CrossRefzbMATHGoogle Scholar
  11. [11]
    Weiss GM (2004) Mining with rarity: a unifying framework. ACM SIGKDD Explorations Newsletter 6(1):7–19Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Stefan Lessmann
    • 1
  • Robert Stahlbock
    • 1
  • Sven Crone
    • 2
  1. 1.Inst. of Information SystemsUniversity of HamburgHamburgGermany
  2. 2.Dept. of Management ScienceLancaster University Management SchoolLancasterUK

Personalised recommendations