Optimizing Weighted Kernel Function for Support Vector Machine by Genetic Algorithm

  • Ha-Nam Nguyen
  • Syng-Yup Ohn
  • Soo-Hoan Chae
  • Dong Ho Song
  • Inbok Lee
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4293)


The problem of determining optimal decision model is a difficult combinatorial task in the fields of pattern classification, machine learning, and especially bioinformatics. Recently, support vector machine (SVM) has shown a better performance than conventional learning methods in many applications. This paper proposes a weighted kernel function for support vector machine and its learning method with a fast convergence and a good classification performance. We defined the weighted kernel function as the weighted sum of a set of different types of basis kernel functions such as neural, radial, and polynomial kernels, which are trained by a learning method based on genetic algorithm. The weights of basis kernel functions in proposed kernel are determined in learning phase and used as the parameters in the decision model in classification phase. The experiments on several clinical datasets such as colon cancer, leukemia cancer, and lung cancer datasets indicate that our weighted kernel function results in higher and more stable classification performance than other kernel functions. Our method also has comparable and sometimes better classification performance than other classification methods for certain applications.


Genetic Algorithm Support Vector Machine Kernel Function Malignant Pleural Mesothelioma Weighted Kernel 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Cristianini, N., Shawe-Taylor, J.: An introduction to Support Vector Machines and other kernel-based learning methods, Cambridge (2000)Google Scholar
  2. 2.
    Vapnik, V.N., et al.: Theory of Support Vector Machines, Technical Report CSD TR-96-17, Univ. of London (1996)Google Scholar
  3. 3.
    Kecman, V.: Learning and Soft Computing: Support Vector Machines. Neural Networks, and Fuzzy Logic Models (Complex Adaptive Systems), The MIT press (2001)Google Scholar
  4. 4.
    Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification, 2nd edn. John Wiley & Sons, Chichester (2001)MATHGoogle Scholar
  5. 5.
    Joachims, T.: Making large-Scale SVM Learning Practical, ch. 11. In: Advances in Kernel Methods - Support Vector Learning, MIT Press, Cambridge (1999)Google Scholar
  6. 6.
    Schökopf, B., Smola, A.J.: Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond (Adaptive Computation and Machine Learning). MIT Press, Cambridge (2002)Google Scholar
  7. 7.
    Minsky, M.L., Papert, S.A.: Perceptrons. MIT Press, Cambridge (1969)MATHGoogle Scholar
  8. 8.
    Michalewicz, Z.: Genetic Algorithms + Data structures = Evolution Programs, 3 re rev. and extended ed. Springer, Heidelberg (1996)Google Scholar
  9. 9.
    Goldberg, D.E.: Genetic Algorithms in Search, Optimization & Machine Learning. Addison-Wesley, Reading (1989)MATHGoogle Scholar
  10. 10.
    Mitchell, M.: Introduction to genetic Algorithms, fifth printing. MIT press, Cambridge (1999)Google Scholar
  11. 11.
    Alon, U., Barkai, N., Notterman, D., Gish, K., Ybarra, S., Mack, D., Levine, A.: Broad Patterns of Gene Expression Revealed by Clustering Analysis of Tumor and Normal Colon Tissues Probed by Oligonucleotide Arrays. Proceedings of National Academy of Sciences of the United States of American 96, 6745–6750 (1999)CrossRefGoogle Scholar
  12. 12.
    Golub, T.R., Slonim, D.K., Tamayo, P., Huard, C., Gaasenbeek, M., Mesirov, J.P., Coller, H., Loh, M.L., Downing, J.R., Caligiuri, M.A., Bloomfield, C.D., Lander, E.S.: Molecular Classification of Cancer: Class Discovery and Class Prediction by Gene Expression Monitoring. Science 286, 531–537 (1999)CrossRefGoogle Scholar
  13. 13.
    Fröhlich, H., Chapelle, O., Scholkopf, B.: Feature selection for support vector machines by means of genetic algorithm, Tools with Artificial Intelligence. In: Proceedings 15th IEEE International Conference, pp. 142–148 (2003)Google Scholar
  14. 14.
    Chen, X.-w.: Gene selection for cancer classification using bootstrapped genetic algorithms and support vector machines. In: The Computational Systems, Bioinformatics Conference, Proceedings IEEE International Conference, pp. 504–505 (2003)Google Scholar
  15. 15.
    Park, C., Cho, S.-B.: Genetic search for optimal ensemble of feature-classifier pairs in DNA gene expression profiles. In: Neural Networks, Proceedings of the International Joint Conference, vol. 3, pp. 1702–1707 (2003)Google Scholar
  16. 16.
    Rüping, S.: mySVM-Manual, University of Dortmund, Lehrstuhl Informatik (2000), online available: http://www-ai.cs.uni-dortmund.de/SOFTWARE/MYSVM
  17. 17.
    Kohavi, R., John, G.H.: Wrappers for Feature Subset Selection. Artificial Intelligence, 273–324 (1997)Google Scholar
  18. 18.
    Blum, A.L., Langley, P.: Selection of Relevant Features and Examples in Machine Learning. Artificial Intelligence, 245–271 (1997)Google Scholar
  19. 19.
    Michell, T.M.: Machine Learning. McGraw-Hill, New York (1997)Google Scholar
  20. 20.
    Liu, C.-C., Chen, W.-S.E., Lin, C.-C., Liu, H.-C., Chen, H.-Y., Yang, P.-C., Chang, P.-C., Chen, J.J.W.: Topology-based cancer classification and related pathway mining using microarray data. Nucleic Acids Res., gkl583v1 (August 16, 2006)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Ha-Nam Nguyen
    • 1
  • Syng-Yup Ohn
    • 1
  • Soo-Hoan Chae
    • 1
  • Dong Ho Song
    • 1
  • Inbok Lee
    • 1
  1. 1.Department of Computer and Information EngineeringHankuk Aviation UniversitySeoulKorea

Personalised recommendations