Multi-class Cancer Classification with OVR-Support Vector Machines Selected by Naïve Bayes Classifier

  • Jin-Hyuk Hong
  • Sung-Bae Cho
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4234)


Support vector machines (SVMs), originally designed for binary classification, have been applied for multi-class classification, where an effective fusion scheme is required for combining outputs from them and producing a final result. In this work, we propose a novel method in which the SVMs are generated with the one-vs-rest (OVR) scheme and dynamically organized by the naïve Bayes classifiers (NBs). This method might break the ties that frequently occur when working with multi-class classification systems with OVR SVMs. More specifically, we use the Pearson correlation measure to select informative genes and reduce the dimensionality of gene expression profiles when constructing the NBs. The proposed method has been validated on GCM cancer dataset consisting of 14 types of tumors with 16,063 gene expression levels and produced higher accuracy than other methods.


Support Vector Machine Feature Selection Method Informative Gene Multiclass Classification Hybrid Classifier 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bredensteiner, E., Bennett, K.: Multicategory classification by support vector machines. Computational Optimization and Applications 12(1), 53–79 (1999)CrossRefMATHMathSciNetGoogle Scholar
  2. 2.
    Crammer, K., Singer, Y.: On the learnability and design of output codes for multiclass problems. Machine Learning 47(2-3), 201–233 (2002)CrossRefMATHGoogle Scholar
  3. 3.
    Hsu, C., Lin, C.: A comparison of methods for multiclass support vector machines. IEEE Trans. Neural Networks 13(2), 415 (2002)CrossRefGoogle Scholar
  4. 4.
    Angulo, C., et al.: K-SVCR. A support vector machine for multi-class classification. Neurocomputing 55(1-2), 57–77 (2003)CrossRefGoogle Scholar
  5. 5.
    Sebald, D., Bucklew, J.: Support vector machines and the multiple hypothesis test problem. IEEE Trans. Signal Processing 49(11), 2865–2872 (2001)CrossRefGoogle Scholar
  6. 6.
    Gestel, T., et al.: Multiclass LS-SVMs: Moderated outputs and coding-decoding schemes. Neural Processing Letters 15(1), 45–58 (2002)CrossRefMATHGoogle Scholar
  7. 7.
    Lee, Y., Lee, C.: Classification of multiple cancer types by multicategory support vector machines using gene expression data. Bioinformatics 19(9), 1132–1139 (2003)CrossRefGoogle Scholar
  8. 8.
    Ramaswamy, S., et al.: Multiclass cancer diagnosis using tumor gene expression signatures. Proc. National Academy of Science 98(26), 15149–15154 (2001)CrossRefGoogle Scholar
  9. 9.
    Cho, S.-B., Ryu, J.: Classifying gene expression data of cancer using classifier ensemble with mutually exclusive features. Proc. of the IEEE 90(11), 1744–1753 (2002)CrossRefGoogle Scholar
  10. 10.
    Inza, I., et al.: Feature subset selection by genetic algorithm and estimation of distribution algorithms. A case study in the survival of cirrhotic patients treated with TIPS. Artificial Intelligence in Medicine 23(2), 187–205 (2001)CrossRefGoogle Scholar
  11. 11.
    Kuncheva, L.: A theoretical study on six classifier fusion strategies. IEEE Trans. Pattern Analysis and Machine Intelligence 24(2), 281–286 (2002)CrossRefGoogle Scholar
  12. 12.
    Brooks, R.: A robust layered control system for a mobile robot. IEEE J. of Robotics and Automation 2(1), 14–23 (1986)CrossRefGoogle Scholar
  13. 13.
    Li, T., et al.: A comparative study of feature selection and multiclass classification methods for tissue classification based on gene expression. Bioinformatics 20(15), 2429–2437 (2004)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Jin-Hyuk Hong
    • 1
  • Sung-Bae Cho
    • 1
  1. 1.Dept. of Computer ScienceYonsei UniversitySeoulKorea

Personalised recommendations