Journal of Combinatorial Optimization

, Volume 17, Issue 1, pp 3–20 | Cite as

Selective support vector machines

  • Onur Seref
  • O. Erhun Kundakcioglu
  • Oleg A. Prokopyev
  • Panos M. Pardalos


In this study we introduce a generalized support vector classification problem: Let X i , i=1,…,n be mutually exclusive sets of pattern vectors such that all pattern vectors x i,k , k=1,…,|X i | have the same class label y i . Select only one pattern vector \(x_{i,k^{*}}\) from each set X i such that the margin between the set of selected positive and negative pattern vectors are maximized. This problem is formulated as a quadratic mixed 0-1 programming problem, which is a generalization of the standard support vector classifiers. The quadratic mixed 0-1 formulation is shown to be \(\mathcal{NP}\) -hard. An alternative approach is proposed with the free slack concept. Primal and dual formulations are introduced for linear and nonlinear classification. These formulations provide flexibility to the separating hyperplane to identify the pattern vectors with large margin. Iterative elimination and direct selection methods are developed to select such pattern vectors using the alternative formulations. These methods are compared with a naïve method on simulated data. The iterative elimination method is also applied to neural data from a visuomotor categorical discrimination task to classify highly cognitive brain activities.


Classification Support vector machines Quadratic mixed 0-1 programming 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Bennet K, Campbell C (2000) Support vector machines: Hype or hallelujah? SIGKDD Explorations, 2(2):1–13 CrossRefGoogle Scholar
  2. Brown M, Grundy W, Lin D, Cristianini N, Sugne C, Furey T, Ares M, Haussler D (2000) Knowledge-base analysis of microarray gene expressiondata by using support vector machines. PNAS, 97(1):262–267 CrossRefGoogle Scholar
  3. Cristianini N, Shawe-Taylor J (2000) An introduction to support vector machines and other kernel-based learning methods. Cambridge University Press, Cambridge Google Scholar
  4. Dietterich TG, Lathrop RH, Lozano-Perez T (1997) Solving the multiple instance problem with axis-parallel rectangles. Artif Intell, 89:31–71 zbMATHCrossRefGoogle Scholar
  5. Eacott MJ, Gaffan D (1991) The role of monkey inferior parietal cortex in visual discrimination of identity and orientation of shapes. Behav Brain Res, 46(1):95–98 CrossRefGoogle Scholar
  6. Garey MR, Johnson DS (1979) Computers and intractability: a guide to the theory of NP-completeness. W.H. Freeman, New York zbMATHGoogle Scholar
  7. Horel JA, Misantone LJ (1976) Visual discrimination impaired by cutting temporal lobe connections. Science, 193(4250):336–338 CrossRefGoogle Scholar
  8. Huang Z, Chen H, Hsu CJ, Chenb WH, Wuc S (2004) Credit rating analysis with support vector machines and neural networks: a market comparative study. Decis Support Syst, 37:543–558 CrossRefGoogle Scholar
  9. Joachims T (1998) Text categorization with support vector machines: Learning with many relevant features. In: Nédellec C, Rouveirol C (eds.), Proceedings of the European conference on machine learning. Springer, Berlin, pp. 137–142 Google Scholar
  10. Lal TN, Schroeder M, Hinterberger T, Weston J, Bogdan M, Birbaumer N, Schölkopf B (2004) Support vector channel selection in BCI. IEEE Trans Biomed Eng, 51(6):1003–1010 CrossRefGoogle Scholar
  11. Ledberg A, Bressler SL, Ding M, Coppola R, Nakamura R (2007) Large-scale visuomotor integration in the cerebral cortex. Cereb Cortex, 17:44–62 CrossRefGoogle Scholar
  12. Lee S, Verri A (2002) Pattern recognition with support vector machines. In: SVM 2002. Springer, Niagara Falls Google Scholar
  13. Mendola JD, Corkin S (1999) Visual discrimination and attention after bilateral temporal-lobe lesions: a case study. Neuropsychologia, 37(1):91–102 CrossRefGoogle Scholar
  14. Noble WS (2004) Kernel methods in computational biology. In: Support vector machine applications in computational biology. MIT Press, Cambridge, pp. 71–92 Google Scholar
  15. Shawe-Taylor J, Cristianini N (2004) Kernel methods for pattern analysis. Cambridge University Press, Cambridge Google Scholar
  16. Trafalis TB, Ince H (2002) Support vector machine for regression and applications to financial forecasting. In: International joint conference on neural networks (IJCNN’02), Como, Italy. IEEE-INNS-ENNS Google Scholar
  17. Vapnik V (1995) The nature of statistical learning theory. Springer, New York zbMATHGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2008

Authors and Affiliations

  • Onur Seref
    • 1
  • O. Erhun Kundakcioglu
    • 2
  • Oleg A. Prokopyev
    • 3
  • Panos M. Pardalos
    • 2
  1. 1.Department of Business Information TechnologyVirginia Polytechnic Institute and State UniversityBlacksburgUSA
  2. 2.Department of Industrial and Systems EngineeringUniversity of FloridaGainesvilleUSA
  3. 3.Department of Industrial EngineeringUniversity of PittsburghPittsburghUSA

Personalised recommendations