Skip to main content
Book cover

Encyclopedia of Biometrics pp 1504–1511Cite as

Support Vector Machine

Synonyms

Margin classifier; Maximum margin classifier; Optimal hyperplane SVM

Definition

Support vector machines (SVMs) are particular linear classifiers which are based on the margin maximization principle. They perform structural risk minimization, which improves the complexity of the classifier with the aim of achieving excellent generalization performance. The SVM accomplishes the classification task by constructing, in a higher dimensional space, the hyperplane that optimally separates the data into two categories.

Introduction

Considering a two-category classification problem, a linear classifier separates the space, with a hyperplane, into two regions, each of which is also called a class. Before the creation of SVMs, the popular algorithm for determining the parameters of a linear classifier was a single-neuron perceptron. The perceptron algorithm uses an updating rule to generate a separating surface for a two-class problem. The procedure is guaranteed to converge when the...

This is a preview of subscription content, access via your institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-1-4899-7488-4_299
  • Chapter length: 8 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   899.99
Price excludes VAT (USA)
  • ISBN: 978-1-4899-7488-4
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Hardcover Book
USD   549.99
Price excludes VAT (USA)
Learn about institutional subscriptions
Support Vector Machine, Fig. 1
Support Vector Machine, Fig. 2
Support Vector Machine, Fig. 3
Support Vector Machine, Fig. 4

References

  1. V. Vapnik, Statistical Learning Theory (Wiley, New York, 1998)

    MATH  Google Scholar 

  2. B. E. Boser, I. Guyon, V. Vapnik, A Training Algorithm for Optimal Margin Classifiers, in Proceedings of the 5th Annual Workshop on Computational Learning Theory (COLT’92), ed. by D. Haussler, (ACM Press, Pittsburgh, PA, USA, 1992), pp. 144–152

    Google Scholar 

  3. B. Scholkopf, A. Smola, Learning with Kernels (MIT, Cambridge, 2002)

    Google Scholar 

  4. N. Cristianini, J. Shawe-Taylor, An Introduction to Support Vector Machines (Cambridge University Press, Cambridge/New York, 2000)

    Google Scholar 

  5. T. Joachims, Making large-scale support vector machine learning practical, in Advances in Kernel Methods: Support Vector Machines, ed. by B. Scholkopf, C.J.C. Burges, A.J. Smola (MIT, Cambridge, 1998)

    Google Scholar 

  6. O. Chapelle, V. Vapnik, Model selection for support vector machines, in Advances in Neural Information Processing Systems, Denver, 1999

    Google Scholar 

  7. N.E. Ayat, M. Cheriet, C. Suen, Automatic model selection for the optimization of the SVM kernels. Pattern Recognit. 38(9), 1733–1745 (2005)

    Google Scholar 

  8. M.M. Adankon, M. Cheriet, Optimizing resources in model selection for support vector machines. Pattern Recognit. 40(3), 953–963 (2007)

    MATH  Google Scholar 

  9. M.M. Adankon, M. Cheriet, New formulation of SVM for model selection, in International Joint Conference in Neural Networks 2006, Vancouver (IEEE, 2006), pp. 3566–3573

    Google Scholar 

  10. J.A.K. Suykens, T. Van Gestel, J. De Brabanter, B. De Moor, J. Vandewalle, Least Squares Support Vector Machines (World Scientific, Singapore, 2002)

    MATH  Google Scholar 

  11. G.C. Cawley, N.L.C. Talbot, Fast exact leave-one-out cross-validation of sparse least-squares support vector machines. Neural Netw. 17, 1467–1475 (2004)

    MATH  Google Scholar 

  12. M.M. Adankon, M. Cheriet, Model selection for the LS-SVM. Application to handwriting recognition. Pattern Recognit. 42(11), 3264–3270 (2009)

    MATH  Google Scholar 

  13. M.M. Adankon, M. Cheriet, A. Biem, Semisupervised learning using Bayesian interpretation: application to LS-SVM. IEEE Trans. Neural Netw. 22(4), 513–524 (2011)

    Google Scholar 

  14. K. Roy, P. Bhattacharya, Iris recognition using support vector machine, in APR International Conference on Biometric Authentication (ICBA), Hong Kong, Jan 2006. Springer Lecture Note Series in Computer Science (LNCS), vol. 3882, 2006, pp. 486–492

    Google Scholar 

  15. Y. Yao, G. Luca Marcialis, M. Pontil, P. Frasconi, F. Roli, Combining flat and structured representations for fingerprint classification with recursive neural networks and support vector machines. Pattern Recognit. Comput. Sci. 36(2), 397–406 (2003)

    Google Scholar 

  16. N. Matic, I. Guyon, J. Denker, V. Vapnik, Writer adaptation for on-line handwritten character recognition, in Second International Conference on Pattern Recognition and Document Analysis, Tsukuba (IEEE, 1993), pp. 187–191

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. ML-Consulting, Laval, QC, Canada

    Mathias M. Adankon

  2. University of Quebec, ETS, Montreal, Canada

    Mohamed Cheriet

Authors
  1. Mathias M. Adankon
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mohamed Cheriet
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Center for Biometrics and Security, Research & National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, China

    Stan Z. Li

  2. Departments of Computer Science and Engineering, Michigan State University, East Lansing, MI, USA

    Anil K. Jain

Rights and permissions

Reprints and Permissions

Copyright information

© 2015 Springer Science+Business Media New York

About this entry

Cite this entry

Adankon, M.M., Cheriet, M. (2015). Support Vector Machine. In: Li, S.Z., Jain, A.K. (eds) Encyclopedia of Biometrics. Springer, Boston, MA. https://doi.org/10.1007/978-1-4899-7488-4_299

Download citation