Skip to main content

Online Support Vector Machine Based on Minimum Euclidean Distance

  • Conference paper
  • First Online:

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 459))

Abstract

The present study includes development of an online support vector machine (SVM) based on minimum euclidean distance (MED). We have proposed a MED support vector algorithm where SVM model is initialized with small amount of training data and test data is merged to SVM model for incorrect predictions only. This method provides a simpler and more computationally efficient implementation as it assign previously computed support vector coefficients. To merge test data in SVM model, we find the euclidean distance between test data and support vector of target class and the coefficients of MED of support vector of training class are assigned to test data. The proposed technique has been implemented on benchmark data set mnist where SVM model initialized with 20 K images and tested for 40 K data images. The proposed technique of online SVM results in overall error rate as 1.69 % and without using online SVM results in error rate as 7.70 %. The overall performance of the developed system is stable in nature and produce smaller error rate.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. A. Bordes, L. Bottou, and J. Gallinari. Solving multiclass support vector machines with larank. International Conference on Machine Learning, 227:89–96, 2007.

    Google Scholar 

  2. A. Bordes, S. Ertekin, J. Weston, and L. Bottou. Fast kernel classifiers with online and active learning. Journal of Machine Learning and Research, 6:1579–1619, 2005.

    Google Scholar 

  3. C.J.C. Burges. A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery, 2:121–167, 1998.

    Google Scholar 

  4. C. Chang, C, W. Hsu, C, and J. Lin, C. The analysis of decomposition methods for support vector machines. IEEE Transactions on Neural Networks, 11(4):1003–1008, 2000.

    Google Scholar 

  5. S. Cheng and F. Shih. An improved incremental training algorithm for support vector machines using active query. Pattern Recognition, 40(3):964–971, 2007.

    Google Scholar 

  6. C. Cortes and V. Vapnik. Support-vector networks. Machine Learning, 20:273–297, 1995.

    Google Scholar 

  7. R.E. Fan, P.H. Chen, and C.J. Lin. Working set selection using second order information for training support vector machines. Journal of Machine learning Research, 6:1889–1918, 2005.

    Google Scholar 

  8. W. Lau, K and H. Wu, Q. Online training of support vector classifier. Pattern Recognition, 36(8):1913–1920, 2003.

    Google Scholar 

  9. Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. Proceedings of the IEEE, pages 2278–2324, 1998.

    Google Scholar 

  10. J. Lin, C. A formal analysis of stopping criteria of decomposition methods for support vector machines. IEEE Transactions on Neural Networks, 13(5):1045–1052, 2002.

    Google Scholar 

  11. F. Orabona, C. Castellini, B. Caputo, L. Jie, and G. Sandini. On-line independent support vector machines. Pattern Recognition, 43:1402–1412, 2010.

    Google Scholar 

  12. J. Platt. Sequential minimal optimization: A fast algorithm for training support vector machines. Microsoft Research, pages MSR–TR–98–14, 1998.

    Google Scholar 

  13. A. Shilton, M. Palaniswami, and T. A. Incremental training of support vector machines. IEEE Transactions on Neural Networks, 16(1):114–131, 2005.

    Google Scholar 

  14. R. Singh, M. Vatsa, A. Ross, and A. Noore. Biometric classifier update using online learning: A case study in near infrared face verification. Image and Vision Computing, 28:1098–1105, 2010.

    Google Scholar 

  15. V. Vapnik. The overview of statistical learning theory. IEEE Transactions on Neural Networks, 10(5):988–999, 1999.

    Google Scholar 

  16. D. Wand, H. Qiao, and B. Zhang. Online support vector machine based on convex hull vertices selection. IEEE Transactions on Neural Networks and Learning Systems, 24(4):593–609, 2013.

    Google Scholar 

  17. D. Wang, B. Zhang, P. Zhang, and H. Qiao. An online core vector machine with adaptive meb adjustment. Pattern Recognition, 43:3468–3482, 2010.

    Google Scholar 

  18. M. Wang, X. Zhou, F. Li, J. Huckins, R. W. King, and S. T. Wong. Novel cell segmentation and online svm for cell cycle phase identification in automated microscopy. Bioinformatics, 24(1):94–101, 2008.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Anuj Sharma .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer Science+Business Media Singapore

About this paper

Cite this paper

Dahiya, K., Kumar Chauhan, V., Sharma, A. (2017). Online Support Vector Machine Based on Minimum Euclidean Distance. In: Raman, B., Kumar, S., Roy, P., Sen, D. (eds) Proceedings of International Conference on Computer Vision and Image Processing. Advances in Intelligent Systems and Computing, vol 459. Springer, Singapore. https://doi.org/10.1007/978-981-10-2104-6_9

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-2104-6_9

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-2103-9

  • Online ISBN: 978-981-10-2104-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics