Skip to main content
SpringerLink
Log in

Survey on SVM and their application in image classification

  • Original Research
  • Published:
International Journal of Information Technology Aims and scope Submit manuscript

Abstract

Life of any living being is impossible if it does not have the ability to differentiate between various things, objects, smell, taste, colors, etc. Human being is a good ability to classify the object easily such as different human face, images. This is time of the machine so we want that machine can do all the work like as a human, this is part of machine learning. Here this paper discusses the some important technique for the image classification. What are the techniques through which a machine can learn for the image classification task as well as perform the classification task with efficiently. The most known technique to learn a machine is SVM. Support Vector machine (SVM) has evolved as an efficient paradigm for classification. SVM has a strongest mathematical model for classification and regression. This powerful mathematical foundation gives a new direction for further research in the vast field of classification and regression. Over the past few decades, various improvements to SVM has appeared, such as twin SVM, Lagrangian SVM, Quantum Support vector machine, least square support vector machine, etc., which will be further discussed in the paper, led to the creation of a new approach for better classification accuracy. For improving the accuracy as well as performance of SVM, we must aware of how a kernel function should be selected and what are the different approaches for parameter selection. This paper reviews the different computational model of SVM and key process for the SVM system development. Furthermore provides survey on their applications for image classification.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Cortes C, and Vapnik V (1995) Support-vector network. Mach Learn 20(3):273–297

  2. Tomar D, Agarwal S (2015) A comparison on multi-class classification methods based on least squares twin support vector machine. Knowl-Based Syst 81:131–147

    Google Scholar 

  3. Mangasarian OL, Musicant DR (2001) Lagrangian support vector machines. J Mach Learn Res 1:161–177

    MathSciNet  MATH  Google Scholar 

  4. Xiang Z, XueqiangLv, Zhang K (2014) An Image Classification Method Based On Multi-feature Fusion and Multi-kernel SVM. In: Seventh International Symposium on Computational Intelligence and Design, Hangzhou, p 49–52

  5. Hsu C-W, Lin C-J (2012) A comparison of methods for multi-class support vector machines. IEEE Trans Neural Networks 13(2):415–425

    Google Scholar 

  6. Milgram J, Cheriet M, Sabourin R (2006) One Against One or One Against All: Which One is Better for Handwriting Recognition with SVMs. In: Tenth International Workshop on Frontiers in Handwriting Recognition, Oct 2006, La Baule (France), Suvisoft,

  7. Jayadeva R, Khemchandani R, Chandra S (2007) Twin support vectormachine for pattern classification. IEEE Trans Pattern Anal Mach Intell 29(5):905–910

    MATH  Google Scholar 

  8. Han J, Kamber M (2001) Data mining: concepts and techniques. Morgan Kaufmann Publishers, USA

  9. Guyon I, Weston J, Barnhill S, Vapnik V (2002) Gene selection for cancer classification using support vector machines. Mach Learn 46:389–422

    MATH  Google Scholar 

  10. Prajapati GL,and Patle A(2010) On Performing Classification Using SVM with Radial Basis and Polynomial Kernel Functions. In: Third International Conference on Emerging Trends in Engineering and Technology, p 512–515

  11. Kuo B-C, Ho H-H, Li C-H, Hung C-C, Taur J-S (2014) A kernel-based feature selection method for SVM with RBF kernel for hyperspectral image classification. IEEE J sel Topic Appl Earth Observ Remote Sens 7(1):317–326

    Google Scholar 

  12. Morariu D, Vintan LN, Volker Tresp V (2006) Feature selection methods for an improved SVM classifier. Trans Eng 14:83–89

    Google Scholar 

  13. Huang C, Chen M, Wang C (2007) Credit scoring with a data mining approach based on SVMs. National Kaohsiung First university of Science and Technology, Department of Information Management, Nantz District, pp 847–856

    Google Scholar 

  14. Lin W, Lee Z, Lee S (2008) Parameter determination of support vector machine and feature selection using simulated annealing approach. Applied Soft Comput 8:1505–1512

    Google Scholar 

  15. Wang Z, Zhu C, Niu Z, Gao D, Feng X (2014) Multi-kernel classification machine with reduced complexity. Knowl-Based Syst 65:83–95

    Google Scholar 

  16. Scholkopf B, Burges CJC, Smola AJ (1999) Advances in kernel methods: support vector learning. MIT Press, Cambridge

    MATH  Google Scholar 

  17. Du P, Tan K, Xing X (2010) Wavelet SVM in reproducing kernel hilbert space for hyper-spectral remote sensing image classification. Opt Commun 283(24):4978–4984

    Google Scholar 

  18. Haar A (1910) Zurtheorie der orthogonalen funktionen systeme. Math Ann 69:331–371

    MathSciNet  Google Scholar 

  19. Graps A (1995) An Introduction to Wavelets. IEEE Comput Sci Eng 2(2):50–61

    Google Scholar 

  20. Agarwal E, Gupta S, Chandra MA (2014) Data hiding using lazy wavelet transform strategy. IJCA Proceedings on International Conference on Advances in Computer Engineering and Applications. ICACEA 5:5–8

    Google Scholar 

  21. Wickerhauser MV (1992) Acoustic signal compression with wave packets: wavelets: a tutorial in theory and applications. Academic Press Professional, San Diego, pp 679–700

    Google Scholar 

  22. Myint SW, Zhu T, Zheng B (2015) A novel image classification algorithm using over complete wavelet transforms. IEEE Geosci Remote Sens Lett 12(6):1232–1236

    Google Scholar 

  23. Nguyen T, Khosravi A, Creighton D, Nahavandi S (2015) Classification of healthcare data using genetic fuzzy logic system and wavelets. Expert Syst Appl 42:2184–2197

    Google Scholar 

  24. Nguyen T, Khosravi A, Creighton D, Nahavandi S (2015) Medical data classification using interval type-2 fuzzy logic system and wavelets. Applied Soft Comput 30:812–822

    Google Scholar 

  25. Tan Y, Li G, Duan H, Li C (2014) Enhancement of medical image details via wavelet homomorphic filtering transform. J Intell Syst 23(1):83–94

    Google Scholar 

  26. McCulloch WS, Pitts W (1943) A logical calculus of the ideas immanent in nervous activity. Bull Math Biophys 5:115–133

    MathSciNet  MATH  Google Scholar 

  27. Rosenblatt F (1957) The perceptron—a perceiving and recognizing automaton. Cornell aeronautical laboratory, report number: 85-460-1

  28. Kohonen T (1982) Self-organized formation of topologically correct feature maps. Biol Cybern 43:59–69

    MathSciNet  MATH  Google Scholar 

  29. Broomhead D S, lowe D (1988) Radial basis functions, multi-variable functional interpolation and adaptive networks, royal signals and radar establishment memorandum No. 4148, 38

  30. Widrow B, Hoff ME (1960) Adaptive switching circuits. IRE WESCON Conven Rec 4:96–104

    Google Scholar 

  31. Rumelhart DE, McClelland JL (eds) (1986) Parallel distributed processing: explorations in the microstructure of cognition, vol 1. MIT Press, Cambridge

    Google Scholar 

  32. Broomhead DS, Lowe D (1988) Multivariable function interpolation and adaptive networks. Complex Syst 2:321–355

    MATH  Google Scholar 

  33. Weston J, Mukherjee S, Chapelle O, Pontil M, Poggio T, Vapnik V (2000) Feature Selection for SVMs. In: Proceeding NIPS’00 Proceedings of the 13th International Conference on Neural Information Processing Systems. p 647–653

  34. Chapelle O, Vapnik V, Bousquet O, Mukhetjee S (2000) Choosing kernel parameters for support vector machines. Mach Learn 46(1–3):131–159

    MATH  Google Scholar 

  35. Burbidge R, Buxton B (2001) An introduction to support vector machines for data mining. Computer Science Dept.,UCL, UK

    Google Scholar 

  36. Chi M, Feng R, Bruzzone L (2008) Classification of hyper-spectral remote-sensing data with primal SVM for small-sized training dataset problem. Adv Space Res 41:1793–1799

    Google Scholar 

  37. Tao S, Chen D, Zhao W (2009) pruning algorithm for multi-output LS-SVM and its application in chemical pattern classification. Chemometr Intell Lab Syst 96:63–69

    Google Scholar 

  38. Tanoori B, Azimifar Z, Shakibafar A, Katebi S (2011) Brain volumetry: an active contour model-based segmentation followed by SVM-based classification. Comput Biol Med 41:619–632

    Google Scholar 

  39. Sugumaran V, Ramchandran KI (2011) Effect of number of features on classification of roller bearing faults using SVM and PSVM. Expert Syst Appl 38:4088–4096

    Google Scholar 

  40. Liu Y-T, Zhang H-X, Li P-H (2011) Research on SVM-based MRI image segmentation. J China Univ Posts Telecommun 18(2):129–132

    Google Scholar 

  41. YANG L, YANG F, NOGUCHI N (2011) Apple Internal Quality Classification Using X-ray and SVM. In: Proceedings of the 18th World Congress The International Federation of Automatic Control IFAC Proceedings, Volume 44, Issue 1, January 2011, p 14145–14150 Milano (Italy)

  42. Wang Z, Sun X (2011) Document classification algorithm based on MMP and LS-SVM. Advanced in Control Engineering and Information Science. Procedia Eng 15:1565–1569

    Google Scholar 

  43. Homaeinezhad MR, Tavakkoli E, Atyabi SA, Ghaffari A, Ebrahimpour R (2011) Synthesis of multiple-type classification algorithms for robust heart rhythm type recognition: neuro-svm-pnn learning machine with virtual QRS image-based geometrical features. Scientia Iranica B 18(3):423–431

    Google Scholar 

  44. Lo C-S, Wang C-M (2012) Support vector machine for breast MR image classification. Comput Math Appl 64:1153–1162

    MATH  Google Scholar 

  45. Ren J (2012) ANN vs. SVM: which one performs better in classification of MCCs in mammogram imaging. Knowl-Based Syst 26:144–153

    Google Scholar 

  46. Yang Q, Liang J, Hub Z, Xing Z, Zhao H (2012) Automatic recognition of poleward moving auroras from all-sky image sequences based on HMM and SVM. Planet Space Sci 69(2012):40–48

    Google Scholar 

  47. Xiang Z, Lv X, Zhang K (2014) An Image Classification method based on multi-feature fusion and multi-kernel SVM. In: 2014 seventh international symposium on computational intelligence and design, Hangzhou, p 49–52

  48. Tang YY, Lu Y, Yuan H (2015) Hyper-spectral image classification based on three-dimensional scattering wavelet transform. IEEE Trans Geosci Remote Sens 53(5):2467–2480

    Google Scholar 

  49. Kumar B, Dikshit O (2015) Spectral-Spatial Classification of Hyper-spectral Imagery Based on Moment Invariants. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 8(6):2457–2463

    Google Scholar 

  50. Goela S, Gaur M, Jain E (2015) Nature inspired algorithms in remote sensing image classification. Procedia Comput Sci 57:377–384

    Google Scholar 

  51. Peng J, Zhou Y, Chen CLP (2015) Region-kernel-based support vector machines for hyper-spectral image classification. IEEE Trans Geosci Remote Sens 53(9):4810–4824

    Google Scholar 

  52. Yang W, Yin X, Xia G-S (2015) Learning high-level features for satellite image classification with limited labeled samples. IEEE Trans Geosci Remote Sens 53(8):4472–4482

    Google Scholar 

  53. Wu Z, Liu J, Plaza A, Li J, Wei Z (2015) GPU implementation of composite kernels for hyper-spectral image classification. IEEE Geosci Remote Sens Lett 12(9):1973–1977

    Google Scholar 

  54. Song Y, Cai W, Huang H, Zhou Y, Feng DD, Wang Y, Fulham MJ, Chen M (2015) large margin local estimate with applications to medical image classification. IEEE Trans Med Imaging 34(6):1362–1377

    Google Scholar 

  55. Luo Y, Liu T, Tao D, Xu C (2015) Multiview matrix completion for multilabelimage classification. IEEE Trans Image Process 24(8):2355–2368

    MathSciNet  MATH  Google Scholar 

  56. Yin H, Jiao X, Chai Y, Fang B (2015) Scene classification based on single-layer SAE and SVM. Expert Syst Appl 42:3368–3380

    Google Scholar 

  57. Sugamya K, Pabboju S, Babu S V (2016) A CBIR Classification Using Support Vector Machines. In: International Conference on Advances in Human Machine Interaction (HMI—2016)

  58. Liu S, Chen X, Fan D, Chen X, Meng F, Huang Q (2016) 3D Smiling Facial Expression Recognition Based on SVM. In: 2016 IEEE International Conference on Mechatronics and Automation, Harbin, p 1661–1666

  59. Oliva J T, Lee HD, Spolaôr N, Coy CSR, Wu FC (2016) Prototype system for feature extraction, classification and study of medical images. Expert Syst Appl 63 No. C, 267–283

  60. Wei Z, Hoai M (2016) Region Ranking SVM for Image Classification. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, p 2987–2996

  61. Ding J, Cao G, Meng D (2016) Classification of Tongue Images Based on Doublet SVM. In: International Symposium on System and Software Reliability (ISSSR), Shanghai, p 77–81

  62. Sachdeva J, Kumar V, Gupta I, Khandelwal N, Ahuja CK (2016) A package-SFERCB-Segmentation, feature extraction, reduction and classification analysis by both SVM and ANN for brain tumors. Appl Soft Comput 47:151–167

    Google Scholar 

  63. Garali I, Adel M, Bourennane S, Guedj E (2016) Classification of positron emission tomography brain images using first and second derivative features. In: 2016 6th European Workshop on Visual Information Processing (EUVIP), Marseille, pp. 1-5.EUVIP 201, p 1–5

  64. Park S, Lee HS, Kim J (2017) Seed growing for interactive image segmentation using SVM classification with geodesic distance. Electron Lett 53(1):22–24

    Google Scholar 

  65. Wang S, Liu Q, Zhu E, Porikli F, Yin J (2018) Hyperparameter selection of one-class support vector machine by self-adaptive data shifting. Pattern Recogn 74:198–211

    Google Scholar 

  66. Mahesh VGV, Raj ANJ (2018) Zernike moments and machine learning based gender classification using facial images. In: Abraham A, Cherukuri A, Madureira A, Muda A (eds) Proceedings of the Eighth International Conference on Soft Computing and Pattern Recognition (SoCPaR 2016). SoCPaR 2016. Advances in Intelligent Systems and Computing, vol 614. Springer, Cham

  67. Priya C A, Balasaravanan T, Thanamani A S (2012) An efficient leaf recognition algorithm for plant classification using support vector machine. In: International Conference on Pattern Recognition, Informatics and Medical Engineering (PRIME-2012), Salem, Tamilnadu, p 428–432

  68. Es-saady Y, Massi I El, Yassa I El, Mammass, D, A. Benazoun A (2016) Automatic recognition of plant leaves diseases based on serial combination of two SVM classifiers. In: 2016 International Conference on Electrical and Information Technologies (ICEIT), Tangiers, p 561–566

  69. Tomar D, Agarwal S (2016) Leaf recognition for plant classification using direct acyclic graph based multi-class least squares twin support vector machine. Int J Image Graph 16(3):1650012

    MathSciNet  Google Scholar 

  70. Lukic M, Tuba E, Tuba M (2017) Leaf recognition algorithm using support vector machine with Hu moments and local binary patterns. In: IEEE 15th International Symposium on Applied Machine Intelligence and Informatics (SAMI), Herl’any p 000485–000490

Download references

Author information

Authors and Affiliations

  1. Department of CSIT, MJP Rohilkhand University, Bareilly, UP, India

    Mayank Arya Chandra & S. S. Bedi

Authors
  1. Mayank Arya Chandra
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. S. S. Bedi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mayank Arya Chandra.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chandra, M.A., Bedi, S.S. Survey on SVM and their application in image classification. Int. j. inf. tecnol. 13, 1–11 (2021). https://doi.org/10.1007/s41870-017-0080-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s41870-017-0080-1

Keywords

Search

Navigation