Skip to main content
SpringerLink
Log in

Angle-based twin support vector machine

  • RAOTA-2016
  • Published:
Annals of Operations Research Aims and scope Submit manuscript

Abstract

In this paper, a novel nonparallel hyperplane based classifier termed as “angle-based twin support vector machine” (ATWSVM) has been proposed which is motivated by the concept of twin support vector machine (TWSVM). TWSVM obtains two nonparallel hyperplanes by solving a pair of quadratic programming problems (QPPs). ATWSVM presents a generic classification model, where the first problem can be formulated using a TWSVM-based classifier and the second problem is an unconstrained minimization problem (UMP) which is reduced to solving a system of linear equations. The second hyperplane is determined so that it is proximal to its own class and the angle between the normals to the two hyperplanes is maximized. The notion of angle has been introduced to have maximum separation between the two hyperplanes. In this work, we have presented two versions of ATWSVM: one that solves a QPP and a UMP; second which formulates both the problems as UMPs. The training time of ATWSVM is much less than that of TWSVM because ATWSVM solves the second problem as UMP instead of QPP. To test the efficacy of the proposed classifier, experiments have been conducted on synthetic and benchmark datasets and it is observed that the proposed classifier achieves classification accuracy comparable or better than that of TWSVM. This work also proposes application of ATWSVM for color image segmentation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  • Arbelaez, P., Fowlkes, C., & Martin, D. (2007). The Berkeley segmentation dataset and bench-mark. http://www.eecs.berkeley.edu/Research/Projects/CS/vision/bsds

  • Blake, C., & Merz, C. J. (1998) UCI repository of machine learning databases. http://www.ics.uci.edu/mlearn/MLRepository.html

  • Burges, C. J. (1998). A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery, 2(2), 121–167.

    Article  Google Scholar 

  • Cortes, C., & Vapnik, V. (1995). Support-vector networks. Machine Learning, 20(3), 273–297.

    Google Scholar 

  • Demšar, J. (2006). Statistical comparisons of classifiers over multiple data sets. The Journal of Machine Learning Research, 7, 1–30.

    Google Scholar 

  • Duda, R. O., Hart, P. E., & Stork, D. G. (2012). Pattern classification. New York: Wiley.

    Google Scholar 

  • Hsu, C. W., Chang, C. C., & Lin, C. J. (2003). A practical guide to support vector classification. http://www.csie.ntu.edu.tw/~cjlin/papers/guide/guide.pdf.

  • Jain, A. K. (2010). Data clustering: 50 years beyond k-means. Pattern Recognition Letters, 31(8), 651–666.

    Article  Google Scholar 

  • Jayadeva, Khemchandani, R., & Chandra, S. (2007). Twin support vector machines for pattern classification. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(5), 905–910.

    Article  Google Scholar 

  • Jayadeva, Khemchandani, R., & Chandra, S. (2016). Twin support vector machines: Models, extensions and applications (Vol. 659). Berlin: Springer.

    Google Scholar 

  • Jumutc, V., & Suykens, J. A. (2014). Multi-class supervised novelty detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 36(12), 2510–2523.

    Article  Google Scholar 

  • Khemchandani, R. (2008). Mathematical programming applications in machine learning. Ph.D. thesis, Indian Institute of Technology, Delhi, New Delhi, India

  • Khemchandani, R., Saigal, P., & Chandra, S. (2016). Improvements on \(\nu \)-twin support vector machine. Neural Networks, 79, 97–107.

    Article  Google Scholar 

  • Kumar, M. A., & Gopal, M. (2009). Least squares twin support vector machines for pattern classification. Expert Systems with Applications, 36(4), 7535–7543.

    Article  Google Scholar 

  • Lee, Y. J., & Mangasarian, O. L. (2001). RSVM: Reduced support vector machines. SIAM International Conference on Data Mining, 2001, 1–17.

    Google Scholar 

  • Lee, Y. J., & Mangasarian, O. L. (2001). SSVM: A smooth support vector machine for classification. Computational Optimization and Applications, 20(1), 5–22.

    Article  Google Scholar 

  • Mangasarian, O. L. (1993). Nonlinear programming (Vol. 10). New Delhi: SIAM.

    Google Scholar 

  • Mangasarian, O. L., & Wild, E. W. (2001). Proximal support vector machine classifiers. In KDD-2001: Knowledge discovery and data mining, Citeseer.

  • Mangasarian, O. L., & Wild, E. W. (2006). Multisurface proximal support vector machine classification via generalized eigenvalues. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(1), 69–74.

    Article  Google Scholar 

  • Manjunath, B. S., & Ma, W. Y. (1996). Texture features for browsing and retrieval of image data. IEEE Transactions on Pattern Analysis and Machine Intelligence, 18(8), 837–842.

    Article  Google Scholar 

  • Musicant, D. (1998). NDC: Normally distributed clustered datasets. Madison: Computer Sciences Department, University of Wisconsin.

    Google Scholar 

  • Peng, X. (2011). TPMSVM: A novel twin parametric-margin support vector machine for pattern recognition. Pattern Recognition, 44(10), 2678–2692.

    Article  Google Scholar 

  • Shao, Y. H., Deng, N. Y., & Yang, Z. M. (2012). Least squares recursive projection twin support vector machine for classification. Pattern Recognition, 45(6), 2299–2307.

    Article  Google Scholar 

  • Shao, Y. H., Zhang, C. H., Wang, X. B., & Deng, N. Y. (2011). Improvements on twin support vector machines. IEEE Transactions on Neural Networks, 22(6), 962–968.

    Article  Google Scholar 

  • Shao, Y. H., Chen, W. J., & Deng, N. Y. (2014). Nonparallel hyperplane support vector machine for binary classification problems. Information Sciences, 263, 22–35.

    Article  Google Scholar 

  • Shao, Y. H., Wang, Z., Chen, W. J., & Deng, N. Y. (2013). A regularization for the projection twin support vector machine. Knowledge-Based Systems, 37, 203–210.

    Article  Google Scholar 

  • Suykens, J. A., & Vandewalle, J. (1999). Least squares support vector machine classifiers. Neural Processing Letters, 9(3), 293–300.

    Article  Google Scholar 

  • Tanveer, M., Shubham, K., Aldhaifallah, M., & Ho, S. S. (2016). An efficient regularized k-nearest neighbor based weighted twin support vector regression. Knowledge-Based Systems, 94, 70–87.

    Article  Google Scholar 

  • Tanveer, M., Khan, M. A., & Ho, S. S. (2016). Robust energy-based least squares twin support vector machines. Applied Intelligence, 45(1), 174–186.

    Article  Google Scholar 

  • Tian, Y., Ju, X., Qi, Z., & Shi, Y. (2014). Improved twin support vector machine. Science China Mathematics, 57(2), 417–432.

    Article  Google Scholar 

  • Tian, Y., & Ping, Y. (2014). Large-scale linear nonparallel support vector machine solver. Neural Networks, 50, 166–74.

    Article  Google Scholar 

  • Tian, Y. J., & Ju, X. C. (2015). Nonparallel support vector machine based on one optimization problem for pattern recognition. Journal of the Operations Research Society of China, 3(4), 499–519.

    Article  Google Scholar 

  • Vapnik, V. (2000). The nature of statistical learning theory. Berlin: Springer.

    Book  Google Scholar 

  • Xu, Y. (2016). Maximum Margin of Twin Spheres Support Vector Machine for Imbalanced Data Classification. IEEE Transactions on Cybernetics, 99, 1–11.

    Google Scholar 

  • Yang, Z. M., Wu, H. J., Li, C. N., & Shao, Y. H. (2016). Least squares recursive projection twin support vector machine for multi-class classification. International Journal of Machine Learning and Cybernetics, 7(3), 411–426.

    Article  Google Scholar 

  • Zhao, J., Yang, Z., & Xu, Y. (2016). Nonparallel least square support vector machine for classification. Applied Intelligence, 45(4), 1119–1128.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, South Asian University, New Delhi, India

    Reshma Khemchandani & Pooja Saigal

  2. Department of Mathematics, Indian Institute of Technology, Delhi, New Delhi, India

    Suresh Chandra

Authors
  1. Reshma Khemchandani
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pooja Saigal
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Suresh Chandra
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Reshma Khemchandani.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Khemchandani, R., Saigal, P. & Chandra, S. Angle-based twin support vector machine. Ann Oper Res 269, 387–417 (2018). https://doi.org/10.1007/s10479-017-2604-2

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10479-017-2604-2

Keywords

Search

Navigation