Twin Bounded Large Margin Distribution Machine

  • Haitao XuEmail author
  • Brendan McCane
  • Lech Szymanski
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11320)


In order to speed up the learning time of large margin distribution machine (LDM) and improve the generalization performance of twin bounded support vector machine (TBSVM), a novel method named twin bounded large margin distribution machine (TBLDM) is proposed in this paper. The central idea of TBLDM is to seek a pair of nonparallel hyperplanes by optimizing the positive and negative margin distributions on the base of TBSVM. The experimental results indicate that the proposed TBLDM is a fast, effective and robust classifier.


Large margin distribution machine Twin bounded support vector machine Margin distribution Margin mean Margin variance 


  1. 1.
    MATLAB version (R2017a). The Mathworks Inc., Natick, Massachusetts (2017)Google Scholar
  2. 2.
    Breiman, L.: Prediction games and arcing algorithms. Neural Comput. 11(7), 1493–1517 (1999)CrossRefGoogle Scholar
  3. 3.
    Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)zbMATHGoogle Scholar
  4. 4.
    Dheeru, D., Karra Taniskidou, E.: UCI machine learning repository (2017).
  5. 5.
    Freund, Y., Schapire, R.E.: A decision-theoretic generalization of on-line learning and an application to boosting. J. Comput. Syst. Sci. 55(1), 119–139 (1997)MathSciNetCrossRefGoogle Scholar
  6. 6.
    Gao, W., Zhou, Z.H.: On the doubt about margin explanation of boosting. Artif. Intell. 203, 1–18 (2013)MathSciNetCrossRefGoogle Scholar
  7. 7.
    Jayadeva, Khemchandani, R., et al.: Twin support vector machines for pattern classification. IEEE Trans. Pattern Anal. Mach. Intell. 29(5), 905–910 (2007)CrossRefGoogle Scholar
  8. 8.
    Khemchandani, R., Sharma, S.: Robust least squares twin support vector machine for human activity recognition. Appl. Soft Comput. 47, 33–46 (2016)CrossRefGoogle Scholar
  9. 9.
    Luo, X., Durrant, R.J.: Maximum margin principal components. arXiv preprint arXiv:1705.06371 (2017)
  10. 10.
    Mangasarian, O.L., Musicant, D.R.: Successive overrelaxation for support vector machines. IEEE Trans. Neural Netw. 10(5), 1032–1037 (1999)CrossRefGoogle Scholar
  11. 11.
    Platt, J., et al.: Sequential minimal optimization: a fast algorithm for training support vector machines (1998)Google Scholar
  12. 12.
    Rastogi, R., Sharma, S., Chandra, S.: Robust parametric twin support vector machine for pattern classification. Neural Process. Lett. 47, 1–31 (2017)CrossRefGoogle Scholar
  13. 13.
    Reyzin, L., Schapire, R.E.: How boosting the margin can also boost classifier complexity. In: Proceedings of the 23rd International Conference on Machine Learning, pp. 753–760. ACM (2006)Google Scholar
  14. 14.
    Schapire, R.E., Freund, Y., Bartlett, P., Lee, W.S.: Boosting the margin: a new explanation for the effectiveness of voting methods. Ann. Stat. 26, 1651–1686 (1998)MathSciNetCrossRefGoogle Scholar
  15. 15.
    Shao, Y.H., Chen, W.J., Wang, Z., Li, C.N., Deng, N.Y.: Weighted linear loss twin support vector machine for large-scale classification. Knowl.-Based Syst. 73, 276–288 (2015)CrossRefGoogle Scholar
  16. 16.
    Shao, Y.H., Zhang, C.H., Wang, X.B., Deng, N.Y.: Improvements on twin support vector machines. IEEE Trans. Neural Netw. 22(6), 962–968 (2011)CrossRefGoogle Scholar
  17. 17.
    Vapnik, V.: The Nature of Statistical Learning Theory. Springer, New York (2013). Scholar
  18. 18.
    Vapnik, V.N., Vapnik, V.: Statistical Learning Theory, vol. 1. Wiley, New York (1998)zbMATHGoogle Scholar
  19. 19.
    Wang, L., Sugiyama, M., Yang, C., Zhou, Z.H., Feng, J.: On the margin explanation of boosting algorithms. In: COLT, pp. 479–490. Citeseer (2008)Google Scholar
  20. 20.
    Xu, H., Fan, L., Gao, X.: Projection twin SMMs for 2D image data classification. Neural Comput. Appl. 26(1), 91–100 (2015)CrossRefGoogle Scholar
  21. 21.
    Xu, Y., Pan, X., Zhou, Z., Yang, Z., Zhang, Y.: Structural least square twin support vector machine for classification. Appl. Intell. 42(3), 527–536 (2015)CrossRefGoogle Scholar
  22. 22.
    Zhang, K., Kwok, J.T.: Clustered Nyström method for large scale manifold learning and dimension reduction. IEEE Trans. Neural Netw. 21(10), 1576–1587 (2010)CrossRefGoogle Scholar
  23. 23.
    Zhang, T., Zhou, Z.H.: Large margin distribution machine. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 313–322. ACM (2014)Google Scholar
  24. 24.
    Zhang, T., Zhou, Z.H.: Optimal margin distribution clustering (2018)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.Department of Computer ScienceUniversity of OtagoOtagoNew Zealand

Personalised recommendations