Soft Computing

, Volume 17, Issue 4, pp 643–650 | Cite as

A total least squares proximal support vector classifier for credit risk evaluation



In this paper, a total least squares (TLS) version of proximal support vector machines (PSVM) is proposed for credit risk evaluation. The formulation of this new model is different from the original PSVM model, so a novel iterative algorithm is proposed to solve this model. A simulation test is first implemented on a classic two-spiral dataset, and then an empirical experiment is conducted on two publicly available credit datasets. The experimental results show that the proposed total least squares PSVM (TLS-PSVM) is at least comparable with PSVM and better than other models including standard SVM model.


Total least squares method Proximal support vector machine Credit risk evaluation 



This work is partially supported by grants from the National Science Fund for Distinguished Young Scholars (NSFC No. 71025005) and the National Natural Science Foundation of China (NSFC No. 90924024).


  1. Baesens B, Van Gestel T, Viaene S, Stepanova M, Suykens J, Vanthienen J (2004) Benchmarking state-of-art classification algorithms for credit scoring. J Oper Res Soc 54:627–635CrossRefGoogle Scholar
  2. Fawcett T (2006) An introduction to ROC analysis. Pattern Recognit Lett 27:861–874CrossRefGoogle Scholar
  3. Frank A, Asuncion A (2010) UCI machine learning repository, University of California Irvine.
  4. Fu G, and Hu G (2008) Total least square support vector machine for regression. In: Proceedings of the 2008 international conference on intelligent computation technology and automation, vol 1, pp 271–275Google Scholar
  5. Fung G, and Mangasarian OL (2001) Proximal support vector machine classifiers. In: Proceedings of international conference of knowledge discovery and data mining, pp 77–86Google Scholar
  6. Golub G (1973) Some modified matrix eigenvalue problems. SIAM Rev 15:318–334MathSciNetMATHCrossRefGoogle Scholar
  7. Golub G, and Van Loan C (1980) An analysis of the total least squares problem. SIAM J Numer Anal 17:883–893MathSciNetMATHCrossRefGoogle Scholar
  8. Hardle W, Moro RA, Schafer D (2005) Predicting bankruptcy with support vector machines. In: Statistical tools for finance and insurance. Springer, Berlin, pp 225–248Google Scholar
  9. Levenberg K (1944) A method for the solution of certain non-linear problems in least squares. Q Appl Math 2:164–168MathSciNetMATHGoogle Scholar
  10. Markovsky I, Van Huffel S (2007) Overview of total least-squares methods. Signal Process 87:2283–2302MATHCrossRefGoogle Scholar
  11. Marquardt D (1963) An algorithm for least-squares estimation of nonlinear parameters. SIAM J Appl Math 11:431–441MathSciNetMATHCrossRefGoogle Scholar
  12. Mathworks (2008), MATLAB R2008aGoogle Scholar
  13. Peng X, Wang Y (2009) A normal least squares support vector machine (NLS-SVM) and its learning algorithm. Neurocomputing 72:3734–3741CrossRefGoogle Scholar
  14. Rakotomamonjy A (2004) Optimizing area under ROC curve with SVMs, ECAI 04 ROC and Artificial Intelligence Workshop, 20–27 August, Valencia, SpainGoogle Scholar
  15. Suykens JAK, Vandewalle JV (1999) Least squares support vector machine classifiers. Neural Process Lett 9:293–300MathSciNetCrossRefGoogle Scholar
  16. Suykens JAK, van Gestel T, De Brabanter J, De Moor B, and Vandewalle JV (2002) Least squares support vector machines. World Scientific, SingaporeGoogle Scholar
  17. Vapnik V (1995) The nature of statistical learning theory. Springer, New YorkGoogle Scholar
  18. Vapnik V (1998) Statistical learning theory. Wiley, New YorkGoogle Scholar
  19. Van Gestel T, Suykens JAK, Lanckriet G, Lambrechts A, De Moor B, Vandewalle JV (2002) Bayesian framework for least squares support vector machine classifiers, Gaussian processes and kernel Fisher discriminant analysis. Neural comput 15:1115–1148CrossRefGoogle Scholar
  20. Van Gestel T, Baesens B, Garcia J, van Dijcke P (2003) A support vector machine approach to credit scoring. Bank en Financiewezen 2:73–82Google Scholar
  21. Yu L, Wang SY, Lai KK (2009) An intelligent-agent-based fuzzy group decision making model for financial multicriteria decision support: the case of credit scoring. Eur J Oper Res 195:942–959MathSciNetMATHCrossRefGoogle Scholar
  22. Yu L, Yao X, Wang S, Lai KK (2011) Credit risk evaluation using a weighted least squares SVM classifier with design of experiment for parameter selection. Expert Syst Appl 38:15392–15399CrossRefGoogle Scholar
  23. Zhou LG, Lai KK (2009) Credit scoring models with AUC maximization based on weighted SVM. Int J Inf Technol Decis Mak 8(4):677–696MATHCrossRefGoogle Scholar

Copyright information

© Springer-Verlag 2012

Authors and Affiliations

  1. 1.School of Economics and ManagementBeijing University of Chemical TechnologyBeijingChina
  2. 2.Alibaba Business CollegeHangzhou Normal UniversityHangzhouChina
  3. 3.Academy of Mathematics and Systems ScienceChinese Academy of SciencesBeijingChina
  4. 4.Business School University of EdinburghEdinburghUK

Personalised recommendations