Abstract
Support vector machines (SVM) is an effective tool for building good credit scoring models. However, the performance of the model depends on its parameters’ setting. In this study, we use direct search method to optimize the SVM-based credit scoring model and compare it with other three parameters optimization methods, such as grid search, method based on design of experiment (DOE) and genetic algorithm (GA). Two real-world credit datasets are selected to demonstrate the effectiveness and feasibility of the method. The results show that the direct search method can find the effective model with high classification accuracy and good robustness and keep less dependency on the initial search space or point setting.
Similar content being viewed by others
References
Baesens B, Gestel TV, Viaene S, Stepanova M, Suykens J, Vanthienen J (2003) Benchmarking state-of-the-art classification algorithms for credit scoring. J Oper Res Soc 54: 627–635
Desai VS, Conway DG, Crook JN, Overstreet GA Jr. (1997) Credit-scoring models in the credit-union environment using neural networks and genetic algorithms. IMA J Manage Math 8(4): 323–346
Gao J (2007) Credibilistic game with fuzzy information. J Uncertain Syst 1(1): 74–80
Gehrlein WV, Wagner BJ (1997) A two-stage least cost credit scoring model. Ann Oper Res 74(1–4): 159–171
Gestel TV, Baesens B, Garcia J, Dijcke PV (2003) A support vector machine approach to credit scoring. Bank en Financiewezen 2: 73–82
Glover F (1990) Improved linear programming models for discriminant analysis. Dec Sci 21(4): 771–785
Hardy WE Jr., Adrian JL Jr. (1985) A linear programming alternative to discriminant analysis in credit scoring. Agribusiness 1(4): 285–292
Henley WE, Hand DJ (1997) Construction of a k-nearest-neighbour credit-scoring system. IMA J Manage Math 8(4): 305–321
Huang CL, Chen MC, Wang CJ (2007) Credit scoring with a data mining approach based on support vector machines. Expert Syst Appl 33(4): 847–856
Jensen HL (1992) Using neural networks for credit scoring. Manage Financ 18(6): 15
Lai KK, Yu L, Zhou LG, Wang SY (2006) Credit risk evaluation with least square support vector machine. Lect Notes Artif Intell 4062: 490–495
Makowski P (1985) Credit scoring branches out. Credit World 74(2): 30–37
Myers JH, Forgy EW (1963) The development of numerical credit evaluation systems. J Am Stat Assoc 58(303): 799–806
Rosenberg E, Gleit A (1994) Quantitative methods in credit management: a survery. Oper Res 42(4): 589–613
Schebesch KB, Stecking R (2005) Support vector machines for classifying and describing credit applicants: detecting typical and critical regions. J Oper Res Soc 56(8): 1082–1088
Staelin C (2003) Parameter selection for support vector machines. In: Tech Rep. HP Laboratories, Israel
Suykens JAK, Gestel TV, Brabanter JD, Moor BD, Vandewalle J (2002) Least squares support vector machines. World Scientific, Singapore
The MathWorks Inc. (2007) MATLAB genetic algorithm and direct search toolbox, version 2.1. Natick
Thomas LC (2000) A survey of credit and behavioural scoring: forecasting financial risk of lending to consumers. Int J Forecast 16(2): 149–172
Vapnik VN (2000) The nature of statistical learning theory, 2nd edn. Springer, New York
Yobas MB, Crook JN, Ross P (2000) Credit scoring using neural and evolutionary techniques. IMA J Manage Math 11(2): 111–125
West D (2000) Neural network credit scoring models. Comput Oper Res 27(11–12): 1131–1152
Wiginton JC (1980) A note on the comparison of logit and discriminant models of consumer credit behavior. J Financ Quant Anal 15(3): 757–770
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhou, L., Lai, K.K. & Yu, L. Credit scoring using support vector machines with direct search for parameters selection. Soft Comput 13, 149–155 (2009). https://doi.org/10.1007/s00500-008-0305-0
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-008-0305-0