Journal of Systems Science and Complexity

, Volume 21, Issue 4, pp 527–539 | Cite as

Designing a Hybrid Intelligent Mining System for Credit Risk Evaluation

  • Lean YU
  • Shouyang WANG
  • Fenghua WEN
  • Kin Keung LAI
  • Shaoyi HE


In this study, a novel hybrid intelligent mining system integrating rough sets theory and support vector machines is developed to extract efficiently association rules from original information table for credit risk evaluation and analysis. In the proposed hybrid intelligent system, support vector machines are used as a tool to extract typical features and filter its noise, which are different from the previous studies where rough sets were only used as a preprocessor for support vector machines. Such an approach could reduce the information table and generate the final knowledge from the reduced information table by rough sets. Therefore, the proposed hybrid intelligent system overcomes the dificulty of extracting rules from a trained support vector machine classifier and possesses the robustness which is lacking for rough-set-based approaches. In addition, the effectiveness of the proposed hybrid intelligent system is illustrated with two real-world credit datasets.

Key words

Credit risk evaluation hybrid intelligent system rough sets support vector machine 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    E. I. Altman, Financial ratios, discriminant analysis and the prediction of corporate bankruptcy, Journal of Finance, 1968, 23(3): 589–609.CrossRefGoogle Scholar
  2. [2]
    J. C. Wiginton, A note on the comparison of logit and discriminant models of consumer credit behaviour, Journal of Financial Quantitative Analysis, 1980, 15(3): 757–770.CrossRefGoogle Scholar
  3. [3]
    C. V. Zavgren, Assessing the vulnerability to failure of American industrial firms: A logistic analysis, Journal of Business Finance and Accounting, 1985, 12(1): 19–45.CrossRefGoogle Scholar
  4. [4]
    B. J. Grablowsky and W. K. Talley, Probit and discriminant functions for classifying credit applicants: A comparison, Journal of Economic and Business, 1981, 33(3): 254–261.CrossRefGoogle Scholar
  5. [5]
    F. Glover, Improved linear programming models for discriminant analysis, Decision Science, 1990, 21(4): 771–785.CrossRefGoogle Scholar
  6. [6]
    O. L. Mangasarian, Linear and nonlinear separation of patterns by linear programming, Operations Research, 1965, 13(3): 444–452.MATHCrossRefMathSciNetGoogle Scholar
  7. [7]
    W. E. Henley and D. J. Hand, A k-nearest-neighbour classifier for assessing consumer credit risk, Statistician, 1996, 45(1): 77–95.CrossRefGoogle Scholar
  8. [8]
    P. Makowski, Credit scoring branches out, Credit World, 1985, 75(1): 30–37.Google Scholar
  9. [9]
    R. Smalz and M. Conrad, Combining evolution with credit apportionment: A new learning algorithm for neural nets, Neural Networks, 1994, 7(2): 341–351.CrossRefGoogle Scholar
  10. [10]
    K. K. Lai, L. Yu, S. Y. Wang, and L. G. Zhou, Credit risk analysis using a reliability-based neural network ensemble model, Lecture Notes in Computer Science, 2006, 4132: 682–690.CrossRefGoogle Scholar
  11. [11]
    R. Malhotra and D. K. Malhotra, Evaluating consumer loans using neural networks, Omega, 2003, 31(1): 83–96.CrossRefGoogle Scholar
  12. [12]
    L. Yu, S. Y. Wang, and K. K. Lai, Credit risk assessment with a multistage neural network ensemble learning approach, Expert Systems with Applications, 2008, 34(2): 1434–1444.CrossRefGoogle Scholar
  13. [13]
    M. C. Chen and S. H. Huang, Credit scoring and rejected instances reassigning through evolutionary computation techniques, Expert Systems with Applications, 2003, 24(4): 433–441.MATHCrossRefGoogle Scholar
  14. [14]
    F. Varetto, Genetic algorithms applications in the analysis of insolvency risk, Journal of Banking and Finance, 1998, 22(10): 1421–1439.CrossRefGoogle Scholar
  15. [15]
    T. Van Gestel, B. Baesens, J. Garcia, and P. Van Dijcke, A support vector machine approach to credit scoring, Bank en Financiewezen, 2003, 2(1): 73–82.Google Scholar
  16. [16]
    Z. Huang, H. C. Chen, C. J. Hsu, W. H. Chen, and S. S. Wu, Credit rating analysis with support vector machines and neural networks: A market comparative study, Decision Support Systems, 2004, 37(4): 543–558.CrossRefGoogle Scholar
  17. [17]
    K. K. Lai, L. Yu, S. Y. Wang, and L. G. Zhou, Credit risk evaluation with least square support vector machine, Lecture Notes in Computer Science, 2006, 4062: 490–495.CrossRefGoogle Scholar
  18. [18]
    L. Yu, S. Y. Wang, K. K. Lai, and L. G. Zhou, Bio-Inspired Credit Risk Analysis–Computational Intelligence with Support Vector Machines, Springer-Verlag, Berlin, 2008.Google Scholar
  19. [19]
    A. I. Dimitras, R. Slowinski, R. Susmaga, and C. Zopounidis, Business failure prediction using rough sets, European Journal of Operational Research, 1999, 114(2): 263–280.MATHCrossRefGoogle Scholar
  20. [20]
    M. J. Beynon and M. J. Peel, Variable precision rough set theory and data discretisation: An application to corporate failure prediction, Omega, 2001, 29(6): 561–576.CrossRefGoogle Scholar
  21. [21]
    T. S. Lee, C. C. Chiu, C. J. Lu, and I. F. Chen, Credit scoring using the hybrid neural discriminant technique, Expert Systems with Applications, 2002, 23(3): 245–254.CrossRefGoogle Scholar
  22. [22]
    S. Piramuthu, Financial credit-risk evaluation with neural and neurofuzzy systems, European Journal of Operational Research, 1999, 112(2): 310–321.CrossRefGoogle Scholar
  23. [23]
    R. Malhotra and D. K. Malhotra, Differentiating between good credits and bad credits using neurofuzzy systems, European Journal of Operational Research, 2002, 136(1): 190–211.MATHCrossRefGoogle Scholar
  24. [24]
    B. S. Ahn, S. S. Cho, and C. Y. Kim, The integrated methodology of rough set theory and artificial neural network for business failure prediction, Expert Systems with Applications, 2000, 18(1): 65–74.CrossRefGoogle Scholar
  25. [25]
    Y. Q. Wang, S. Y. Wang, and K. K. Lai, A new fuzzy support vector machine to evaluate credit risk, IEEE Transactions on Fuzzy Systems, 2005, 13(6): 820–831.CrossRefGoogle Scholar
  26. [26]
    L. C. Thomas, A survey of credit and behavioral scoring: forecasting financial risk of lending to consumers, International Journal of Forecasting, 2002, 16(2): 149–172.CrossRefGoogle Scholar
  27. [27]
    L. C. Thomas, R. W. Oliver, and D. J. Hand, A survey of the issues in consumer credit modelling research, Journal of the Operational Research Society, 2005, 56(9): 1006–1015.MATHCrossRefGoogle Scholar
  28. [28]
    M. Yahia, R. Mahmod, N. Sulaiman, and F. Ahmad, Rough neural expert systems, Expert Systems with Applications, 2000, 18(2): 87–99.CrossRefGoogle Scholar
  29. [29]
    H. P. Nguyen, L. L. Phong, P. Santiprabhob, and B. De Baets, Approach to generation rules for expert systems using rough set theory, in Proceedings of the Joint 9th IFSA World Congress and 20th NAFIPS International Conference (ed. by M. H. Smith, W. A. Gruver, and William, H. L. O’Higgins), Vancouver, Canada, 2001, 877–882.Google Scholar
  30. [30]
    Z. Pawlak, Rough sets, International Journal of Computing and Information Science, 1982, 11(5): 341–356.MATHCrossRefMathSciNetGoogle Scholar
  31. [31]
    J. Bazan, A. Skowron, and P. Synak, Dynamic reducts as a tool for extracting laws from decisions tables, in Proceedings of the 8th International Symposium on Methodologies for Intelligent Systems (ed. by G. Goos, J. Hartmanis, and J. van Leeuwen), Springer-Verlag, Berlin, 1994, 346–355.Google Scholar
  32. [32]
    R. Li and Z. Wang, Mining classification rules using rough sets and neural networks, European Journal of Operational Research, 2004, 157(2): 439–448.MATHCrossRefGoogle Scholar
  33. [33]
    V. N. Vapnik, The Nature of Statistical Learning Theory, Springer-Verlag, New York, 1995.MATHGoogle Scholar
  34. [34]
    G. Fung, S. Sandilya, and R. B. Rao, Rule extraction from linear support vector machines via mathematical programming, in Rule Extraction from Support Vector Machines (ed. by D. Joachim), Springer, Berlin, 2008, 83–107.CrossRefGoogle Scholar
  35. [35]
    Y. Li and T. Fang, Study of forecasting algorithm for support vector machines based on rough sets, Journal of Data Acquisition & Processing, 2003, 18(2): 199–203.Google Scholar
  36. [36]
    Z. Pawlak, Rough classification, International Journal of Man-Machine Studies, 1984, 20(5): 469–483.MATHCrossRefGoogle Scholar
  37. [37]
    Z. Pawlak, Rough sets, in Rough Sets and Data Mining (ed. by T. Y. Lin and N. Cercone), Kluwer, Dordrecht, 1997, 3–8.Google Scholar
  38. [38]
    Z. Pawlak, Rough Sets: Theoretical Aspects of Reasoning about Data, Kluwer, Dordrecht, 1991.MATHGoogle Scholar
  39. [39]
    R. R. Hashemi, F. R. Jelovsek, and M. Razzaghi, Developmental toxicity risk assessment: A rough set approach, International Journal of Methods of Information in Medicine, 1993, 32(1): 47–54.Google Scholar
  40. [40]
    M. Dash and H. Liu, Feature selection for classification, Intelligent Data Analysis, 1997, 1(3): 131–156.CrossRefGoogle Scholar
  41. [41]
    R. W. Swiniarski and A. Skowron, Rough set methods in feature selection and recognition, Pattern Recognition Letters, 2003, 24(6): 833–849.MATHCrossRefGoogle Scholar
  42. [42]
    N. Zhong, J. Dong, and S. Ohsuga, Using rough sets with heuristics for feature selection, Journal of Intelligent Information Systems, 2001, 16(2): 199–214.MATHCrossRefGoogle Scholar
  43. [43]
    M. Beynon, Reducts within the variable precision rough sets model: A further investigation, European Journal of Operational Research, 2001, 134(3): 592–605.MATHCrossRefGoogle Scholar
  44. [44]
    R. Slowinski, C. Zopoundis, and A. I. Dimitras, Prediction of company acquisition in Greece by means of the rough set approach, European Journal of Operational Research, 1997, 100(1): 1–15.MATHCrossRefGoogle Scholar
  45. [45]
    M. Last, A. Kandel, and O. Maimon, Information-theoretic algorithm for feature selection, Pattern Recognition Letters, 2001, 22(6–7): 799–811.MATHCrossRefGoogle Scholar
  46. [46]
    I. Guyon, J. Weston, and S. Barnhill, Gene selection for cancer classification using support vector machines, Machine Learning, 2002, 46(1–3): 389–422.MATHCrossRefGoogle Scholar
  47. [47]
    J. Brank, M. Grobelnik, N. Milic-Frayling, and D. Mladenic, Feature selection using support vector machines, in Proceeding of the 3th International Conference on Data Mining Methods and Databases for Engineering, Finance and Other Fields, Bologna, Italy, 2002, 25–27.Google Scholar
  48. [48]
    R. Felix and T. Ushio, Rule induction from inconsistent and incomplete data using rough sets, in IEEE International Conference on Systems, Man, and Cybernetics, Tokyo, 1999, 5: 154–158.Google Scholar

Copyright information

© Academy of Mathematics & Systems Science, Beijing, China 2008

Authors and Affiliations

  • Lean YU
    • 1
  • Shouyang WANG
    • 1
  • Fenghua WEN
    • 2
  • Kin Keung LAI
    • 3
  • Shaoyi HE
    • 4
  1. 1.Institute of Systems Science, Academy of Mathematics and Systems ScienceChinese Academy of SciencesBeijingChina
  2. 2.School of Economy and ManagementChangsha University of Science & TechnologyChangshaChina
  3. 3.Department of Management SciencesCity University of Hong KongKowloonHong Kong
  4. 4.Department of Information Systems and Operations Management, College of Business AdministrationCalifornia State University San MarcosSan MarcosUSA

Personalised recommendations