Hybrid Artificial Immune Algorithm and CMAC Neural Network Classifier for Supporting Business and Medical Decision Making

  • Jui-Yu Wu
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7121)

Abstract

Decision making that involves credit scoring and medical diagnosis can be considered to solve classification problems. Among the many data miming (DM) methods that have been developed to solve these classification problems are neural network (NN) and support vector machine (SVM) classifiers. Despite their successful application to classification problems, these classifiers are limited, in that users must use trial-and error to modify specific parameter settings. Fortunately, the setting of the parameters for those classifiers can be viewed as an unconstrained global optimization problem. To overcome this limitation of those classifiers, this work develops an advanced DM method that combines an artificial immune algorithm (AIA) and a MIMO cerebellar model articulation controller NN (CMAC NN) classifier (AIA-MIMO CMAC NN classifier). The AIA is a stochastic global optimization method and its parameters are easily set. The proposed CMAC NN classifier is characterized by its fast learning, reasonable generalization ability and robust noise resistance. The proposed AIA-MIMO CMAC NN classifier uses an outer AIA to optimize the parameter settings of an inner MIMO CMAC NN classifier, which is used to solve classification problems. The performance of the proposed classifier is also evaluated using a set of real-world classification problems, such as credit scoring and medical diagnosis. Moreover, this work compares the numerical results obtained using the proposed AIA-MIMO CMAC NN classifier with those obtained using published classifiers (such as SVM, SVM-based classifiers, NN classifiers and C4.5). Experimental results indicate that the classification accuracy of the proposed AIA-MIMO CMAC NN classifier is superior to those of some published classifiers. Hence, the AIA-MIMO CMAC NN classifier can be viewed an alternative DM method for supporting business and medical decision making.

Keywords

data mining classification artificial immune algorithm neural network classifier cerebellar model articulation controller 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Mitra, S., Pal, S.K., Mitra, P.: Data Mining in Soft Computing Framework: A Survey. IEEE Transactions on Neural Networks 13(1), 3–14 (2002)CrossRefGoogle Scholar
  2. 2.
    Zadeh, L.A.: Fuzzy Logic, Neural Networks, and Soft Computing. Communications of the ACM 37(3), 77–84 (1994)CrossRefGoogle Scholar
  3. 3.
    Konar, A.: Computational Intelligence-Principles, Techniques and Applications. Springer, New York (2005)MATHGoogle Scholar
  4. 4.
    Poorzahedy, H., Rouhani, O.M.: Hybrid Meta-Heuristic Algorithms for Solving Network Design Problem. European Journal of Operational Research 182(2), 578–596 (2007)CrossRefMATHGoogle Scholar
  5. 5.
    Valdez, F., Melin, P., Castillo, O.: An Improved Evolutionary Method with Fuzzy Logic for Combining Particle Swarm Optimization and Genetic Algorithms. Applied Soft Computing 11(2), 2625–2632 (2011)CrossRefGoogle Scholar
  6. 6.
    Abd-El-Wahed, W.F., Mousa, A.A., El-Shorbagy, M.A.: Integrating Particle Swarm Optimization with Genetic Algorithms for Solving Nonlinear Optimization Problems. Journal of Computational and Applied Mathematics 235(5), 1446–1453 (2011)CrossRefMATHGoogle Scholar
  7. 7.
    Kuo, R.J., Han, Y.S.: A Hybrid of Genetic Algorithm and Particle Swarm Optimization for Solving Bi-Level Linear Programming Problem - A Case Study on Supply Chain Model. Applied Mathematical Modelling 35(8), 3905–3917 (2011)CrossRefMATHGoogle Scholar
  8. 8.
    Huang, C.L., Chen, M.C., Wang, C.J.: Credit Scoring with a Data Mining Approach Based on Support Vector Machines. Expert Systems with Applications 33(4), 847–856 (2007)CrossRefGoogle Scholar
  9. 9.
    Mitra, S., Acharya, T.: Data Mining—Multimedia, Soft Computing, and Bioinformatics. Wliey and Sons, New Jersey (2003)Google Scholar
  10. 10.
    Olafsson, S., Li, X., Wu, S.: Operations Research and Data Mining. European Journal of Operational Research 187(3), 1429–1448 (2008)CrossRefMATHGoogle Scholar
  11. 11.
    Tsai, C.F., Wu, J.W.: Using Neural Network Ensembles for Bankruptcy Prediction and Credit Scoring. Expert Systems with Applications 34(4), 2639–2649 (2008)CrossRefGoogle Scholar
  12. 12.
    Wang, S.J., Mathew, A., Chen, Y., Xi, L.F., Ma, L., Lee, J.: Empirical Analysis of Support Vector Machine Ensemble Classifiers. Expert Systems with Applications 36(3), Part 2, 6466–6476 (2009)Google Scholar
  13. 13.
    Min, J.H., Lee, Y.C.: Bankruptcy Prediction Using Support Vector Machine with Optimal Choice of Kernel Function Parameters. Expert Systems with Applications 28(4), 603–614 (2005)CrossRefGoogle Scholar
  14. 14.
    Wu, J.Y.: MIMO CMAC Neural Network Classifier for Solving Classification Problems. Applied Soft Computing 11(2), 2326–2333 (2011)CrossRefGoogle Scholar
  15. 15.
    Wu, J.Y., Tseng, Y.H.: Evaluating Credit Risk via A MIMO CMAC Neural Network Classifier-Based Data Mining Approach. In: 2011 The 3rd International Conference on Machine Learning and Computing, pp. 147-151 (2011)Google Scholar
  16. 16.
    Asuncion, A., Newman, D.J.: UCI Machine Learning Repository. University of California, Department of Information and Computer Science (2007), http://www.ics.uci.edu/~mlearn/mlrepository.html
  17. 17.
    West, D., Dellana, S., Qian, J.: Neural Network Ensemble Strategies for Financial Decision Applications. Computers & Operations Research 32(10), 2543–2559 (2005)CrossRefMATHGoogle Scholar
  18. 18.
    Prechelt, L.: Proben1 - A Set of Neural Network Benchmark Problems and Benchmarking Rules. Universität Karlsruhe (1994)Google Scholar
  19. 19.
    de Falco, I., Cioppa, A.D., Tarantino, E.: Discovering Interesting Classification Rules with Genetic Programming. Applied Soft Computing 1(4), 257–269 (2002)CrossRefGoogle Scholar
  20. 20.
    Brameier, M., Banzhaf, W.: A Comparison of Linear Genetic Programming and Neural Networks in Medical Data Mining. IEEE Transactions on Evolutionary Computation 5(1), 17–26 (2001)CrossRefMATHGoogle Scholar
  21. 21.
    Zhu, F., Guan, S.: Feature Selection for Modular GA-Based Classification. Applied Soft Computing 4(4), 381–393 (2004)CrossRefGoogle Scholar
  22. 22.
    Wu, J.Y.: Solving Constrained Global Optimization via Artificial Immune System. International Journal on Artificial Intelligence Tools 20(1), 1–27 (2011)CrossRefGoogle Scholar
  23. 23.
    Houck, C.R., Joines, J.A., Kay, M.G.: A Genetic Algorithm for Function Optimization: A Matlab Implementation. North Carolina State Univ., Raleigh (1995)Google Scholar
  24. 24.
    de Castro, L.N., Von Zuben, F.J.: Artificial Immune Systems: Part I- Basic Theory and Applications. FEEC/Univ. Campinas, Campinas, Brazil (1999), ftp://ftp.dca.fee.unicamp.br/pub/docs/vonzuben/tr_dca/trdca0199.pdf
  25. 25.
    Michie, D., Spiegelhalter, D.J., Taylor, C.C.: Machine Learning, Neural, and Statistical Classification. Ellis Horwood, London (1994)MATHGoogle Scholar
  26. 26.
    Sakprasat, S., Sinclair, M.C.: Classification Rule Mining for Automatic Credit Approval Using Genetic Programming. In: IEEE Congress on Evolutionary Computation, pp. 548–555 (2007)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Jui-Yu Wu
    • 1
  1. 1.Department of Business AdministrationLunghwa University of Science and TechnologyTaiwan

Personalised recommendations