Abstract
In this work we propose an immune-based approach for designing of fuzzy systems. From numerical data and with membership function previously defined, the immune algorithm evolves a population of fuzzy classification rules based on the clonal selection, hypermutation and immune network principles. Once AIS are able to find multiple good solutions of the problem, accurate and diverse fuzzy systems are built in a single run. Hence, we construct an ensemble of these classifier in order to achieve better results. An ensemble of classifiers consists of a set of individual classifiers whose outputs are combined when classifying novel patterns. The good performance of an ensemble is strongly dependent of individual accuracy and diversity of its components. We evaluate the proposed methodology through computational experiments on some datasets. The results demonstrate that the performance of the obtained fuzzy systems in isolation is very good. However when we combine these systems, a significant improvement is obtained in the correct classification rate, outperforming the single best classifier.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Klir, G., Yuan, B.: Fuzzy Sets and Fuzzy Logic - Theory and Applications. Prentice Hall, Englewood Cliffs (1995)
Pedrycz, W., Gomide, F.: An Introduction to Fuzzy Sets: Analysis and Design. MIT Press, Cambridge (1998)
Cordón, O., Herrera, F., Gomide, F., Hoffmann, F., Magdalena, L.: Ten years of genetic-fuzzy systems: a current framework and new trends. In: Proceedings of Joint 9th IFSA World Congress and 20th NAFIPS International Conference, Vancouver, Canada, pp. 1241–1246 (2001)
Cordón, O., Herrera, F., Hoffmann, F., Magdalena, L.: Genetic Fuzzy Systems. Evolutionary tuning and learning of fuzzy knowledge bases. In: Advances in Fuzzy Systems: Applications and Theory, vol. 19. World Scientific, Singapore (2001)
Yuan, Y., Zhuang, H.: A genetic algorithm for generating fuzzy classification rules. Fuzzy Sets and Systems 84(4), 1–19 (1996)
Goldberg, D.E., Richardson, J.J.: Genetic algorithms with sharing for multimodal function optimization. In: Proceedings of the 2nd International Conference on Genetic Algorithms, Cambridge, pp. 41–49 (1987)
Bonissone, P., Eklund, N., Goebel, K.: Using an Ensemble of Classifiers to Audit a Production Classifier. In: Oza, N.C., Polikar, R., Kittler, J., Roli, F. (eds.) MCS 2005. LNCS, vol. 3541, pp. 376–386. Springer, Heidelberg (2005)
Dasgupta, D. (ed.): Artificial Immune Systems and Their Applications. Springer, Heidelberg (1999)
de Castro, L.N., Timmis, J.: An Introduction to Artificial Immune Systems: A New Computational Intelligence Paradigm. Springer, Heidelberg (2002)
Gomes, L.C.T., de Sousa, J.S., Bezerra, G.B., de Castro, L.N., Von Zuben, F.J.: Copt-aiNet and the Gene Ordering Problem. In: Second Brazilian Workshop on Bioinformatics, Macaé, Brazil (2003)
Hansen, L.K., Salamon, P.: Neural network ensembles. IEEE Transactions on Pattern Analysis and Machine Intelligence 12, 993–1001 (1990)
Opitz, D., Shavlik, J.: Generating accurate and diverse members of a neural network ensemble. In: Touretsky, D., Mozer, M., Hasselmo, M. (eds.) Advances in Neural Information Processing Systems, vol. 8, pp. 535–541. MIT Press, Cambridge (1996)
Cordón, O., del Jesus, M.J., Herrera, F.: A proposal on reasoning methods in fuzzy rule-based classification systems. International Journal of Approximate Reasoning 20, 21–45 (2001)
de Castro, L.N., Von Zuben, F.J.: aiNet: An Artificial Immune Network for Data Analysis. In: Abbass, H.A., Sarker, R.A., Newton, C.S. (eds.) Data Mining: A Heuristic Approach, ch. XII, pp. 231–259. Idea Group Publishing, USA (2001)
de Castro, L.N., Timmis, J.I.: An Artificial Immune Network for Multimodal Function Optimization. In: Proceedings of IEEE Congress of Evolutionary Computation, Hawaii, vol. 1, pp. 699–674 (2002)
Ada, G.L., Nossal, G.J.V.: The Clonal Selection Theory, vol. Scientific American 257(2), 50–57 (1987)
Jerne, N.K.: Towards a Network Theory of the Immune System. Ann. Immunol (Inst. Pasteur) 125C, 373–389 (1974)
Freitas, A.A.: Data Mining and Knowledge Discovery with Evolutionary Algorithms, Secaucus, NJ, USA. Springer, New York (2002)
Krogh, A., Vedelsby, J.: Neural Network Ensembles, Cross Validation, and Active Learning. In: Tesauro, G., Touretzky, D., Leen, T. (eds.) Advances in Neural Information Processing System, vol. 7, pp. 231–238. MIT Press, Cambridge (1994)
Glover, F., Laguna, M.: Tabu Search. Kluwer Academic Publishers, Dordrecht (1998)
Alves, R.T., Delgado, M.R.B., Lopes, H.S., Freitas, A.: Induction of Fuzzy Classification Rules with an Artificial Immune System. In: Proceedings of Brazilian Symposium on Neural Networks, Brazil (2004)
Camargo, H.A., Pires, M.G., Castro, P.A.D.: Genetic Design of Fuzzy Knowledge Bases - a study of different approaches. In: Proceedings of 23rd IEEE International Conference of NAFIPS, Canada, vol. 2, pp. 954–959 (2004)
Perrone, M.P., Cooper, L.N.: When networks disagree: Ensemble method for neural networks. In: Mammone, R.J. (ed.) Neural Networks for Speech and Image processing. Chapman Hall, Boca Raton (1993)
Lima, C.A.M., Coelho, A.L.V., Von Zuben, F.J.: Fuzzy Systems Design via Ensembles of ANFIS. In: Proceedings of the IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2002), Hawaii, vol. 1, pp. 506–511 (2002)
Ishibuchi, H., Yamamoto, T.: Evolutionary Multi-objective Optimization for Generating an Ensemble of Fuzzy Rule-Based Classifiers. In: Proc. of the Genetic and Evolutionary Computation Conference, USA, pp. 1077–1088 (2003)
Zhou, Z.H., Wu, J., Tang, W.: Ensembling Neural Networks: Many Could Be Better Than All. Artificial Intelligence 137(1-2), 239–263 (2002)
Blake, C.L., Merz, C.J.: UCI Repository of machine learning databases, Irvine, CA: University of California, Department of Information and Computer Science (1998), http://www.ics.uci.edu/mlearn/MLRepository.html
Ishibuchi, H., Yamamoto, T.: Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining. Fuzzy Sets and Systems 141, 59–88 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Castro, P.D., Coelho, G.P., Caetano, M.F., Von Zuben, F.J. (2005). Designing Ensembles of Fuzzy Classification Systems: An Immune-Inspired Approach. In: Jacob, C., Pilat, M.L., Bentley, P.J., Timmis, J.I. (eds) Artificial Immune Systems. ICARIS 2005. Lecture Notes in Computer Science, vol 3627. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11536444_36
Download citation
DOI: https://doi.org/10.1007/11536444_36
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28175-7
Online ISBN: 978-3-540-31875-0
eBook Packages: Computer ScienceComputer Science (R0)