On Rule Learning Methods: A Comparative Analysis of Classic and Fuzzy Approaches

  • Marcos E. Cintra
  • Maria C. Monard
  • Heloisa A. Camargo
Part of the Studies in Fuzziness and Soft Computing book series (STUDFUZZ, volume 291)


Classification is an important task widely researched by the machine learning and fuzzy communities. In this paper, we present and compare methods from both communities, in order to support the selection of a suitable method, according to two conflicting objectives: accuracy × interpretability. Two groups of rule-based methods are analysed: decision tree-based and genetic-based approaches. For the tree-based approaches, C4.5, PART and FuzzyDT, a fuzzy version of the C4.5 algorithm, are used. For the genetic-based approaches, MPLCS, a method from the machine learning community to generate rule-based models, SLAVE and FCA-Based, both fuzzy-based, are analysed. Since accuracy and interpretability are usually conflicting objectives, in this paper, we briefly present these methods and then discuss the models generated by them. Comparisons take into account the error rates and syntactic complexity of the produced models. Ten benchmark datasets are used in the experiments with a 10 fold cross-validation strategy. Results show that FCA-Based and MPLCS are able to obtain good accuracy and interpretability.


Fuzzy Systems Decision Trees Genetic Algorithms 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Quinlan, J.R.: C4.5: Programs for Machine Learning (Morgan Kaufmann Series in Machine Learning), 1st edn. Morgan Kaufmann (January 1993)Google Scholar
  2. 2.
    Quinlan, J.R.: Bagging, Boosting and C4.5. In: Proc. of the 13th Conf. on Artificial Intelligence, pp. 725–730 (1996)Google Scholar
  3. 3.
    Frank, E., Witten, I.H.: Generating accurate rule sets without global optimization. In: ICML 1998: Proceedings of the 15th Int. Conf. on Machine Learning, pp. 144–151. Morgan Kaufmann (1998)Google Scholar
  4. 4.
    Ishibuchi, H., Yamamoto, T.: Rule weight specification in fuzzy rule-based classification systems. IEEE Transactions on Fuzzy Systems 13, 428–435 (2005)CrossRefGoogle Scholar
  5. 5.
    Nakashima, T., Schaefer, G., Yokota, Y., Ishibuchi, H.: A weighted fuzzy classifier and its application to image processing tasks. Fuzzy Sets and Systems 158, 284–294 (2007)MathSciNetCrossRefGoogle Scholar
  6. 6.
    Mansoori, E., Zolghadri, M., Katebi, S.: Sgerd: A steady-state genetic algorithm for extracting fuzzy classification rules from data. IEEE Transactions on Fuzzy Systems 16(4), 1061–1071 (2008)CrossRefGoogle Scholar
  7. 7.
    Cintra, M.E., Camargo, H.A.: Fuzzy rules generation using genetic algorithms with self-adaptive selection. In: IEEE International Conference on Information Reuse and Integration - IRI, pp. 261–266 (2007)Google Scholar
  8. 8.
    Cintra, M.E., Monard, M.C., Camargo, H.A., Martin, T.P.: A hybrid approach for the automatic generation of fuzzy systems using fuzzy formal concepts. In: 2012 IEEE International Conference on Fuzzy Systems, FUZZ-IEEE 2012 (accepted for publication, 2012)Google Scholar
  9. 9.
    Olaru, C., Wehenkel, L.: A complete fuzzy decision tree technique. Fuzzy Sets and Systems 138(2), 221–254 (2003)MathSciNetCrossRefGoogle Scholar
  10. 10.
    Cintra, M.E., Monard, M.C., Camargo, H.A.: An evaluation of rule-based classification models induced by a fuzzy method and two classic learning algorithms. In: The Brazilian Symposium on Artificial Neural Network (SBRN), vol. 1, pp. 188–193 (2010)Google Scholar
  11. 11.
    Ahmadizar, F., Soltanpanah, H.: Reliability optimization of a series system with multiple-choice and budget constraints using an efficient ant colony approach. Expert Systems with Applications 38(4), 3640–3646 (2011)CrossRefGoogle Scholar
  12. 12.
    Marinaki, M., Marinakis, Y., Stavroulakis, G.E.: Fuzzy control optimized by a multi-objective particle swarm optimization algorithm for vibration suppression of smart structures. Struct. and Multidisciplinary Optimization 43(1), 29–42 (2011)MathSciNetCrossRefGoogle Scholar
  13. 13.
    Prakash, A., Deshmukh, S.: A multi-criteria customer allocation problem in supply chain environment: An artificial immune system with fuzzy logic controller based approach. Expert Systems with Applications 38(4), 3199–3208 (2011)CrossRefGoogle Scholar
  14. 14.
    Angelov, P.P.: An evolutionary approach to fuzzy rule-based model synthesis using indices for rules. Fuzzy Sets and Systems 137, 325–338 (2003)MathSciNetMATHCrossRefGoogle Scholar
  15. 15.
    Chiou, Y., Lan, L.W.: Genetic fuzzy logic controller: an iterative evolution algorithm with new encoding method. Fuzzy Sets and Systems 152, 617–635 (2005)MathSciNetMATHCrossRefGoogle Scholar
  16. 16.
    Gonzalez, A., Perez, R.: Selection of relevant features in a fuzzy genetic learning algorithm. IEEE Transactions on Systems and Man and and Cybernetics and Part B: Cybernetics 31(3), 417–425 (2001)CrossRefGoogle Scholar
  17. 17.
    Cintra, M.E., Camargo, H.A.: Feature Subset Selection for Fuzzy Classification Methods. In: Hüllermeier, E., Kruse, R., Hoffmann, F. (eds.) IPMU 2010. CCIS, vol. 80, pp. 318–327. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  18. 18.
    Mitchell, T.M.: Machine Learning. McGraw-Hill (1997)Google Scholar
  19. 19.
    Wille, R.: Restructuring lattice theory: An approach based on hierarchies of concepts. In: Rivals, I. (ed.) Ordered Sets, vol. 23, pp. 445–470 (1982)Google Scholar
  20. 20.
    Wang, X.Z., Wang, Y.D., Xu, X.F., Ling, W.D., Yeung, D.S.: A new approach to fuzzy rule generation: fuzzy extension matrix. Fuzzy Sets and Systems 123, 291–306 (2001)MathSciNetMATHCrossRefGoogle Scholar
  21. 21.
    Bacardit, J., Krasnogor, N.: Performance and efficiency of memetic pittsburgh learning classifier systems. Evolutionary Computation 17(3), 307–342 (2009)CrossRefGoogle Scholar
  22. 22.
    Chen, M.S., Wang, S.W.: Fuzzy clustering analysis for optimizing membership functions. Fuzzy Sets and Systems 103, 239–254 (1999)CrossRefGoogle Scholar
  23. 23.
    Frank, A., Asuncion, A.: UCI machine learning repository (2010)Google Scholar
  24. 24.
    Bull, L., Bernadó-Mansilla, E., Holmes, J.: Learning Classifier Systems in Data Mining. Springer (2008)Google Scholar
  25. 25.
    Demsar, J.: Statistical comparison of classifiers over multiple data sets. Journal of Machine Learning Research 7(1), 1–30 (2006)MathSciNetMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Marcos E. Cintra
    • 1
  • Maria C. Monard
    • 1
  • Heloisa A. Camargo
    • 2
  1. 1.Mathematics and Computer Science InstituteUniversity of Sao Paulo (USP)Sao CarlosBrazil
  2. 2.Computer Science DepartmentFederal University of Sao CarlosSao CarlosBrazil

Personalised recommendations