Learning Fuzzy Decision Rules

  • Bernadette Bouchon-Meunier
  • Christophe Marsala
Part of the The Handbooks of Fuzzy Sets Series book series (FSHS, volume 5)

Abstract

In this chapter a review of existing methods to learn fuzzy decision rules is done. Two kinds of learning methods exist. The first kind deals with the determination of the structure of the fuzzy decision rules. Fuzzy propositions (Vk is Ak) have to be chosen to compose premises and conclusions of such rules. The second kind of method is concerned with the tuning of the membership functions associated with the fuzzy propositions that appear in premises and conclusions of a given set of fuzzy decision rules.

Keywords

Entropy Recombination Coherence Flous 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Aladenise N. and Bouchon-Meunier B., (1997). Acquisition de connaissances imparfaites: mise en évidence d’une fonction d’appartenance, Revue Internationale de Systémique, 11(1): 109–127.Google Scholar
  2. Araya R., (1994). Induction of Decision Trees when Examples are Described with Noisy Measurements and with Fuzzy Class Membership. INRIA seminar, CLOREC Project.Google Scholar
  3. Bäck T. and Kursawe F., (1994). Evolutionary Algorithms for Fuzzy Logic: a Brief Overview, Proceedings of the 5th International Conference IPMU, 659–664.Google Scholar
  4. Batur C. and Kasparian., (1991), Adaptative Approach to Implication for Approximate Reasoning with Fuzzy Logic, Fuzzy Sets and Systems, 3:193–219.Google Scholar
  5. Berenji H., (1998). Learning and Tuning Fuzzy Rules, Fuzzy Systems: Modeling and Control, Nguyen and Sugeno (eds), Chap 11, The Handbook of Fuzzy Sets, Kluwer; 291–310.Google Scholar
  6. Bezdek J., Keller J., Krishnapuram R., Pal N., (1998). Fuzzy Models and Algorithms for Pattern Recognition and Image Processing, The Handbook of Fuzzy Sets, Kluwer, to appear.Google Scholar
  7. Bothorel S., (1996). Analyse d’images par arbre de décision flou. Application à la classification sémiologique des amas de microcalcifications. PhD thesis, University P. and M. Curie, Paris, France.Google Scholar
  8. Bothorel S., Bouchon-Meunier B., and Muller S., (1997), A Fuzzy Logic Based Approach for Semiological Analysis of Microcalcifications in Mammographic Images, International Journal of Intelligent Systems, to appear.Google Scholar
  9. Botta M., Giordana A. and Saitta L., (1993). Learning Fuzzy Concept Definitions, Proceedings of the 2nd IEEE International Conference on Fuzzy Systems, San Francisco, 18–22.Google Scholar
  10. Bouchon-Meunier B., (1995). La logique floue et ses applications, Addison-Wesley.Google Scholar
  11. Bouchon-Meunier B., Marsala C. and Ramdani M., (1995). Arbres de décision et théorie des sous-ensembles flous. Actes des Sème journées du PRC-GDR d’Intelligence Artificielle, Nancy, France, 50–53.Google Scholar
  12. Bouchon-Meunier B., Marsala C. and Ramdani M., (1996). Inductive learning and fuzziness, Scientia Iranica, Int. Jour. of Science and Technology, 2(4), 289–298.MATHGoogle Scholar
  13. Bouchon-Meunier B., Marsala C. and Ramdani M., (1997). Learning from Imperfect Data. Fuzzy Set Methods in Information Engineering: a Guided Tour of Applications, Prade, Dubois and Yager (eds.), John Wiley & Sons, 139–148.Google Scholar
  14. Boyen X., (1995). Design of Fuzzy Logic-based Decision Trees Applied to Power System Transient Stability Assessment. Mémoire de fin d’études. University of Liège, Belgium.Google Scholar
  15. Boyen X. and Wehenkel L., (1995). Fuzzy Decision Tree Induction for Power System Security Assessment. Proceedings of the IFAC Control of Power Plants and Power Systems, SIPOWER’95, Cancun, Mexico, 151–156.Google Scholar
  16. Boyen X. and Wehenkel L., (1996). Automatic Induction of Continuous Decision Trees, Proceedings of the 6th Int. Conf. IPMU. Granada, Spain, 419–424.Google Scholar
  17. Breiman L., Friedman J.H., Olshen R.A. and Stone C.J., (1984). Classification and Regression Trees, Chapman and Hall, New York.MATHGoogle Scholar
  18. Castro J.L. and Zurita J.M., (1997). An Inductive Learning Algorithm in Fuzzy Systems, Fuzzy Sets and Systems, 89(2): 193–203.MathSciNetCrossRefGoogle Scholar
  19. Catlett J., (1991). On Changing Continuous Attributes into Ordered Discrete Attributes. Proceedings of EWSL-91, Lecture Notes in Artificial Intelligence 482, Springer Verlag, 164–178.MathSciNetGoogle Scholar
  20. Cios K.J. and Liu N., (1992). A Machine Learning Method for Generation of a Neural Network Architecture: a Continuous ID3 Algorithm, IEEE Transactions on Neural Networks, 3(2):280–290.CrossRefGoogle Scholar
  21. Cios K.J. and Sztandera L.M., (1992). Continuous ID3 Algorithm with Fuzzy Entropy Measures. Proceedings of the 1st IEEE Int. Conf. on Fuzzy Systems, San Diego.Google Scholar
  22. Cordón O., Herrera F. and Lozano M., (1997). A classified review on the combination fuzzy logic-genetic algorithms. Bibliography 1989-1995, Genetic Algorithms and Fuzzy Logic Systems. Soft Computing Perspectives. Sanchez, Shibata and Zadeh (eds), Advances in Fuzzy Systems series n°7, World Scientific, 209–240.Google Scholar
  23. de Campos L.M. and Moral S., (1993). Learning Rules for a Fuzzy Inference Model, Fuzzy Sets and Systems, 59(3):247–257.MathSciNetMATHCrossRefGoogle Scholar
  24. De Luca A. and Termini S., (1972). A Definition of Non-probabilistic Entropy in the Settings of Fuzzy Sets Theory, Information and Control, 20:301–312.MathSciNetMATHCrossRefGoogle Scholar
  25. Delgado M. and Gonzalez A., (1993). An Inductive Learning Procedure to Identify Fuzzy Systems, Fuzzy Sets and Systems, 55(2):121–132.MathSciNetCrossRefGoogle Scholar
  26. Delgado M., Gómez-Skarmeta A.F. and Martin F., (1997). A Fuzzy Clustering-Based Rapid Prototyping fo Fuzzy Rule-Based Modeling, IEEE Transactions on Fuzzy Systems, 5(2):223–233.CrossRefGoogle Scholar
  27. Fagarasan F. and Negoita M.G., (1996). A Genetic Algorithm with Variable Length Geotypes, Applications in Fuzzy Modeling, Proceedings of the 4th European Conference EUFIT, Aachen, Germany, 405–409.Google Scholar
  28. Fayyad U.M., Piatetsky-Shapiro G. and Smyth P. (1996). From Data Mining to Knowledge Discovery in Databases, AI Magazine, 17(3), 37–54.Google Scholar
  29. Geyer-Schultz A., (1997). Fuzzy Rule-based Expert Systems and Genetic Machine Learning, Physica-Verlag, Heidelberg.Google Scholar
  30. Geyer-Schultz A., (1998). Fuzzy Genetics Algorithms, Fuzzy Systems: Modeling and Control, Nguyen and Sugeno (eds), chap. 11, The Handbook of Fuzzy Sets, Kluwer, 403–460.Google Scholar
  31. Guély F., (1994). Apprentissage de bases de règles floues: Contribution à une étude systématique de l’approche de l’optimisation, PhD thesis, Ecole Centrale de Paris.Google Scholar
  32. Hall L.O. and Lande P., (1997). Generating Fuzzy Rules from Decision Trees, Proceedings of the 7th IFSA World Congress, Prague, 418–423.Google Scholar
  33. Heider H., Tryba V. and Mühlenfeld E., (1994). Automatic design of fuzzy systems by genetic algorithms, Proceedings of the 5th International Conference IPMU. 665–670.Google Scholar
  34. Hong T.-P. and Lee C.-Y., (1996). Induction of Fuzzy Rules and Membership Functions from Training Examples, Fuzzy Sets and Systems, 84:33–47.MathSciNetMATHCrossRefGoogle Scholar
  35. Hu X. And Cercone N., (1995). Rough Sets Similarity-Based Learning from Databases, Proceedings of the 1st Int. Conf. On Knowledge Discovery and Data Mining, Montréal, Canada, 162–167.Google Scholar
  36. Ichihashi H., Shirai T., Nagasaka K. and Miyoshi T., (1996). Neuro-fuzzy ID3: a Method of Inducing Fuzzy Decision Trees with Linear Programming for Maximizing Entropy and an Algebraic Method for Incremental Learning. Fuzzy Sets and Systems, 81(1): 157–167.MathSciNetCrossRefGoogle Scholar
  37. Jang J.-S. R., (1994). Structure Determination in Fuzzy Modeling: a Fuzzy CART Approach. Proceedings of the 3rd IEEE Int. Conf. on Fuzzy Systems, Orlando, 480–485.Google Scholar
  38. Janikow C. Z., (1994). Fuzzy Decision Trees: FIDMV. Proceedings of the Joint Conference on Information Science JCIS’94, Pinehurst, USA, 232–235.Google Scholar
  39. Kacprzyk J. and Iwanski C., (1992). Fuzzy Quantifiers in Inductive Learning with Perception of Errors in Data, Proceedings of the 1st IEEE Int. Conf. on Fuzzy Systems, San Diego, 477–484.Google Scholar
  40. Kacprzyk J. and Iwanski C., (1992b). Learning from Erroneous Examples Using Fuzzy Logic and “ Textbook ” Knowledge, IPMU’92 — Advanced Methods in Artificial Intelligence. Bouchon-Meunier, Valverde and Yager (eds), Springer Verlag, 183–191.Google Scholar
  41. Krishnapuram, R., (1994). Generation of Membership Functions via Possibilistic Clustering, Proceedings of the third IEEE Int. Conf. on Fuzzy Systems. IEEE World Congress on Computational Intelligence — vol. 2, 902–908.CrossRefGoogle Scholar
  42. Kuncheva L.I. and Bezdek C. J., (1997). A Fuzzy Generalized Nearest Prototype Classifier, Proceedings of the 7th IFSA World Congress, Prague, 217–222.Google Scholar
  43. Kosko B., (1997). Fuzzy Engineering, Prentice-Hall Inc.Google Scholar
  44. Maeda A., Someya R. and Funabashi M., (1991). A Self-Tuning Algorithm for Fuzzy Membership Functions Using Computational Flow Network, Proceedings of the IFSA World Congress, Bruxelles, volume Artificial Intelligence, 129–132.Google Scholar
  45. Maher P.E., Saint-Clair D., (1993). Uncertain Reasoning in an ID3 Machine Learning Framework. Proceedings of the 2nd IEEE Int. Conf. on Fuzzy Systems, FUZZ-IEEE, 7–12.Google Scholar
  46. Marsala C., and Bouchon-Meunier B., (1996). Fuzzy partitioning using mathematical morphology in a learning scheme, Proceedings of the 5th IEEE Int. Conf. on Fuzzy Systems, New Orleans, 1512–1517.Google Scholar
  47. Marsala C., (1998). Apprentissage inductif en présence de données imprécises: Construction et utilisation d’arbres de décisions flous, PhD thesis, University P. and M. Curie, Paris, France. Published as LIP6 report n° 1998/014.Google Scholar
  48. Marsala C., Ramdani M., Tollabi M. and Zackarya D., (1998). Recognition of Odors: a Fuzzy Decision Tree Approach. Proceedings of the 7th Int. Conf. IPMU, Paris, France, 532–539.Google Scholar
  49. Narazaki H. and Ralescu A.L., (1992). A Method for Inducing Category Membership Function from Examples, Proceedings of the International Conference IPMU’92, Palma de Mallorca, Spain.Google Scholar
  50. Narazaki H. and Ralescu A.L., (1994). An Alternative Method for inducing a membership function of a category, International Journal of Approximate Reasoning, 11(l):l–28.Google Scholar
  51. Pawlack Z. (1996). Rough Sets-Present State and Perspectives. Proceedings of the 6th Int. Conf. IPMU. Granada, Spain, 1137–1145.Google Scholar
  52. Pedrycz W., (1984). Identification in Fuzzy Systems, IEEE Trans. Systems, Man and Cybernetics, 14:361–366.MathSciNetMATHCrossRefGoogle Scholar
  53. Pedrycz W., Hirota K. and Takagi T., (1991). Fuzzy associative memories: concepts, architectures and algorithms, Proceedings of IFES’91, Yokohama, 1991, 163–174.Google Scholar
  54. Picard C.-F., (1972). Graphes et questionnaires, tome 2, Gauthier-Vilars, Paris.MATHGoogle Scholar
  55. Picard C.-F., (1980). Graphs and questionnaires. North Holland.Google Scholar
  56. Plaza E., Alsina C., Lopez de Mantaras R., Aguilar J., Agusti J., (1986). Consensus and knowledge acquisition, Proceedings of the fifth international conference IPMU. Information Processing and Management of Uncertainty in Knowledge-Based Systems, 294–306.Google Scholar
  57. Procyk T.J., and Mamdani E.H., (1979). A Linguistic Self-Organizing Process Controller, Automatica, 15: 15–30.MATHCrossRefGoogle Scholar
  58. Quinlan J.R., (1986). Induction of decision trees, Machine Learning, 1(1), 86–106.Google Scholar
  59. Quinlan J.R., (1993). C4.5: Program for machine learning. Morgan Kaufmann, San Mateo, Ca.Google Scholar
  60. Ramdani M., (1992). Une approche floue pour traiter les valeurs numériques en apprentissage. Actes des Journées Francophones d’Apprentissage et d’Explication des Connaissances, Dourdan, France.Google Scholar
  61. Ramdani M., (1994). Système d’induction formelle à base de connaissances imprécises. PhD thesis, University P. and M. Curie, Paris, France. Published as LAFORIA-IBP report n°TH94/l.Google Scholar
  62. Rifqi M., (1996). Mesures de comparaison, typicalité et classification d’objets flous: théorie et pratique. PhD thesis, University, and M. Curie, Paris, France. Published as LAFORIA-IBP report n°TH96/15.Google Scholar
  63. Sanchez E., Shibata T., Zadeh L.A. (1997) Genetic algorithms and fuzy logic systems, Soft Computing Perspectives, World Scientific.Google Scholar
  64. Shibata T., Abe T., Tanie K. and Nose M., (1995). Motion Planning of a Redundant Manipulator Based on Criteria of Skilled Operators using Fuzzy ID3 and GMDH. Proceedings of the 6th IFSA World Congress, São Paulo, Brazil, 613–616.Google Scholar
  65. Shibata T., (1997). Skill Acquisition and Skill-based Motion Planning for Hierarchical Intelligent Control of a Redundant Manipulator, Genetic Algorithms and Fuzzy Logic Systems. Soft Computing Perspectives. Sanchez, Shibata and Zadeh (eds), Advances in Fuzzy Systems series n°7, World Scientific, 19–35.Google Scholar
  66. Shi-Zhong He, Shaohua Tan, Chang-Chieh Hang, and Pei-Zhuang Wang, (1993) Control of Dynamical Processes using an on-line Rule-Adaptative Fuzzy Control System, Fuzzy Sets and Systems, 54:11–22.MathSciNetCrossRefGoogle Scholar
  67. Smith S.M. and Comer DJ., (1991). Automated Calibration of a Fuzzy Logic Controller using a Cell State Space Algorithm, IEEE Control Systems Mag., August, 18–28.Google Scholar
  68. Sugeno M., (1985). An Introductory Survey of Fuzzy Control, Information Science, 36:59–83.MathSciNetMATHCrossRefGoogle Scholar
  69. Sugeno M. and Murakami K., (1985). An Experimental Study on Fuzzy Parking Control Using a Model of Car, In Sugeno (eds), Industrial Applications of Fuzzy Control, Elsevier Science Pub., North Holland, 125–138.Google Scholar
  70. Sugeno M. and Takagi T., (1983). A New Approach to Design of Fuzzy Controller, In P.P. Wang, S.K. Chang (dir.), Advances in Fuzzy sets, possibility theory and applications, Plenum, New York.Google Scholar
  71. Takagi T. and Sugeno M., (1985). Fuzzy Identification of Systems and its Applications to Modeling and Control, IEEE Trans. Systems, Man and Cybernetics, 15(1):116–132.MATHCrossRefGoogle Scholar
  72. Umano M., Okamoto H., Hatono I., Tamura H., Kawachi F., Umedzu S. and Kinoshita J., (1994). Fuzzy Decision Trees by Fuzzy ID3 algorithm and its application to diagnosis systems. Proceedings of the 3rd IEEE Int. Conf. on Fuzzy Systems, Orlando, 2113–2118.Google Scholar
  73. Weber R., (1992). Fuzzy-ID3: a Class of Methods for Automatic Knowledge Acquisition, Proceedings of the 2nd Int. Conf. on Fuzzy Logic, Iizuka, 265–268.Google Scholar
  74. Wehenkel L., (1996). On Uncertainty Measures used for Decision Tree Induction. Proceedings of the 6th Int. Conf IPMU. Granada, Spain, 413–418.Google Scholar
  75. Wehenkel L., (1997). Discretization of continuous attributes for supervised learning. Variance evaluation and variance reduction. Proceedings of the 7th IFSA World Congress, Prague, 381–388.Google Scholar
  76. Yager R.R. and Filev D.P., (1994). Essentials of Fuzzy Modeling and Control, John Wiley.Google Scholar
  77. Yuan Y. and Shaw M.J., (1995). Induction of Fuzzy Decision Trees, Fuzzy Sets and Systems, 69:125–139.MathSciNetCrossRefGoogle Scholar
  78. Zadeh L.A., (1968). Probability Measures of Fuzzy Events. Journal of Mathematical Analysis Applications., 23.Google Scholar
  79. Zadeh L. A., (1982). A note on prototype theory and fuzzy sets, Cognition, 12:291–297.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 1999

Authors and Affiliations

  • Bernadette Bouchon-Meunier
    • 1
  • Christophe Marsala
    • 1
  1. 1.LIP6Université Pierre et Marie Curie, Case 169Paris Cedex 5France

Personalised recommendations