Abstract
The learning algorithms can be an useful tool for helping to the humans to understand the behavior of phenomena from a set of samples. In particular, those algorithms that represent the knowledge obtained by linguistic fuzzy rules are appropriate for this task. However, it is not sufficient that the knowledge representation is close to the humans comprehension. Furthermore, it is necessary that the knowledge is expressed as simple as possible.
In this chapter, we classify some techniques, models and tools for improving the knowledge obtained by inductive linguistic rule learning algorithms from three different points of view: those that increase the knowledge interpretability, those that increase the knowledge accuracy keeping its interpretability and those that simultaneously increase the accuracy and interpretability of the knowledge.
In this study, we have considered fuzzy rules expressed by the Disjunctive Normal Form (DNF).
This work has been supported by the CICYT under Project TAP99-0535-C02-01
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Aguirre E., Gonzalez A., Pérez R. (2001) A feature selection model for learning algorithms based on Pittsburgh approach (in Spanish). Accepted in First Spanish Congress of Evolutionary and Bio-inspired Algorithms, Merida, Spain.
Aha D.W., Bankert R.L. (1996) A comparative evaluation of sequential feature selection algorithms. Artificial Intelligence and Statistical V (D. Fisher and J-H Lens eds), Springer, New York.
Alcalá R., Casillas J., Castro J.L., Gonzalez A., Herrera F. (2001) A multicriteria genetic tuning for fuzzy logic controllers. Mathware and Soft Computing, 8(2), 179–201.
Alcalá R., Benftez J.M., Casillas J., Cordon O., Pérez R., Fuzzy Control of HVAC Systems Optimized by Genetic Algorithms. Accepted in Applied Intelligence.
Almuallin H., Dietterich T.G. (1992) Learning with many irrelevant features. Proc. 9th National Conference on Artificial Intelligence, MIT Press, Massachusetts, 547–552.
Blum A.L., Langley P. (1997) Selection of relevant features and examples in machine learning. Artificial Intelligence, 97, 245–271.
Bobrowski L. (1988) Feature selection based on some homogeneity coefficient. Proc. 9th International Conference on Patter Recognition, 544–546.
Bouchon-Meunier B., Jia Y. (1992) Linguistic modifiers and imprecise categories. Internation Journal of Intelligent Systems, 7, 25–36.
Breiman L, Friedman J.H., Olshen RA., Stone C.J. (1984) Classification and Regression Trees. Wadsworth Belmont, CA.
Castillo L., Gonzalez A., Pérez R. (2001) Including a simplicity criterion in the selection of the best rule in a genetic fuzzy learning algorithm. Fuzzy Sets and Systems, 120(2), 309–321.
Cardie C. (1993) Using decision trees to improve case-based learning. Proc. 10th International Conference on Machine Learning, 25–32.
Clark P., Niblett T. (1986) Learning if-then rules in noisy domains. TIRM 86–019, The turing institute, Glasgow, (1986).
Cordon O., Herrera F. (1997) A three-stage evolutionary process for learning descriptive and approximate fuzzy-logic-controller knowledge bases from examples,. International Journal of Approximate Reasoning, 17, 369–407.
Cordon O., del Jesús M.J., Herrera F. (1998) Genetic learning of fuzzy rulebased classification systems cooperating with fuzzy reasoning methods. International Journal of Intelligence Systems, 13, 1025–1053.
De Jong K.A., Spears W.M., Gordon D.F. (1993) Using Genetic Algorithms for Concept Learning. Machine Learning, 13, 161–188.
Fensel D., Wiese M. (1993) Refinement of Rule Sets with JoJo. Lectures Notes in Artificial Intelligence, 677, 378–383.
Foroutan I., Sklansky J. (1987) Feature selection for automatic classification of non-gaussian data. IEEE Transactions on Systems, Man and Cybernetics, 17(2), 187–198.
Gonzalez A., Pérez R., Verdegay J.L. (1994) Learning the structure of a fuzzy rule: a genetic approach. Fuzzy Systems and Artificial Intelligence, 3(1), 57–70.
Gonzalez A. (1995) A learning methodology in uncertain and imprecise environment. International Journal of Intelligence Systems, 19, 357–371.
Gonzalez A., Herrera F. (1997) Multi-stage Genetic Fuzzy Systems Based on the Iterative Rule Learning Approach. Mathware and Soft Computing, 4(3), 233–249.
Gonzalez A., Pérez R. (1998) Completeness and consistency conditions for learning fuzzy rules. Fuzzy Set and Systems, 96(1), 37–51.
Gonzalez A., Pérez R. (1998) A fuzzy theory refinement algorithm. International Journal of Approximate Reasoning, 19, 193–200.
Gonzalez A., Pérez R. (1999) SLAVE: A genetic learning system base on an iterative approach. IEEE Transaction on Fuzzy Systems, 7(2), 176–191.
Gonzalez A., Pérez R. (1999) A study about the inclusion of linguistic hedges in a fuzzy rule learning algorithm. International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 7(3), 257–266.
Gonzalez A., Pérez R. (2001) Selection of relevant features in fuzzy genetic learning algorithm. IEEE Transaction on Systems, Man and Cybernetics, 31(3), 417–425.
Janikow C.Z. (1993) A Knowledge-intensive Genetic Algorithm for Supervised Learning. Machine Learning, 13, 189–228.
Kira K., Rendell L.A. (1992) The feature selection problem: Traditional methods and a new algorithm. Proc. 9th National Conference on Artificial Intelligence, 129.
Kohavi R., John G.H. (1997) Wrapper for feature subset selection. Artificial Intelligence, 97, 273–324.
Koller D., Sahami M. (1996) Toward optimal feature selection. Proc. 13th International Conference on Machine Learning.
Kononenko I. (1994) Estimating attributes: Analysis and extension of RELIEF. Proc. European Conference on Machine Learning, 171–182.
Kullback S. (1968) Information theory and statistics. New York: Dover.
Lakoff G. (2001) Hedges: a study in meaning criteria and the logic of fuzzy modeling. Fuzzy Sets and Systems, 123(3), 343–358.
Langley P., Sage S. (1994) Oblivious decision trees and abstract cases. Working notes of the AAAI-94, 113–117.
Liu B.D., Chen C.Y., Tsao J.Y. (2001) Design of adaptive fuzzy logic controller based on linguistic-hedge concepts and genetic algorithms. IEEE Transaction on Systems, Man and Cybernetics Part B, 31(1), 32–53.
Liu H., Setiono R. (1996) A probabilistic approach to feature selection- a filter solution. Proc. International Conference on Machine Learning, 319–327.
Magdalena L. (1997) Adapting the Gain of an FLC with Genetic Algorithms. International Journal of Approximate Reasoning, 17, 327–349.
Magdalena L., Monasterio F. (1997) A Fuzzy Logic Controller with Learning Through the Evolution of its Knowledge Base. International Journal of Approximate Reasoning, 16, 335–358.
Mamdani E.H. (1974) Applications of fuzzy algorithms for control a simple dynamic plant. Proceedings of the IEEE 121, 1585–1588.
Michalski R.S. (1981) Theory and Methodology of inductive learning. Machine Learning: An artificial intelligence approach, 33–56.
Moore A.W., Lee M.S. (1994) Efficient algorithms for minimizing cross validation error. Proc. 11th International Conference on Machine Learning, 190–198.
Mucciardi AN., Gose E.E. (1971) A comparison of sever techniques for choosing subset of patter recognition. IEEE Transactions on Computers, C–20, 1023–1031.
Ourston D., Mooney R.J. (1994) Theory refinement combining analytical and empirical methods. Artificial Intelligence, 66, 273–309.
Pérez R. (1997) Learning fuzzy rules using genetic algorithms (in Spanish). PhD dissertation, Dpto. Ciencias de la Computación e Inteligencia Artificial, Universidad de Granada (Spain).
Quinlan J.R. (1993) C4.5: Programs for machine learning. Morgan Kaufmann, San Mateo, CA.
Rissanen J. (1978) Modeling by shortest data description. Automatica, 14, 465–471.
Schlimmer J.C. (1993) Efficiently inducing determinations: A complete and systematic search algorithm that uses optimal pruning. Proc. 10th International Conference on Machine Learning, (P. B. Brazdil, ed), 284–290.
Segen J. (1984) Feature selection and constructive inference. Proc. 7th International Conference on Patter Recognition, 1344–1346.
Sheinvald J., Dom B., Niblack W. (1990) A modeling approach to feature selection. Proc. 10th International Conference on Patter Recognition, 1, 535–539.
Townsend-Weber T., Kibler D. (1994) Instance-based prediction of continuous values. Working notes of the AAAI-94, Workshop on Case-Based Reasoning, Seattle, WA, 30–35.
Venturini G. (1993) SIA: a Supervised Inductive Algorithm with Genetic Search for Learning Attributes based Concepts. Machine Learning: ECML-93,280–296.
Xu L., Yan P., Chang T. (1988) Best first strategy for feature selection. Proc 9th International Conference on Patter Recognition, 706–708.
Zadeh L.A. (1972) A fuzzy-set theoretic interpretation of linguistic hedges. Journal of Cybernetics, 2(2), 4–34.
Zadeh L.A. (1975) The concept of a linguistic variable and its applications to approximate reasoning. Part I Information Sciences, 8, 199–249.
Zadeh L.A. (1975) The concept of a linguistic variable and its applications to approximate reasoning. Part II Information Sciences, 8, 301–357,
Zadeh L.A. (1975) The concept of a linguistic variable and its applications to approximate reasoning. Part III Information Sciences, 9, 43–80.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Aguirre, E., Gonzalez, A., Pérez, R. (2003). A description of several characteristics for improving the accuracy and interpretability of inductive linguistic rule learning algorithms. In: Casillas, J., Cordón, O., Herrera, F., Magdalena, L. (eds) Accuracy Improvements in Linguistic Fuzzy Modeling. Studies in Fuzziness and Soft Computing, vol 129. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-37058-1_11
Download citation
DOI: https://doi.org/10.1007/978-3-540-37058-1_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-05703-8
Online ISBN: 978-3-540-37058-1
eBook Packages: Springer Book Archive