Fuzzy-Neural Inference in Decision Trees
The predominate weakness in the creation of decision trees is the strict partitions which are selected by the induction algorithm. To overcome this problem the theories of fuzzy logic have been applied to generate soft thresholds leading to the creation of fuzzy decision trees, thus allowing cases passing through the tree for classification to be assigned partial memberships down all paths. A challenging task is how these resultant membership grades are combined to produce an overall outcome. A number of theoretical fuzzy inference techniques exist, yet they have not been applied extensively in practical situations and are often domain dependent. Thus the overall classification success of the fuzzy trees has a high dependency on the optimization of the strength of the fuzzy intersection and union operators that are applied. This paper investigates a new, more general approach to combining membership grades using neural-fuzzy inference. Comparisons are made between using the fuzzy-neural approach and the use of pure fuzzy inference trees.
KeywordsDecision Tree Membership Grade Induction Algorithm Fuzzy Decision Tree Fuzzy Intersection
Unable to display preview. Download preview PDF.
- 1.Quinlan J.R, “Probabilistic Decision Trees”. In “Machine Learning Volume 3: An AI Approach”. (Eds). Kockatoft, Y. Michalshi, R, pp 140–152, 1990.Google Scholar
- 3.Quinlan, J.R., Is C5.0 Better Than C4.5. Available: http://www.rulequest.com/see5-comparison.html, 2000.
- 4.Breiman, L., Shang, N., Born Again Trees, ftp://ftp.stat.berkeley.edu/pub/users/breiman/, 1997.
- 5.Tani T. Sakoda, T. Tanaka, K. Fuzzy Modeling by ID3 Algorithm and it’s Application to Prediction Of Heater Outlet Temperature, IEEE, pp. 923–9301992.Google Scholar
- 6.Umano, M., Okamoto, H., Hatono, I., Tamura, H., Generation of Fuzzy Decision Trees By Fuzzy ID3 Algorithm and it’s Application to Diagnosis by Gas in Oil, Japan-U.S.A Symposium, pp. 1445–1450, 1994.Google Scholar
- 7.Bouchon-Meunier, B., Mamdani, R., “Learning From Imperfect Data”, In “Fuzzy Information Engineering A Guided Tour of Applications”, Eds. Dubois, D. Prade, H. Yager, R, R, John Wiley and Sons Publishing, pp. 139–148. 1997.Google Scholar
- 8.Janikow C., Fuzzy Decision Trees: Issues and Methods, IEEE Transactions on Systems, Man, and Cybernetics, pp. 1–14, Vol. 28,1, 1998.Google Scholar
- 9.Crockett, K.A., Bandar, Z., Soft Decision Trees: A New Approach Using Non-linear Fuz-zification, The 9th IEEE International Conference on Fuzzy Systems, May 2000.Google Scholar
- 10.Crockett, K.A., Bandar, Z., Al-Attar, A A Fuzzy Inference Framework For Induced Decision Trees. ECAI 98. 13th European Conference on Artificial Intelligence, Brighton, UK. Eds. H. Prade. John Wiley & Sons Ltd, pp 425–429, 1998Google Scholar
- 11.Michalewicz, Z., Genetic Algorithms and Data Structures = Evolution Programs, Second Edition, Springer-Verlag, 1994.Google Scholar
- 13.Yager, R., On a General Class Of Fuzzy Connectives. Fuzzy Sets & Systems 4, 1980.Google Scholar