Abstract
Fuzzy rough sets are widely studied and applied in the domain of machine learning and data mining these years. In this work, this theory is used to design a fuzzy rough decision tree algorithm which can be used to deal with the cognitive uncertainties such as vagueness and ambiguity associated with human thinking and perception. In our algorithm, both selecting nodes and splitting branches in constructing the tree are based on fuzzy rough set theory. Especially, the current branching point is determined by pureness of the two branches, where the pureness is based on fuzzy lower approximation. The comparison results show that our decision tree algorithm is equivalent to or outperforms some popular decision tree algorithms.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Blake, C.L., Merz, C.J.: UCI Repository of Machine Learning Databases (1998), http://www.ics.uci.edu/~mlearn/MLRepository.html
Breiman, L., Friedman, J., Stone, C., Olshen, R.: Classification and Regression Trees. Chapman and Hall/CRC, Boca Raton (1984)
Cios, K.J., Sztandera, L.M.: Continuous ID3 Algorithm with Fuzzy Entropy Measures. In: Proceeding on IEEE International Conference on Fuzzy Systems, San Diego, CA, pp. 469–476 (1992)
Cornelis, C., Jensen, R., Martin, G.H., Slezak, D.: Attribute Selection with Fuzzy Decision Reducts. Information Sciences 180, 209–224 (2010)
Cover, T.M., Hart, P.E.: Nearest Neighbor Pattern Classification. IEEE Transactions on Information Theory 13, 21–27 (1967)
Dasarathy, B.V.: Nearest Neighbor NN Norms: NN Pattern Classification Techniques, pp. 1–30. IEEE Computer Society (1990)
Dubois, D., Prade, H.: Rough Fuzzy Sets and Fuzzy Rough Sets. General Systems 17, 191–209 (1990)
Geurts, P., Ernst, D., Wehenkel, L.: Extremely Randomized Trees. Machine Learning 36, 3–42 (2006)
Hullermeier, E., Vanderlooy, S.: Why Fuzzy Decision Trees are Good Rankers. IEEE Transactions on Fuzzy Systems 17, 1233–1244 (2009)
Jensen, R., Shen, Q.: Fuzzy-rough Attribute Reduction with Application to Web Categorization. Fuzzy Sets and Systems 141, 469–485 (2004)
Mi, J.S., Zhang, W.X.: An axiomatic Characterization of a Fuzzy Generalization of Rough Sets. Information Sciences 160, 235–249 (2004)
Morsi, N.N., Yakout, M.M.: Axiomatics for Fuzzy Rough Sets. Fuzzy Sets and Systems 100, 327–342 (1998)
Nguyen, H.S.: Approximate Boolean Reasoning: Foundations and Applications in Data Mining. In: Peters, J.F., Skowron, A. (eds.) Transactions on Rough Sets V. LNCS, vol. 4100, pp. 334–506. Springer, Heidelberg (2006)
Tsang, E.C.C., Chen, D.G., Yeung, D.S.: Attributes Reduction Using Fuzzy Rough Sets. IEEE Transactions on Fuzzy Systems 16, 1130–1141 (2008)
Olaru, C., Wehenkel, L.: A Complete Fuzzy Decision Tree Technique. Fuzzy Sets and Systems 138, 221–254 (2003)
Quinlan, J.R.: Induction of Decision Trees. Machine Learning 1, 81–106 (1986)
Quinlan, J.R.: C4.5: Programs for Machine Learning. Morgan Kaufmann, San Francisco (1993)
Radzikowska, A.M., Kerre, E.E.: A Comparative Study of Fuzzy Rough Sets. Fuzzy Sets and Systems 126, 137–155 (2002)
Safavian, S.R., Landgrebe, D.: A Survey of Decision Tree Classifier Methodology. IEEE Transactions on System Man Cybernet 21, 660–674 (1991)
Suarez, A., Lutsko, J.F.: Globally Optimal Fuzzy Decision Trees for Classification and Regression. IEEE Transactions on Pattern Analysis and Machine Intelligence 21, 1297–1311 (1999)
Wang, X.Z., Zhai, J.H., Lu, S.X.: Induction of Multiple Fuzzy Decision Trees based on Rough Set Technique. Information Sciences 178, 3188–3202 (2008)
Wu, H.Y., Wu, Y.Y., Luo, J.P.: An Interval Type2 Fuzzy Rough Set Model for Attribute Reduction. IEEE Transactions on Fuzzy Systems 17, 301–315 (2009)
Wu, W.-Z., Mi, J.-S., Zhang, W.-X.: Generalized Fuzzy Rough Sets. Information Sciences 151, 263–282 (2003)
Wu, W.-Z., Mi, J.-S., Zhang, W.-X.: Constructive and Axiomatic Approaches of Fuzzy Approximation Operators. Information Sciences 159, 233–254 (2004)
Yuan, Y., Shaw, M.J.: Induction of Fuzzy Decision Trees. Fuzzy Sets and Systems 69, 125–139 (1995)
Yueng, D.S., Chen, D.G., Tsang, E.C.C., et al.: On the Generalization of Fuzzy Rough Sets. IEEE Transactions on Fuzzy Systems 13, 343–361 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
An, S., Hu, Q. (2012). Fuzzy Rough Decision Trees. In: Yao, J., et al. Rough Sets and Current Trends in Computing. RSCTC 2012. Lecture Notes in Computer Science(), vol 7413. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-32115-3_47
Download citation
DOI: https://doi.org/10.1007/978-3-642-32115-3_47
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-32114-6
Online ISBN: 978-3-642-32115-3
eBook Packages: Computer ScienceComputer Science (R0)