International Conference on Mining Intelligence and Knowledge Exploration

Mining Intelligence and Knowledge Exploration pp 70-80 | Cite as

Classification Using Rough Random Forest

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9468)

Abstract

The Rough random forest is a classification model based on rough set theory. The Rough random forest uses the concept of random forest and rough set theory in a single model. It combines a collection of decision trees for classification instead of depending on a single decision tree. It uses the concept of bagging and random subspace method to improve the performance of the classification model. In the rough random forest the reducts of each decision tree are chosen on the basis of boundary region condition. Each decision tree uses a different subset of patterns and features. The class label of patterns is obtained by combining the decisions of all the decision trees by majority voting. Results are reported on a number of benchmark datasets and compared with other techniques. Rough random forest is found to give better performance.

References

  1. 1.
    Bonissone, P., Cadenas, J., Garrido, M., Dıaz-Valladares, R.: A fuzzy random forest: Fundamental for design and construction. In: Proceedings of the 12th International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems (IPMU 2008), pp. 1231–1238 (2008)Google Scholar
  2. 2.
    Breiman, L.: Random forests. Mach. Learn. 45(1), 5–32 (2001)CrossRefMATHGoogle Scholar
  3. 3.
    Breiman, L.: Bagging predictors. Mach. Learn. 24, 123–140 (1996)MathSciNetMATHGoogle Scholar
  4. 4.
    Dietterich, T.G.: An experimental comparison of three methods for constructing ensembles of decision trees: Bagging, boosting, and randomization. Mach. Learn. 40(2), 139–157 (2000)CrossRefGoogle Scholar
  5. 5.
    Ding, B., Zheng, Y., Zang, S.: A new decision tree algorithm based on rough set theory. In: 2009 Asia-Pacific Conference on Information Processing, pp. 326–329, July 2009Google Scholar
  6. 6.
    Hamza, M., Larocque, D.: An empirical comparison of ensemble methods based on classification trees. J. Stat. Comput. Simul. 75, 629–643 (2005)CrossRefMATHGoogle Scholar
  7. 7.
    Huang, L., Huang, M., Guo, B., Zhuang, Z.: A new method for constructing decision tree based on rough set theory. In: 2007 IEEE International Conference on Granular Computing (GRC 2007), pp. 241–241, November 2007Google Scholar
  8. 8.
    Komorowski, J., Pawlak, Z., Polkowski, L., Skowron, A.: Rough sets: A tutorial. Rough fuzzy hybridization: A new trend in decision-making, pp. 3–98 (1999)Google Scholar
  9. 9.
    Lichman, M.: UCI machine learning repository (2013)Google Scholar
  10. 10.
    Patel, B.R., Rana, K.K.: A survey on decision tree algorithm for classification. Int. J. Eng. Dev. Res. IJEDR 2, 1–5 (2014)Google Scholar
  11. 11.
    Pawlak, Z.: Rough sets. Int. J. Comput. Inform. Sci. 11(5), 341–356 (1982)MathSciNetCrossRefMATHGoogle Scholar
  12. 12.
    Quinlan, R.J.: C4.5: Programs for Machine Learning. Morgan Kaufmann Publishers Inc., San Francisco (1993)Google Scholar
  13. 13.
    Quinlan, J.R.: Induction of decision trees. Mach. Learn. 1(1), 81–106 (1986)Google Scholar
  14. 14.
    Rokach, L., Maimon, O.: Data Mining with Decision Trees: Theroy and Applications. World Scientific Publishing Co., Inc., River Edge (2008)Google Scholar
  15. 15.
    Skurichina, M., Duin, R.P.W.: Bagging, boosting and the random subspace method for linear classifiers. Pattern Anal. Appl. 5, 121–135 (2002)MathSciNetCrossRefMATHGoogle Scholar
  16. 16.
    Suraj, Z.: An introduction to rough set theory and its applications. In: ICENCO, Cairo, Egypt (2004)Google Scholar
  17. 17.
    Wei, J., Huang, D., Wang, S., Ma, Z.: Rough set based decision tree. In: 2002 Proceedings of the 4th World Congress on Intelligent Control and Automation, vol. 1, pp. 426–431 (2002)Google Scholar
  18. 18.
    Yeh, C.C., Lin, F., Hsu, C.Y.: A hybrid KMV model, random forests and rough set theory approach for credit rating. Knowl. Based Syst. 33, 166–172 (2012)CrossRefGoogle Scholar
  19. 19.
    Zhang, X., Zhou, J., He, Y., Wang, Y., Liu, B.: Vibration fault diagnosis of hydro-turbine generating unit based on rough 1-v-1 multiclass support vector machine. In: 2010 Sixth International Conference on Natural Computation (ICNC), vol. 2, pp. 755–759, August 2010Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.Indian Institute of ScienceBangaloreIndia

Personalised recommendations