ComEnVprs: A Novel Approach for Inducing Decision Tree Classifiers

  • Shuqin Wang
  • Jinmao Wei
  • Junping You
  • Dayou Liu
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4093)


This paper presents a new approach for inducing decision trees by combining information entropy criteria with VPRS based methods. From the angle of rough set theory, when inducing decision trees, entropy based methods emphasize the effect of class distribution. Whereas the rough set based approaches emphasize the effect of certainty. The presented approach takes the advantages of both criteria for inducing decision trees. Comparisons between the presented approach and the fundamental information entropy based method on some data sets from the UCI Machine Learning Repository are also reported.


Decision Tree Classification Error Information Entropy Node Count Average Classification Accuracy 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Hunt, E.B., Marin, J., Stone, P.J.: Experiments in Induction. Academic Press, New York (1966)Google Scholar
  2. 2.
    Fayyad, U.M., Weir, N., Djiorgovski, S.: SKICAT: A machine learning system for automated cataloging of large scale sky surveys. In: Proc. the Tenth International Conference on Machine Learning, pp. 112–119. Morgan Kaufmann, Amherst, MA (1993)Google Scholar
  3. 3.
    Michalski, R.S., Carbonell, J.G., Mitchell, T.M.: Machine Learning-An Artificial Intelligence Approach. Springer, Germany (1983)Google Scholar
  4. 4.
    Chen, S.C., Shyu, M.L., Chen, M., Zhang, C.C.: A Decision Tree-based Multimodal Data Mining Framework for Soccer Goal Detection. In: IEEE International Conference on Multimedia and Expo, June 27-June 30, 2004, Taipei, Taiwan, ROC (2004)Google Scholar
  5. 5.
    Quinlan, J.R.: Introduction of Decision Trees. Machine Learning 3, 81–106 (1986)Google Scholar
  6. 6.
    Cheng, J., Bell, D.: Learning bayesian networks from data: an efficient approach based on information theory. In: Proc. of the sixth ACM International Conference on Information and Knowledge Management, pp. 325–331 (1997)Google Scholar
  7. 7.
    Breiman, L., Friedman, J.H., Olshen, R.A., Stone, C.J.: Classification and regression trees. Technical report, Wadsworth International, Monterey, CA (1984)Google Scholar
  8. 8.
    Pawlak, Z.: Rough sets. International Journal of Computer and Information Science 11, 341–356 (1982)CrossRefMATHMathSciNetGoogle Scholar
  9. 9.
    Jerzy, W., GrZymala-Busse, J.W., Ziarko, W.: Data mining and rough set theory. Communications of the ACM 43(4), 108–109 (2000)CrossRefGoogle Scholar
  10. 10.
    Pawlak, Z.: Rough set approach to multi-attribute decision analysis. European Journal of Operational Research 72(3), 443–459 (1994)CrossRefMATHGoogle Scholar
  11. 11.
    Pawlak, Z., Wang, S.K.M., Ziarko, W.: Rough sets: probabilistic versus deterministic approach. Int. J. Man-Machine Studies 29(1), 81–95 (1988)CrossRefMATHGoogle Scholar
  12. 12.
    Wei, J.M.: Rough Set Based Approach to Selection of Node. International Journal of Computational Cognition 1(2), 25–40 (2003)Google Scholar
  13. 13.
    Mingers, J.: An empirical comparison of pruning methods for decision-tree induction. Machine Learning 4(2), 319–342 (1989)CrossRefGoogle Scholar
  14. 14.
    Quinlan, J.R., Rivest, R.: Inferring decision trees using the minimum description length principle. Information and Computation 80(3), 227–248 (1989)CrossRefMATHMathSciNetGoogle Scholar
  15. 15.
    Zbigniew, W.R., Zemankova, M.: Imprecise Concept Learning within a Growing Language. In: Proc. the sixth inter. workshop on Machine learning, Ithaca, New York, United States, pp. 314–319 (1989)Google Scholar
  16. 16.
    Berzal, F., Cubero, J.C., Cuenca, F., Martín-Bautista, M.J.: On the quest for easy-to-understand splitting rules. Data & Knowledge Engineering 44(1), 31–48 (2003)CrossRefMATHGoogle Scholar
  17. 17.
    Ziarko, W.: Variable precision rough set model. Journal of Computer and System Sciences 46(1), 39–59 (1993)CrossRefMATHMathSciNetGoogle Scholar
  18. 18.
    Quinlan, J.R.: C4.5: Programs for Machine Learning. Morgan Kaufmann, San Francisco (1993)Google Scholar
  19. 19.
    Gehrke, J., Ramakrishnan, R., Ganti, V.: RainForest - A Framework for Fast Decision Tree Construction of Large Datasets. Data Mining and Knowledge Discovery 4(2/3), 127–162 (2000)CrossRefGoogle Scholar
  20. 20.
    Rastogi, R., Shim, K.: PUBLIC: A Decision Tree Classifier that integrates building and pruning. Data Mining and Knowledge Discovery 4(4), 315–344 (2000)CrossRefMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Shuqin Wang
    • 1
  • Jinmao Wei
    • 2
    • 3
  • Junping You
    • 2
  • Dayou Liu
    • 3
  1. 1.School of Mathematics & StatisticsNortheast Normal UniversityJilinChina
  2. 2.Institute of Computational IntelligenceNortheast Normal UniversityJilinChina
  3. 3.Open Symbol Computation and Knowledge Engineering Laboratory of State EducationJilin UniversityJilinChina

Personalised recommendations