Skip to main content

Performance Evaluation Among ID3, C4.5, and CART Decision Tree Algorithm

  • Conference paper
  • First Online:
Pervasive Computing and Social Networking

Abstract

Data is the most valuable resource in the present. Classifying the data and using the classified data to make a decision holds the highest priority. Computers are trained to manage the data automatically using machine learning algorithms and making judgments as outputs. Several data mining algorithms can be obtained for Artificial Neural Network classification, Nearest Neighbor Law and Baysen classifiers, but the decision tree mining is most commonly used. Data can be classified easily using the decision tree classification learning process. It’s trained on a training dataset and then implemented on a test set from which a result is expected. There are three decision trees (ID3 C4.5 and CART) that are extensively used. The algorithms are all based on Hut’s algorithm. This paper focuses on the difference between the working processes, significance, and accuracy of the three (ID3 C4.5 and CART) algorithms. Comparative analysis among the algorithms is illustrated as well.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Manlangit S, Azam S, Shanmugam B, Karim A (2019) Novel machine learning approach for analyzing anonymous credit card fraud patterns. Int J Electron Commerce Stud 10(2):175–202. https://doi.org/10.7903/ijecs.1732

    Article  Google Scholar 

  2. Ghosh P, Azam S, Jonkman M, Karim A, Shamrat FMJM, Ignatious E, Shultana S, Beeravolu AR, De Boer F Efficient prediction of cardiovascular disease using machine learning algorithms with relief and LASSO feature selection techniques. IEEE Access. https://doi.org/10.1109/ACCESS.2021.3053759

  3. Foysal MFA, Islam MS, Karim A, Neehal N (2019) Shot-Net: a convolutional neural network for classifying different cricket shots. Commun Comput Inform Sci Rec Trends Image Process Pattern Recogn 111–120. http://doi-org-443.webvpn.fjmu.edu.cn/10.1007/978-981-13-9181-1_10

  4. Shamrat FMJM, Asaduzzaman Md, Rahman AKMS, Tusher RTH, Tasnim Z (2019) A comparative analysis of parkinson disease prediction using machine learning approaches. Int J Sci Technol Res 8(11):2576–2580. ISSN: 2277-8616

    Google Scholar 

  5. Williams FM, Rothe H, Barrett G, Chiodini A, Whyte J, Cronin MT, Yang C (2016) Assessing the safety of cosmetic chemicals: consideration of a flux decision tree to predict dermally delivered systemic dose for comparison with oral TTC (Threshold of Toxicological Concern). Regul Toxicol Pharmacol 76:174–186

    Article  Google Scholar 

  6. Rahman AKMS, Shamrat FMJM, Tasnim Z, Roy J, Hossain SA (2019) A comparative study on liver disease prediction using supervised machine learning algorithms. Int J Sci Technol Res 8(11):419–422. ISSN 2277-8616

    Google Scholar 

  7. Wang X, Liu X, Pedrycz W, Zhang L (2015) Fuzzy rule based decision trees. Pattern Recognit 48:50–59

    Article  Google Scholar 

  8. Lim T, Loh W, Shih Y (1997) An empirical comparison of decision trees and other classification methods. Technical report, Department of Statistics, University of Wisconsin, Madison, WI, USA, 1997

    Google Scholar 

  9. Karim A, Azam S, Shanmugam B, Kannoorpatti K, Alazab M (2019) A comprehensive survey for intelligent spam email detection. IEEE Access 7:168261–168295.https://doi.org/10.1109/ACCESS.2019.2954791

  10. Vieira EMA, Neves NTAT, Oliveira ACC, Moraes RM, Nascimento JA (2018) Avaliação da performance do algoritmo J48 para construção de modelos baseados em árvores de decisão. Rev Bras Comput Apl 10:80–90

    Google Scholar 

  11. Kaur D, Bedi R, Gupta SK (2015) Review of decision tree data mining algorithms: ID3 and C4.5. In: Proceedings of international conference on information technology and computer science, 11–12 July 2015. ISBN 9788193137307

    Google Scholar 

  12. Karim A, Azam S, Shanmugam B, Kannoorpatti K (2020) Efficient clustering of emails into spam and ham: the foundational study of a comprehensive unsupervised framework. IEEE Access 8:154759–154788. https://doi.org/10.1109/ACCESS.2020.3017082

    Article  Google Scholar 

  13. Kumar N, Obi Reddy GP, Chatterji S, Sarkar D (2012) An application of ID3 decision tree algorithm in land capability classification. Agropedology 22(J):35–42

    Google Scholar 

  14. Shamrat FMJM, Mahmud I, Rahman AKMS, Majumder A, Tasnim Z, Nobel NI (2020) A smart automated system model for vehicles detection to maintain traffic by image processing. Int J Sci Technol Res 9(2):2921–2928. ISSN 2277-8616

    Google Scholar 

  15. Dai Q, Zhang C, Wu H (2016) Research of decision tree classification algorithm in data mining. Int J Database Theor Appl 9(5):1–8. https://doi.org/10.14257/ijdta.2016.9.5.01

  16. Hssina B, Merbouha A, Ezzikouri H, Erritali M A comparative study of decision tree ID3 and C4.5. (IJACSA) Int J Adv Comput Sci Appl. Special Issue on Advances in Vehicular Ad Hoc Networking and Applications

    Google Scholar 

  17. Bittencourt, Radke H, Clarke RT (2004) Feature selection by using classification and regression trees (CART)

    Google Scholar 

  18. Shamrat FMJM, Ghosh P, Sadek MH, Kazi MA, Shultana S (2020) Implementation of machine learning algorithms to detect the prognosis rate of kidney disease. In: 2020 IEEE international conference for innovation in technology (INOCON), Bangluru, pp 1–7.https://doi.org/10.1109/INOCON50539.2020.9298026

  19. Shamrat FMJM, Asaduzzaman Md, Ghosh P, Sultan MdD, Tasnim Z (2020) A web based application for agriculture: “Smart Farming System”. Int J Emerg Trends Eng Res 8(6): 309–2320. ISSN 2347-3983. https://doi.org/10.30534/ijeter/2020/18862020

  20. Saleh AJ, Karim A, Shanmugam B, Azam S, Kannoorpatti K, Jonkman M, Boer FD (2019) An intelligent spam detection model based on artificial immune system. Information 10(6):209. https://doi.org/10.3390/info10060209

    Article  Google Scholar 

  21. Shamrat FMJM, Tasnim Z, Nobel NI, Ahmed MdR (2019) An automated embedded detection and alarm system for preventing accidents of passengers vessel due to overweight. In: Proceedings of the 4th international conference on big data and Internet of Things (BDIoT'19). Association for Computing Machinery, New York, NY, USA, Article 35, pp 1–5. https://doi.org/10.1145/3372938.3372973

  22. Shamrat FMJM, Allayear SM, Alam MF, Jabiullah MI, Ahmed R (2019) A smart embedded system model for the AC automation with temperature prediction. In: Singh M, Gupta P, Tyagi V, Flusser J, Ören T, Kashyap R (eds) Advances in computing and data sciences. ICACDS 2019. Communications in computer and information science, vol 1046. Springer, Singapore. https://doi.org/10.1007/978-981-13-9942-8_33

  23. Shamrat FMJM, Nobel NI, Tasnim Z, Ahmed R (2020) Implementation of a smart embedded system for passenger vessel safety. In: Saha A, Kar N, Deb S (eds) Advances in computational intelligence, security and Internet of Things. ICCISIoT 2019. Communications in computer and information science, vol 1192. Springer, Singapore. https://doi.org/10.1007/978-981-15-3666-3_29

  24. Ma L, Destercke S, Wang Y (2016) Online active learning of decision trees with evidential data. Pattern Recogn 52:33–45

    Article  MATH  Google Scholar 

  25. Ahmed MdR, Ali MdA, Ahmed N, Zamal MdFB, Shamrat FMJM (2020) The impact of software fault prediction in real-world application: an automated approach for software engineering. In: Proceedings of 2020 the 6th international conference on computing and data Engineering (ICCDE 2020). Association for Computing Machinery, New York, NY, USA, pp 247–251. https://doi.org/10.1145/3379247.3379278

  26. Shamrat FMJM, Tasnim Z, Ghosh P, Majumder A, Hasan MZ (2020) Personalization of job circular announcement to applicants using decision tree classification algorithm. In: 2020 IEEE international conference for innovation in technology (INOCON), Bangluru, pp 1–5.https://doi.org/10.1109/INOCON50539.2020.9298253

  27. Liang C, Shanmugam B, Azam S, Karim A et al (2020) Intrusion detection system for the internet of things based on blockchain and multi-agent systems. Electronics 9(7):1120. https://doi.org/10.3390/electronics9071120

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Javed Mehedi Shamrat, F.M., Ranjan, R., Hasib, K.M., Yadav, A., Siddique, A.H. (2022). Performance Evaluation Among ID3, C4.5, and CART Decision Tree Algorithm. In: Ranganathan, G., Bestak, R., Palanisamy, R., Rocha, Á. (eds) Pervasive Computing and Social Networking. Lecture Notes in Networks and Systems, vol 317. Springer, Singapore. https://doi.org/10.1007/978-981-16-5640-8_11

Download citation

Publish with us

Policies and ethics