Skip to main content
SpringerLink
Log in

A novel rule generation and activation method for extended belief rule-based system based on improved decision tree

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Among many classifiers applied to classification problems, the extended belief rule-based (EBRB) system is a powerful tool with the ability to handle both qualitative and quantitative information under uncertainty. However, it may face the problems of low inference efficiency and inconsistent rule activation in some applications due to the limitations of the conventional EBRB generation and activation method. To this end, a novel rule generation and activation method for EBRB system based on improved decision tree is proposed in this paper. Firstly, the distributed EBRB is generated by using the improved decision tree construction method designed in this paper. Then, the conventional EBRB activation scheme is modified by selecting input-related sub-EBRB for a given input as inference rule base to search suitable belief rules as well as introducing the attribute sorting knowledge in the process of activation. Moreover, the original procedures of the inference process and class estimation are retained from conventional EBRB system. Experiments were carried out to validate the efficiency and effectiveness of the proposed method in comparison with different types of classifiers under eleven standard classification datasets. The comparison results show that the proposed method could obtain satisfactory classification accuracy and rule inference efficiency. Additionally, the proposed method performs well on datasets with fewer classes, and it can efficiently process multi-attribute datasets.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Chang L, Dong W, Yang J, Sun X, Xiaobin X, Xiaojian X, Zhang L (2020) Hybrid belief rule base for regional railway safety assessment with data and knowledge under uncertainty. Inf Sci 518:376–395

    Article  Google Scholar 

  2. Yang L-H, Wang Y-M, Chang L-L, Fu Y-G (2017) A disjunctive belief rule-based expert system for bridge risk assessment with dynamic parameter optimization model. Comput Indus Eng 113:459–474

    Article  Google Scholar 

  3. Singh N, Singh P, Deepika B (2019) A rule extraction approach from support vector machines for diagnosing hypertension among diabetics. Expert Syst with Appl 130:188–205

    Article  Google Scholar 

  4. Al-Najdawi N, Biltawi M, Tedmori S (2015) Mammogram image visual enhancement, mass segmentation and classification. Appl Soft Comput 35:175–185

    Article  Google Scholar 

  5. Maggiori E, Tarabalka Y, Charpiat G, Alliez P (2016) Convolutional neural networks for large-scale remote-sensing image classification. IEEE Trans on Geosci and Remote Sens 55(2):645–657

    Article  Google Scholar 

  6. Tsang C-H, Kwong S, Wang H (2007) Genetic-fuzzy rule mining approach and evaluation of feature selection techniques for anomaly intrusion detection. Pattern Recogn 40(9):2373–2391

    Article  MATH  Google Scholar 

  7. Ugŭz H (2011) A two-stage feature selection method for text categorization by using information gain, principal component analysis and genetic algorithm. Knowl-Based Syst 24(7):1024–1032

    Article  Google Scholar 

  8. Tong S, Koller D (2001) Support vector machine active learning with applications to text classification. J Mach Learn Res 2:45–66

    MATH  Google Scholar 

  9. Lee S-J, Xu Z, Li T, Yang Y (2018) A novel bagging c4.5 algorithm based on wrapper feature selection for supporting wise clinical decision making. J Biomed Inform 78:144–155

    Article  Google Scholar 

  10. Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, Thrun S (2017) Dermatologist-level classification of skin cancer with deep neural networks. Nature 542(7639):115–118

    Article  Google Scholar 

  11. Xu D-L, Liu J, Yang J-B, Liu G-P, Wang J, Jenkinson I, Ren J (2007) Inference and learning methodology of belief-rule-based expert system for pipeline leak detection. Expert Syst with Appl 32 (1):103–113

    Article  Google Scholar 

  12. Zhou Z-G, Liu F, Jiao L-C, Zhou Z-J, Yang J-B, Gong M-G, Zhang X-P (2013) A bi-level belief rule based decision support system for diagnosis of lymph node metastasis in gastric cancer. Knowl-Based Syst 54:128–136

    Article  Google Scholar 

  13. Yang L-H, Ye F-F, Wang Y-M (2020) Ensemble belief rule base modeling with diverse attribute selection and cautious conjunctive rule for classification problems. Expert Syst with Appl 146:113161

    Article  Google Scholar 

  14. Jian-Bo Yang, Liu J, Wang J, Sii HS, Wang HW (2006) Belief rule-base inference methodology using the evidential reasoning approach-rimer. IEEE Trans Syst, Man, and Cybern-part A: Syst Humans 36 (2):266–285

    Article  Google Scholar 

  15. Liu J, Martinez L, Calzada A, Wang H (2013) A novel belief rule base representation, generation and its inference methodology. Knowl-Based Syst 53:129–141

    Article  Google Scholar 

  16. Yang L-H, Liu J, Wang YM, Martínez L (2018) Extended belief-rule-based system with new activation rule determination and weight calculation for classification problems. Appl Soft Comput 72:261–272

    Article  Google Scholar 

  17. Calzada Alberto, Liu J, Wang H, Kashyap A (2014) A new dynamic rule activation method for extended belief rule-based systems. IEEE Trans Knowl Data Eng 27(4):880–894

    Article  Google Scholar 

  18. Yang L-H, Wang Y-M, Fu Y-G (2018) A consistency analysis-based rule activation method for extended belief-rule-based systems. Inf Sci 445:50–65

    Article  MathSciNet  Google Scholar 

  19. Zhang A, Gao F, Yang M, Bi W (2020) A new rule reduction and training method for extended belief rule base based on dbscan algorithm. Int J of Approx Reason 119:20–39

    Article  MathSciNet  MATH  Google Scholar 

  20. Wang Y-M, Yang J-B, Xu D-L (2006) Environmental impact assessment using the evidential reasoning approach. Eur J of Oper Res 174(3):1885–1913

    Article  MATH  Google Scholar 

  21. Mantas CJ, Abellan J (2014) Credal-c4. 5: decision tree based on imprecise probabilities to classify noisy data. Expert Syst with Appl 41(10):4625–4637

    Article  Google Scholar 

  22. Ross Quinlan J (2014) C4. 5: programs for machine learning. Elsevier

  23. Baesens B, Gestel TV, Viaene S, Stepanova M, Suykens J, Vanthienen J (2003) Benchmarking state-of-the-art classification algorithms for credit scoring. J Operational Res Soc 54(6):627–635

    Article  MATH  Google Scholar 

  24. Robnik-Šikonja M, Kononenko I (2003) Theoretical and empirical analysis of relieff and rrelieff. Mach Learn 53(1):23–69

    Article  MATH  Google Scholar 

  25. Reyes O, Morell C, Ventura S (2015) Scalable extensions of the relieff algorithm for weighting and selecting features on the multi-label learning context. Neurocomputing 161:168–182

    Article  Google Scholar 

  26. Floriana E, Malerba D, Semeraro G, Kay J (1997) A comparative analysis of methods for pruning decision trees. IEEE Trans Pattern Anal Mach Intell 19(5):476–491

    Article  Google Scholar 

  27. Asuncion A, Newman D (2007) Uci machine learning repository

  28. Raudys SJ, Jain AK et al (1991) Small sample size effects in statistical pattern recognition: Recommendations for practitioners. IEEE Trans Pattern Anal Mach Intell 13(3):252–264

    Article  Google Scholar 

  29. Fu Y-G, Zhuang J-H, Chen Y-P, Guo L-K, Wang Y-M (2020) A framework for optimizing extended belief rule base systems with improved ball trees. Knowl-Based Syst 210:106484

    Article  Google Scholar 

  30. Gao Fei, Zhang A, Bi W, Ma J (2021) A greedy belief rule base generation and learning method for classification problem. Appl Soft Comput 98:106856

    Article  Google Scholar 

  31. Fu Y, Yin Z, Su M, Wu Y, Liu G (2020) Construction and reasoning approach of belief rule-base for classification base on decision tree, vol 8

  32. Chi Zheru, Yan Hong, Pham Tuan (1996) Fuzzy algorithms: with applications to image processing and pattern recognition. vol 10. World scientific

  33. Ishibuchi H, Yamamoto T (2005) Rule weight specification in fuzzy rule-based classification systems. IEEE Trans Fuzzy Syst 13(4):428–435

    Article  Google Scholar 

  34. Ishibuchi H, Yamamoto T, Nakashima T (2005) Hybridization of fuzzy gbml approaches for pattern classification problems. IEEE Trans Syst, Man, and Cybern Part B (Cybernetics) 35(2):359–365

    Article  Google Scholar 

  35. Alcalá-Fdez J, Alcalá R, Herrera F (2011) A fuzzy association rule-based classification model for high-dimensional problems with genetic rule selection and lateral tuning. IEEE Trans Fuzzy Syst 19 (5):857–872

    Article  Google Scholar 

  36. Hühn J, Hüllermeier E (2009) Furia: an algorithm for unordered fuzzy rule induction. Data Min and Knowl Disc 19(3):293–319

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgements

This work was supported by the National Natural Science Foundation of China (Grant Nos. 61903305 and 62073267), the Aeronautical Science Foundation of China (Grant No. 201905053001), the Research Funds for Interdisciplinary Subject, NWPU, PR China.

Author information

Authors and Affiliations

  1. School of Aeronautics, Northwestern Polytechnical University, 710072, Xi’an, Shaanxi, China

    Junwen Ma, An Zhang, Fei Gao, Wenhao Bi & Changhong Tang

Authors
  1. Junwen Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. An Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Fei Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Wenhao Bi
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Changhong Tang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wenhao Bi.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ma, J., Zhang, A., Gao, F. et al. A novel rule generation and activation method for extended belief rule-based system based on improved decision tree. Appl Intell 53, 7355–7368 (2023). https://doi.org/10.1007/s10489-022-03803-x

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-022-03803-x

Keywords

Search

Navigation