Augmentation of rule-based models with a granular quantification of results

Abstract

This study is concerned with the augmentation of rule-based models or fuzzy rule-based models by associating the numeric results produced by them with granular characterization in the form of prediction intervals. The role of prediction intervals encountered in regression analysis is well emphasized in the literature, especially for “monolithic” models such as linear regression or neural networks. However, there have not been comprehensive and algorithmically complete studies devoted to the conceptualization and determination of prediction intervals for rule-based models, Boolean (two-valued) and fuzzy ones. While the results generated by rule-based models are formed by aggregating partial outcomes resulting from the individual rules, the prediction intervals adhere to the same way of aggregation. In this sense, one can regard the rule-based model augmented by the associated prediction intervals as a granular rule-based model. The construction of rule-based models is, in a nutshell, the optimization process being commonly guided by the sum of squared errors (say, RMSE or alike), and the quality of the granular counterpart of the rule-based models is assessed by looking at the quality of prediction intervals and introducing the two pertinent quality measures focused on the granular nature of the obtained results, namely coverage and specificity along with their combined index. In this study, we analyze an impact of the rules and the parameters of fuzzy clustering on the quality of the numeric and granular performance of the models. A series of experimental results is presented to help quantify the performance of granular outputs (prediction intervals) constructed for rule-based models.

This is a preview of subscription content, log in to check access.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

References

  1. Ak R, Li YF, Vitelli V, Zio E (2018) Adequacy assessment of a wind-integrated system using neural network-based interval predictions of wind power generation and load. Electr Power Energy Syst 95:213–226

    Article  Google Scholar 

  2. Beran RJ (1992) Introduction to Efron (1979) bootstrap methods: another look at the Jackknife. Springer, New York

    Google Scholar 

  3. Box GEP, Jenkins GM, Reinsel GC (1994) Time series analysis: forecasting and control. Englewood Cliffs, Prentice-Hall

    Google Scholar 

  4. Chiang HS, Chen MY, Wu ZW (2017) Applying fuzzy petri nets for evaluating the impact of bedtime behaviors on sleep quality. Granul Comput. https://doi.org/10.1007/s41066-017-0069-y

    Article  Google Scholar 

  5. Christoffersen PF (1998) Evaluating interval forecasts. Int Econ Rev 39:841–862

    MathSciNet  Article  Google Scholar 

  6. Cogan NG, Hussaini MY, Chellam S (2018) Uncertainty propagation in a model of dead-end bacterial microfiltration using fuzzy interval analysis. J Membr Sci 546:215–224

    Article  Google Scholar 

  7. Cordón O (2011) A historical review of evolutionary learning methods for Mamdani-type fuzzy rule-based systems: designing interpretable genetic fuzzy systems. Int J Approx Reason 52:894–913

    Article  Google Scholar 

  8. Fujita H, Gaeta A, Loia V, Orciuoli F (2018) Improving awareness in early stages of security analysis: a zone partition method based on GrC. Appl Intell. https://doi.org/10.1007/s10489-018-1315-y

    Article  Google Scholar 

  9. Hesamian G, Shams M (2016) Parametric testing statistical hypotheses for fuzzy random variables. Soft Comput 20(4):1537–1548

    Article  Google Scholar 

  10. Hwang JTG, Ding AA (1997) Prediction intervals for artificial neural networks. J Am Stat Assoc 92:748–757

    MathSciNet  Article  Google Scholar 

  11. Kerr-Wilson J, Pedrycz W (2017) Some new qualitative insights into quality of fuzzy rule-based models. Fuzzy Sets Syst 307:29–49

    MathSciNet  Article  Google Scholar 

  12. Khosravi A, Nahavandi S, Creighton D (2010) A prediction interval-based approach to determine optimal structures of neural network metamodels. Expert Syst Appl 37:2377–2387

    Article  Google Scholar 

  13. Khosravi A, Nahavandi S, Creighton D, Atiya AF (2011a) Comprehensive review of neural network-based prediction intervals and new advances. IEEE Trans Neural Netw 22:1341–1356

    Article  Google Scholar 

  14. Khosravi A, Nahavandi S, Creighton D, Atiya AF (2011b) Lower upper bound estimation method for construction of neural network-based prediction intervals. IEEE Trans Neural Netw 22:337–346

    Article  Google Scholar 

  15. Lee YS, Scholtes S (2014) Empirical prediction intervals revisited. Int J Forecast 30:217–234

    Article  Google Scholar 

  16. Li K, Wang R, Lei H, Zhang T, Liu Y, Zheng X (2018a) Interval prediction of solar power using an improved bootstrap method. Sol Energy 159:97–112

    Article  Google Scholar 

  17. Li J, Yang L, Qu Y et al (2018b) An extended Takagi–Sugeno–Kang inference system (TSK+) with fuzzy interpolation and its rule base generation. Soft Comput 22(10):3155–3170

    Article  Google Scholar 

  18. Moore RE (1966) Interval analysis. Prentice-Hall, Englewood Cliffs

    Google Scholar 

  19. Pedrycz W (2013) Granular computing: analysis and design of intelligent systems. CRC Press/Francis Taylor, Boca Raton

    Google Scholar 

  20. Pedrycz W, Lu W, Liu X et al (2014) Human-centric analysis and interpretation of time series: a perspective of granular computing. Soft Comput 18(12):2397–2411

    Article  Google Scholar 

  21. Sandhu R, Kaur N, Sood SK et al (2018) TDRM: tensor-based data representation and mining for healthcare data in cloud computing environments. J Supercomput 74:592. https://doi.org/10.1007/s11227-017-2163-y

    Article  Google Scholar 

  22. Seber GAF, Lee AJ (2003) Linear regression analysis, 2nd edn. Wiley, New York

    Google Scholar 

  23. Shrestha DL, Solomatine DP (2006) Machine learning approaches for estimation of prediction interval for the model output. Neural Netw 19:225–235

    Article  Google Scholar 

  24. Tang M, Chen X, Hu W, Yu W (2012) Generation of a probabilistic fuzzy rule base by learning from examples. Inf Sci 217:21–30

    Article  Google Scholar 

  25. Vieaux RDD, Schumi J, Schweinsberg J, Ungar LH (1998) Prediction intervals for neural networks via nonlinear regression. Technometrics 40:273–282

    MathSciNet  Article  Google Scholar 

  26. Wu JJ (2012) Semiparametric forecast intervals. J Forecast 31:189–228

    MathSciNet  Article  Google Scholar 

  27. Xu KJ, Pedrycz W, Li ZW, Nie WK (2019) High-accuracy signal subspace separation algorithm based on gaussian kernel. IEEE Trans Ind Electron 66(1):491–499

    Article  Google Scholar 

  28. Yun SL, Scholtes S (2014) Empirical prediction intervals revisited. Int J Forecast 30:217–234

    Article  Google Scholar 

Download references

Acknowledgements

Support from the Natural Sciences and Engineering Research Council (NSERC) and Canada Research Chair (CRC) Program is gratefully acknowledged.

Funding

This study was funded by NSERC and CRC.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Witold Pedrycz.

Ethics declarations

Conflict of interest

All the authors have no conflict of interest.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Communicated by V. Loia.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Cui, Y., Hanyu E, Pedrycz, W. et al. Augmentation of rule-based models with a granular quantification of results. Soft Comput 23, 12745–12759 (2019). https://doi.org/10.1007/s00500-019-03825-7

Download citation

Keywords

  • Rule-based model
  • Clustering
  • Information granules
  • Prediction interval
  • Coverage
  • Specificity
  • Optimization