On a New Method of Dynamic Integration of Fuzzy Linear Regression Models

  • Jakub KozerskiEmail author
  • Marek Kurzynski
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 578)


In the study the problem of ensemble regression with fuzzy linear regression (FLR) models is considered. For this case a novel method of integration is proposed in which first fuzzy responses of base FLR models are integrated and next the fuzzy response of a common model is defuzzified. Four different operators are defined for integration procedure. The performance of proposed integration methods of FLR base models on the soft level were compared against state-of-the-art integration method on the crisp level using computer generated datasets with linear, 2-order and 3-order models and different variances of Gaussian disturbances. As a criterion of method quality the root mean square error was applied. The results of computer experiments clearly show that in many cases proposed methods significant outperform the reference approach.


Fuzzy regression model Regression ensemble Integration method Fuzzy integration 



This work was supported by the statutory funds of the Department of Systems and Computer Networks, Wroclaw University of Science and Technology.


  1. 1.
    Breiman, L.: Stacked regressions. Mach. Learn. 24(1), 49–64 (1996)zbMATHGoogle Scholar
  2. 2.
    Chang, Y.H.O., Ayyub, B.M.: Fuzzy regression methods - a comparative assessment. Fuzzy Sets Syst. 119(2), 187–203 (2001)MathSciNetCrossRefGoogle Scholar
  3. 3.
    Chatterjee, S., Simonoff, J.S.: Multiple Linear Regression, pp. 1–21. Wiley, New York (2013)Google Scholar
  4. 4.
    Hashem, S.: Optimal linear combinations of neural networks. Neural Netw. 10(4), 599–614 (1997)MathSciNetCrossRefGoogle Scholar
  5. 5.
    Leblanc, M., Tibshirani, R.: Combining estimates in regression and classification. J. Am. Stat. Assoc. 91(436), 1641–1650 (1996)MathSciNetzbMATHGoogle Scholar
  6. 6.
    Mendes-Moreira, J., Soares, C., Jorge, A.M., De Sousa, J.F.: Ensemble approaches for regression: a survey. ACM Comput. Surv. 45(1), 10:1–10:40 (2012)CrossRefzbMATHGoogle Scholar
  7. 7.
    Merz, C.J.: Dynamical Selection of Learning Algorithms. In: Fisher, D., Lenz, H.-J. (eds.) Learning from Data. Lecture Notes in Statistics, vol. 112, pp. 281–290. Springer, New York (1996)CrossRefGoogle Scholar
  8. 8.
    Merz, C.J.: Classification and Regression by Combining Models. Ph.D. thesis (1998). aAI9821450Google Scholar
  9. 9.
    Perrone, M.P., Cooper, L.N.: When networks disagree: ensemble methods for hybrid neural networks. Technical report, DTIC Document (1992)Google Scholar
  10. 10.
    Perrone, M.P.: Improving regression estimation: averaging methods for variance reduction with extensions to general convex measure optimization (1993)Google Scholar
  11. 11.
    Rooney, N., Patterson, D., Anand, S., Tsymbal, A.: Dynamic integration of regression models. In: Roli, F., Kittler, J., Windeatt, T. (eds.) MCS 2004. LNCS, vol. 3077, pp. 164–173. Springer, Heidelberg (2004). doi: 10.1007/978-3-540-25966-4_16 CrossRefGoogle Scholar
  12. 12.
    Tanaka, H., Uejima, S., Asai, K.: Linear regression analysis with fuzzy model. IEEE Trans. Syst. Man Cybern. 12(6), 903–907 (1982)CrossRefzbMATHGoogle Scholar
  13. 13.
    Weisberg, S.: Applied Linear Regression, 3rd edn. Springer Science+Business Media, Heidelberg (2001)zbMATHGoogle Scholar
  14. 14.
    Zadeh, L.: The concept of a linguistic variable and its application to approximate reasoning–i. Inf. Sci. 8(3), 199–249 (1975)MathSciNetCrossRefzbMATHGoogle Scholar
  15. 15.
    Zimmermann, H.: Fuzzy Set Theory and Its Applications, 4th edn. Wiley-Interscience, New York (2005)Google Scholar

Copyright information

© Springer International Publishing AG 2018

Authors and Affiliations

  1. 1.Wroclaw University of Science and TechnologyWroclawPoland

Personalised recommendations