Constructing Rule-Based Models Using the Belief Functions Framework

  • Rui Jorge Almeida
  • Thierry Denoeux
  • Uzay Kaymak
Part of the Communications in Computer and Information Science book series (CCIS, volume 299)


We study a new approach to regression analysis. We propose a new rule-based regression model using the theoretical framework of belief functions. For this purpose we use the recently proposed Evidential c-means (ECM) to derive rule-based models solely from data. ECM allocates, for each object, a mass of belief to any subsets of possible clusters, which allows to gain a deeper insight on the data while being robust with respect to outliers. The proposed rule-based models convey this added information as the examples illustrate.


Belief Function Antecedent Variable Fuzzy Linear Regression Complete Ignorance Unreliable Information 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Shafer, G.: A mathematical theory of evidence. Princeton university press (1976)Google Scholar
  2. 2.
    Takagi, T., Sugeno, M.: Fuzzy identification of systems and its aplication to modeling and control. IEEE Transactions on Systems, Man and Cybernetics 15, 116–132 (1985)zbMATHGoogle Scholar
  3. 3.
    Hartigan, J.A.: Clustering Algorithms. Wiley Interscience, New York (1974)Google Scholar
  4. 4.
    Smets, P., Kennes, R.: The transferable belief model. Artif. Intell. 66, 191–234 (1994)MathSciNetzbMATHCrossRefGoogle Scholar
  5. 5.
    Masson, M.H., Denoeux, T.: ECM: An evidential version of the fuzzy c-means algorithm. Pattern Recognition 41, 1384–1397 (2008)zbMATHCrossRefGoogle Scholar
  6. 6.
    Tanaka, H., Uejima, S., Asai, K.: Linear regression analysis with fuzzy model. IEEE Transactions on Systems, Man and Cybernetics 12, 903–907 (1982)zbMATHCrossRefGoogle Scholar
  7. 7.
    Chang, Y.H.O., Ayyub, B.M.: Fuzzy regression methods - a comparative assessment. Fuzzy Sets and Systems 119, 187–203 (2001)MathSciNetCrossRefGoogle Scholar
  8. 8.
    Ramdani, M., Mourot, G., Ragot, J.: A multi-modeling strategy based on belief function theory. In: 44th IEEE Conference on Decision and Control 2005 and 2005 European Control Conference, CDC-ECC 2005, pp. 3261–3266 (2005)Google Scholar
  9. 9.
    Petit-Renaud, S., Denoeux, T.: Nonparametric regression analysis of uncertain and imprecise data using belief functions. International Journal of Approximate Reasoning 35, 1–28 (2004)MathSciNetzbMATHCrossRefGoogle Scholar
  10. 10.
    Denoeux, T.: Function approximation in the framework of evidence theory: A connectionist approach. In: Proceedings of the 1997 International Conference on Neural Networks, Houston, USA (1997)Google Scholar
  11. 11.
    Smets, P.: The transferable belief model for quantified belief representation. In: Gabbay, D., Smets, P. (eds.) Handbook of Defeasible Reasoning and Uncertainty Management Systems. Kluwer, Dordrecht (1998)Google Scholar
  12. 12.
    Smets, P.: The combination of evidence in the transferable belief model. IEEE Trans. Pattern Anal. Mach. Intell. 12, 447–458 (1990)CrossRefGoogle Scholar
  13. 13.
    Smets, P.: Decision making in the TBM: the necessity of the pignistic transformation. Int. J. Approx. Reasoning 38, 133–147 (2005)MathSciNetzbMATHCrossRefGoogle Scholar
  14. 14.
    Masson, M.H., Denux, T.: RECM: Relational evidential c-means algorithm. Pattern Recogn. Lett. 30, 1015–1026 (2009)CrossRefGoogle Scholar
  15. 15.
    Bezdek, J.C.: Pattern Recognition with Fuzzy Objective Function Algorithms. Plenum Press, New York (1981)zbMATHCrossRefGoogle Scholar
  16. 16.
    Quost, B., Masson, M.H., Denoeux, T.: Classifier fusion in the dempster-shafer framework using optimized t-norm based combination rules. International Journal of Approximate Reasoning 52, 353–374 (2011); Dependence Issues in Knowledge-Based SystemsMathSciNetCrossRefGoogle Scholar
  17. 17.
    Kallel, A., Hégarat-Mascle, S.L.: Combination of partially non-distinct beliefs: The cautious-adaptive rule. International Journal of Approximate Reasoning 50, 1000–1021 (2009); Special Section on Graphical Models and Information RetrievalMathSciNetzbMATHCrossRefGoogle Scholar
  18. 18.
    Klement, E., Mesiar, R., Pap, E.: Triangular Norms. Kluwer Academic Publishers, Dordrecht (2000)zbMATHGoogle Scholar
  19. 19.
    Box, G.E.P., Jenkins, G.M.: Time Series Analysis, Forecasting, and Control. Holden-Day, San Francisco (1976)zbMATHGoogle Scholar
  20. 20.
    Gustfson, D., Kessel, W.: Fuzzy clustering with a fuzzy covariance matrix. In: Proceedings of IEEE Conference on Decision and Control, CDC, San Diego, CA, USA, pp. 761–766 (1979)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Rui Jorge Almeida
    • 1
  • Thierry Denoeux
    • 2
  • Uzay Kaymak
    • 3
  1. 1.Erasmus School of EconomicsErasmus University RotterdamRotterdamThe Netherlands
  2. 2.U.M.R. C.N.R.S. 6599 HeudiasycUniversité de Technologie de CompiègneCompiègneFrance
  3. 3.School of Industrial EngineeringEindhoven University of TechnologyEindhovenThe Netherlands

Personalised recommendations