Skip to main content

Methodological Principles of Uncertainty in Inductive Modelling: A New Perspective

  • Chapter
Maximum-Entropy and Bayesian Methods in Science and Engineering

Part of the book series: Fundamental Theories of Physics ((FTPH,volume 31-32))

Abstract

It is argued that the concept of uncertainty plays a fundamental role in inductive (data-driven) systems modelling. In particular, it is essential for dealing with two broad classes of problems that are essential to inductive modelling: problems involving ampliative reasoning (reasoning in which conclusions are not entailed within the given premises) and problems of systems simplification. These problem classes are closely connected with the principles of maximum and minimum uncertainty. When models are conceptualized in terms of probability theory, these principles become the well established principles of maximum and minimum entropy. However, when the more general framework of the Dempster-Shafer theory of evidence is employed, four different types of uncertainty emerge. Well justified measures of these types of uncertainty are now available and are described in the paper. The meaning of these four types of uncertainty is captured by the suggestive names “nonspecificity”, “fuzziness,” “dissonance,” and “confusion.” Since uncertainty is a multidimensional entity in evidence theory, the maximum and minimum uncertainty principles lead to optimization problems with multiple objective criteria.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Christensen, R. (1980–81). Entropy Minimax Sourcebook (4 volumes). Lincoln, Mass.: Entropy Limited.

    Google Scholar 

  • Christensen, R. (1983). Multivariate Statistical Modeling. Lincoln, Mass.: Entropy Limited.

    Google Scholar 

  • Christensen, R. (1985). Entropy minimax multivariate statistical modeling—I: Theory. Intern. J. of General Systems, 11, 231–277.

    Article  Google Scholar 

  • Christensen, R. (1986). Entropy minimax multivariate statistical modeling—II: Applications. Intern. J. of General Systems, 12, 193–271.

    Article  Google Scholar 

  • Dubois, D. & Prade, H. (1987). Properties of measures of information in evidence and possibility theories. Fuzzy Sets and Systems, 24, no. 2.

    Google Scholar 

  • Gaines, B.R. (1976). On the complexity of causal models. IEEE Trans. on Systems, Man, and Cybernetics, SMC-6, 56–59.

    Google Scholar 

  • Gaines, B.R. (1977). System identification, approximation and complexity. Intern. J. of General Systems, 3, 145–174.

    Article  MathSciNet  MATH  Google Scholar 

  • Hartley, R.V.L. (1928). Transmission of information. The Bell Systems Technical J., 7, 535–563.

    Google Scholar 

  • Higashi, M. & Klir, G.J. (1982). On measures of fuzziness and fuzzy complements. Intern. J. of General Systems, 8, 169–180.

    Article  MathSciNet  MATH  Google Scholar 

  • Higashi, M. & Klir, G.J. (1983). Measures of uncertainty and information based on possibility distributions. Intern. J. of General Systems, 9, 43–58.

    Article  Google Scholar 

  • Hohle, U. (1982). Entropy with respect to plausibility measures. Proc. 12th IEEE Symp. on Multiple-Valued Logic, Paris, 167–169.

    Google Scholar 

  • Klir, G.J. (1985). Architecture of Systems Problem Solving. New York: Plenum Press.

    MATH  Google Scholar 

  • Klir, G.J. & Folger, T.A. (1988). Fuzzy Sets, Uncertainty, and Information. Englewood Cliffs, NJ: Prentice Hall.

    MATH  Google Scholar 

  • Klir, G.J. and Mariano, M. (1987). On the uniqueness of possibilistic measure of uncertainty and information. Fuzzy Sets and Systems, 24.

    Google Scholar 

  • Pearl, J. (1978). On the connection between the complexity and credibility of inferred models. Intern. J. of General Systems, 4, 255–264.

    Article  MathSciNet  MATH  Google Scholar 

  • Ramer, A. (1987). Uniqueness of information measure in the theory of evidence. Fuzzy Sets and Systems, 24.

    Google Scholar 

  • Rényi, A. (1970). Probability Theory. Amsterdam: North-Holland (Chapter IX, Introduction to Information Theory, 540–616).

    Google Scholar 

  • Shafer, G. (1976). A Mathematical Theory of Evidence. Princeton, NJ: Princeton University Press.

    MATH  Google Scholar 

  • Sugeno, M. (1977). Fuzzy measures and fuzzy integrals: a survey. In: Fuzzy Automata and Decision Processes, edited by M.M. Gupta, G.N. Saridis, and B.R. Gaines, Amsterdam and New York: North-Holland, 89–102.

    Google Scholar 

  • Tsu, Lao (1972). Tao Te Ching. New York: Vintage Books (Sec. 71).

    Google Scholar 

  • Yager, R.R. (1979). On the measure of fuzziness and negation. Part I: Membership in the unit interval. Intern. J. of General Systems, 5, 221–229.

    Article  MathSciNet  MATH  Google Scholar 

  • Yager, R.R. (1983). Entropy and specificity in a mathematical theory of evidence. Intern. J. of General Systems, 9, 249–260.

    Article  MathSciNet  MATH  Google Scholar 

  • Yager, R.R. (1986). Toward general theory of reasoning with uncertainty: nonspecificity and fuzziness. Intern. J. of Intelligent Systems, 1, 45–67.

    Article  MATH  Google Scholar 

  • Zadeh, L.A. (1978) Fuzzy sets as a basis for a theory of possibility. Fuzzy Sets and Systems, 1, 3–28.

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1988 Kluwer Academic Publishers

About this chapter

Cite this chapter

Klir, G.J. (1988). Methodological Principles of Uncertainty in Inductive Modelling: A New Perspective. In: Erickson, G.J., Smith, C.R. (eds) Maximum-Entropy and Bayesian Methods in Science and Engineering. Fundamental Theories of Physics, vol 31-32. Springer, Dordrecht. https://doi.org/10.1007/978-94-009-3049-0_17

Download citation

  • DOI: https://doi.org/10.1007/978-94-009-3049-0_17

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-94-010-7871-9

  • Online ISBN: 978-94-009-3049-0

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics