Methodological Principles of Uncertainty in Information Systems Modeling

  • George J. Klir


System modeling permeates all disciplines of science, both natural and artificial. The general concepts of system modeling are presented in summary fashion. The key role of uncertainty in system modeling is discussed including the principles of maximum and minimum uncertainty. Recent results regarding conceptualization of uncertainty, which demonstrate that uncertainty is a multidimensional concept, are overviewed, and the implications for modeling in information and software engineering are discussed.


Shannon Entropy Information Retrieval System Possibility Distribution Evidence Theory Possibility Theory 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Bard, Y., 1980(a), Estimation of State Probabilities Using the Maximum Entropy Principle, IBM Journal of Research and Development, Vol. 24, No. 5, pp. 563–569.MathSciNetMATHCrossRefGoogle Scholar
  2. Bard, Y., 1980(b), A Model of Shared DASD and Multipathing, ACM Communications, Vol. 23, No. 10, pp. 564–572.CrossRefGoogle Scholar
  3. Buckles, B. P., and Petry, F. E., 1983, Information-Theoretical Characterization of Fuzzy Relational Databases, IEEE Trans. on Systems, Man, and Cybernetics, Vol. SMC-13, No. 1, pp. 74–77.Google Scholar
  4. Buell, D. A., 1982, An Analysis of Some Fuzzy Subset Applications to Information Retrieval Systems, Fuzzy Sets and Systems, Vol. 7, pp. 35–42.CrossRefGoogle Scholar
  5. Cavallo, R., and Pittarelli, M., 1987, The Theory of Probabilistic Databases, Proc. 13th Very Large Scale Databases Conf., Brighton, pp. 71–81.Google Scholar
  6. Christensen, R., 1980–1981, Entropy Minimax Sourcebook (4 volumes),Entropy Limited, Lincoln, Mass.Google Scholar
  7. Christensen, R., 1983, Multivariate Statistical Modeling, Entropy, Lincoln, Mass.Google Scholar
  8. Christensen, R., 1986, Entropy Minimax Multivariate Statistical Modeling, Intern. J. of General Systems, Vol. 11, No. 3, pp. 231–277, (I. Theory); Vol. 12, No. 3, 1986, pp. 227–305 ( II. Applications ).Google Scholar
  9. Dubois, D., and Prade, H., 1988, Possibility Theory, Plenum Press, New York.MATHCrossRefGoogle Scholar
  10. Ferdinand, A. E., 1972, Quality in Programming, IBM Technical Report 21, 485, Kingston, NY, June 1972.Google Scholar
  11. Ferdinand, A. E., 1974, A Theory of System Complexity, Intern. J. of General Systems, Vol. 1, No. 1, pp. 19–33.CrossRefGoogle Scholar
  12. Gupta, M. M., Kandel, A., Bandler, W., and Kiszka, J. B., (eds.), 1985, Approximate Reasoning in Expert Systems, North-Holland, New York.Google Scholar
  13. Hall, L., and Kandel, A., 1986, Designing Fuzzy Expert Systems, TÚV Rheinland, Köln.Google Scholar
  14. Hartley, R.V.L., 1928, Transmission of Information, The Bell Systems Technical J, Vol. 7, pp. 535–563.Google Scholar
  15. Higashi, M., and Klir, G. J., 1982, On Measures of Fuzziness and Fuzzy Complements, Intern. J. of General Systems, Vol. 8, No. 3, pp. 169–180.CrossRefGoogle Scholar
  16. Higashi, M., and Klir, G. J., 1983, Measures of Uncertainty and Information Based on Possibility Distributions, Intern. J. of General Systems, Vol. 9, No. 1, pp. 43–58.MathSciNetCrossRefGoogle Scholar
  17. Höhle, U., 1982, Entropy with Respect to Plausibility Measures, Proc. 12th IEEE Intern. Symp. on Multiple Valued Logic, Paris, pp. 167–169.Google Scholar
  18. Islam, S., 1974, Toward Integration of Two System Theories by Mesarovic and Wymore, Intern. J. of General Systems, Vol. 1, No. 1, pp. 35–40.MATHCrossRefGoogle Scholar
  19. Jaynes, E. T., 1983, Papers on Probability, Statistics and Statistical Physics, Rosenkrantz, R. D., ed., Reidel, Boston.Google Scholar
  20. Kanal, L. N., and Lemmer, J. F., (eds.), 1986, Uncertainty in Artificial Intelligence, North-Holland, New York.MATHGoogle Scholar
  21. Klir, G. J., 1985(a), Architecture of Systems Problem Solving,Plenum Press, New York.Google Scholar
  22. Klir, G. J., 1985(b), The Many Faces of Complexity, The Science and Praxis of Complexity,The United Nations University, Tokyo, pp. 81–98.Google Scholar
  23. Klir, G. J., 1987, When Do We Stand on Measures of Uncertainty, Ambiguity, Fuzziness, and the Like?, Fuzzy Sets and Systems, Vol. 24, No. 2, pp. 141–160.MathSciNetMATHCrossRefGoogle Scholar
  24. Klir, G. J., and Folger, T. A., 1988, Fuzzy Sets, Uncertainty and Information, Prentice Hall, Englewood Cliffs, NJ.Google Scholar
  25. Klir, G. J., and Mariano, M., 1987, On the Uniqueness of Possibilistic Measure of Uncertainty and Information, Fuzzy Sets and Systems, Vol. 24, No. 2, 197–219.Google Scholar
  26. Lee, T. T., 1987, An Information-Theoretic Analysis of Relational Databases, IEEE Trans. on Software Engineering, Vol. SE-13, No. 10, pp. 1049–1072.Google Scholar
  27. Lofgren, L. 1977, Complexity of Descriptions of Systems: A Foundational Study, Inter. J. of General Systems, Vol. 3, pp. 197–214.MathSciNetCrossRefGoogle Scholar
  28. Malvestuto, F. M., 1986, Statistical Treatment of the Information Content of a Database, Information Systems, Vol. 11, No. 3, pp. 211–223.MATHCrossRefGoogle Scholar
  29. Mesarovic, M. D., and Takahara, Y., 1975, General Systems Theory: Mathematical Foundations, Academic Press, New York.MATHGoogle Scholar
  30. Negoita, C. V., 1985, Expert Systems and Fuzzy Systems, Benjamin/Cummings, Menlo Park, CA.Google Scholar
  31. Prade, H., 1984, Lipski’s Approach to Incomplete Information, Data Bases Restated and Generalized in the Setting of Zadeh’s Possibility Theory, Information System, Vol. 9, No. 1, pp. 27–42.MathSciNetMATHCrossRefGoogle Scholar
  32. Radecki, T., 1983, A Theoretical Background for Applying Fuzzy Set Theory in Information Retrieval, Fuzzy Sets and Systems, Vol. 10, pp. 169–183.MathSciNetMATHCrossRefGoogle Scholar
  33. Ramer, A., 1987, Uniqueness of Information Measure in the Theory of Evidence, Fuzzy Sets and Systems, Vol. 24, No. 2, pp. 183–196.MathSciNetMATHCrossRefGoogle Scholar
  34. Rényi, A., 1970, Probability Theory,North-Holland, Amsterdam, (Chapter IX, Introduction to Information Theory,pp. 540–616).Google Scholar
  35. Ruspini, E. H., 1982, Possibility Theory Approaches for Advanced Information Systems, Computer, Sept. 1982, pp. 83–91.Google Scholar
  36. Shafer, G., 1976, A Mathematical Theory of Evidence, Princeton University Press, Princeton. Simon, H. A., 1969, The Sciences of the Artificial, MIT Press, Cambridge, Mass.Google Scholar
  37. Skilling, J. 1986, Theory of Maximum Entropy Image Reconstruction, Maximum Entropy and BayesianMethods in Applied Statistics,Justice, J. H. ed., Cambridge University Press, Cambridge.Google Scholar
  38. Umano, M., 1984, Retrieval from Fuzzy Database by Fuzzy Relational Algebra, Fuzzy Information Knowledge Representation and Decision Analysis, Sanchez, E., (ed.), Pergamon Press, Oxford, pp. 1–6.Google Scholar
  39. Wymore, A. W., 1969, A Mathematical Theory of Systems Engineering: The Elements, John Wiley, New York.Google Scholar
  40. Yager, R. R., 1979, On the Measure of Fuzziness and Negation. Part I: Membership in the Unit Interval, Intern. J. of General Systems, Vol. 5, No. 4, pp. 221–229.MathSciNetMATHCrossRefGoogle Scholar
  41. Yager, R. R., 1983, Entropy and Specificity in a Mathematical Theory of Evidence, Intern. J. of General Systems, Vol. 9, No. 4, pp. 249–260.MathSciNetMATHCrossRefGoogle Scholar
  42. Yager, R. R., 1986, Toward General Theory of Reasoning with Uncertainty: Nonspecificity and Fuzziness, Intern. J. of Intelligent Systems, Vol. 1, No. 1, pp. 45–67.MATHCrossRefGoogle Scholar
  43. Yager, R. R. et al. (eds.), 1987, Fuzzy Sets and Applications: Selected Papers by L.A. Zadeh, Wiley-Inter science, New York.Google Scholar
  44. Zeigler, B. P., 1976, Theory of Modelling and Simulation, John Wiley, New York.MATHGoogle Scholar
  45. Zemankova, M., and Kandel, A., 1985, Implementing Imprecision in Information Systems, Information Sciences, Vol. 37, pp. 107–141.MATHCrossRefGoogle Scholar

Copyright information

© Plenum Press, New York 1990

Authors and Affiliations

  • George J. Klir
    • 1
  1. 1.Department of Systems Science Thomas J. Watson SchoolState University of New YorkBinghamtonUSA

Personalised recommendations