Using Quality Measures in the Intelligent Fusion of Probabilistic Information

  • Ronald R. YagerEmail author
  • Frederick E. Petry
Part of the Information Fusion and Data Science book series (IFDS)


Our objective here is to obtain quality-fused values from multiple sources of probabilistic distributions, where quality is related to the lack of uncertainty in the fused value and the use of credible sources. We first introduce a vector representation for a probability distribution. With the aid of the Gini formulation of entropy, we show how the norm of the vector provides a measure of the certainty, i.e., information, associated with a probability distribution. We look at two special cases of fusion for source inputs, those that are maximally uncertain and certain. We provide a measure of credibility associated with subsets of sources. We look at the issue of finding the highest-quality fused value from the weighted aggregation of source-provided probability distributions.


Quality measures Information fusion Entropy Credibility Choquet integral 



Ronald Yager was supported in part by an ONR grant award. Fred Petry would like to thank the Naval Research Laboratory’s Base Program, Program Element No. 0602435N for their sponsorship.


  1. 1.
    R. Pirsig, Zen and the Art of Motorcycle Maintenance: An Inquiry into Values (HarperCollins, New York, 1999)Google Scholar
  2. 2.
    J. Evans, W. Lindsay, The Management and Control of Quality (South-Western College Publications, Cincinnati, 1999)Google Scholar
  3. 3.
    H. Miller, The multiple dimensions of information quality. Inf. Syst. Manag. 13(2), 79–82 (1996)CrossRefGoogle Scholar
  4. 4.
    J.-E. Mai, The quality and qualities of information. J. Am. Soc. Inf. Sci. Technol. 64(4), 675–688 (2013)CrossRefGoogle Scholar
  5. 5.
    D.L. Hall, C.Y. Chong, J. Llinas, M. Liggins, Distributed Data Fusion for Network-Centric Operations (CRC Press, Boca Raton, 2012)CrossRefGoogle Scholar
  6. 6.
    P. Elmore, F.E. Petry, R.R. Yager, Comparative measures of aggregated uncertainty representations. J. Ambient. Intell. Humaniz. Comput. 5, 809–819 (2014)CrossRefGoogle Scholar
  7. 7.
    H. Bustince, P. Burillo, Correlation of interval-valued intuitionistic fuzzy sets. Fuzzy Set. Syst. 74, 237–244 (1995)MathSciNetCrossRefGoogle Scholar
  8. 8.
    M.R. Spiegal, D. Lipschutz, D. Spellman, Vector Analysis (John Wiley, Hoboken, 2009)Google Scholar
  9. 9.
    R.R. Yager, N. Alajlan, An intelligent interactive approach to group aggregation of subjective probabilities, Technical report MII-3502, Machine Intelligence Institute, Iona College, New Rochelle, NY, 2015Google Scholar
  10. 10.
    S. Kullback, Information Theory and Statistics (John Wiley and Sons, New York, 1959)zbMATHGoogle Scholar
  11. 11.
    B. Buck, Maximum Entropy in Action: A Collection of Expository Essays (Oxford University Press, New York, 1991)Google Scholar
  12. 12.
    J. Aczel, Z. Daroczy, On Measures of Information and their Characterizations (Academic, New York, 1975)zbMATHGoogle Scholar
  13. 13.
    R.R. Yager, K. Engemann, Entropy measures in sports. Int. J. Syst. Meas. Decis. 1, 67–72 (1981)Google Scholar
  14. 14.
    R.R. Yager, V. Kreinovich, Entropy conserving transforms and the entailment principle. Fuzzy Sets Syst. 158, 1397–1405 (2007)MathSciNetCrossRefGoogle Scholar
  15. 15.
    D.G. Luenberger, Information Science (Princeton University Press, Princeton, 2006)Google Scholar
  16. 16.
    C. Gini, Variabilità e mutabilità,” Reprinted in Memorie di Metodologica Statistica, ed. by E. Pizetti, T. Salvemini (Libreria Eredi Virgilio Veschi, Rome, 1955Google Scholar
  17. 17.
    P.-T. De Boer, D.P. Kroese, S. Mannor, R.Y. Rubinstein, A tutorial on the cross-entropy method. Ann. Oper. Res. 134, 19–67 (2005)MathSciNetCrossRefGoogle Scholar
  18. 18.
    R.Y. Rubinstein, D.P. Kroese, The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte-Carlo Simulation, and Machine Learning (Springer-Verlag, New York, 2004)CrossRefGoogle Scholar
  19. 19.
    L.A. Zadeh, A computational approach to fuzzy quantifiers in natural languages. Comput. Math. Appl. 9, 149–184 (1983)MathSciNetCrossRefGoogle Scholar
  20. 20.
    T. Takagi, M. Sugeno, Fuzzy identification of systems and its application to modeling and control. IEEE Trans. Syst. Man Cybern. 15, 116–132 (1985)CrossRefGoogle Scholar
  21. 21.
    R.R. Yager, Modeling prioritized multi-criteria decision making. IEEE Trans. Syst. Man Cybern. B 34, 2396–2404 (2004)CrossRefGoogle Scholar
  22. 22.
    R.R. Yager, Prioritized aggregation operators. Int. J. Approx. Reason. 48, 263–274 (2008)MathSciNetCrossRefGoogle Scholar
  23. 23.
    R.R. Yager, On prioritized multiple criteria aggregation. IEEE Trans. Syst. Man Cybern. B 42, 1297–1305 (2012)CrossRefGoogle Scholar
  24. 24.
    L.A. Zadeh, Fuzzy logic = computing with words. IEEE Trans. Fuzzy Syst. 4, 103–111 (1996)CrossRefGoogle Scholar
  25. 25.
    Z. Wang, G.J. Klir, Generalized Measure Theory (Springer, New York, 2009)CrossRefGoogle Scholar
  26. 26.
    G. Beliakov, A. Pradera, T. Calvo, Aggregation Functions: A Guide for Practitioners (Springer, Heidelberg, 2007)zbMATHGoogle Scholar
  27. 27.
    E.P. Klement, R. Mesiar, E. Pap, A universal integral as common frame for Choquet and Sugeno. IEEE Trans. Fuzzy Syst. 18, 178–187 (2010)CrossRefGoogle Scholar
  28. 28.
    Z. Wang, R. Yang, K.-S. Leung, Nonlinear Integrals and Their Applications in Data Mining (World Scientific, Singapore, 2010)CrossRefGoogle Scholar
  29. 29.
    J.L. Marichal, M. Roubens, “Entropy of discrete fuzzy measures,” in Proceedings of Third International Workshop on Preferences and Decisions, Trento, pp. 135–148, 2000Google Scholar
  30. 30.
    T. Murofushi, A technique for reading fuzzy measures (i): the Shapely value with respect to a fuzzy measure, in Proceedings Second Fuzzy Workshop, Nagaoka, Japan (in Japanese), pp. 39–48, 1992Google Scholar
  31. 31.
    R.R. Yager, On the entropy of fuzzy measures. IEEE Trans. Fuzzy Sets Syst. 8, 453–461 (2000)MathSciNetCrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Iona CollegeNew RochelleUSA
  2. 2.Naval Research LaboratoryStennis Space CenterSt. LouisUSA

Personalised recommendations