Skip to main content
SpringerLink
Log in

Cross entropy of mass function and its application in similarity measure

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Dempster-Shafer (D-S) evidence theory needs the weaker conditions than Bayesian probability theory by assigning the probability into power sets. Hence it has the more stronger ability to express imprecise and unknown information which can be used in many fields. In D-S evidence theory, how to measure the cross entropy between different mass functions is also an open issue. Hence, the paper proposed the new cross entropy by considering the cardinality of mass function which is compatible with classical cross entropy. In addition, there are some numerical examples to explain the reasonableness of proposed cross entropy. Cross entropy can describe the difference of information. Similarity is also an effective method to measure the non-difference of information. It is an interesting question to set the relationship between cross entropy and similarity. Hence, the paper proposed similarity measure based on the entropy and cross entropy. Besides, the paper also discussed some measurement axioms of proposed similarity measure to verify its reasonableness. Finally, based on the new similarity measure, the paper proposed new classification method under D-S evidence theory. The IRIS data set is used to the classification method to verify the effectiveness of its by setting different the number of training data and comparing with other methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

References

  1. Jin Y, Branke J (2005) Evolutionary optimization in uncertain environments-a survey. IEEE Trans Evol Comput 9(3):303–317

    Article  Google Scholar 

  2. Yager RR (2018) Decision making under measure-based granular uncertainty. Granul Comput 3(4):345–353

    Article  Google Scholar 

  3. Shafer G (1976) A mathematical theory of evidence, vol 42. Princeton university press

  4. Dempster AP (1967) Upper and lower probabilities induced by a multivalued mapping. Ann Math Stat 38(2):325–339

    Article  MathSciNet  MATH  Google Scholar 

  5. Zadeh LA (1965) Fuzzy sets. Inf Control 8(3):338–353

    Article  MATH  Google Scholar 

  6. Pawlak Z (1982) Rough sets. Int J Comput Inf Sci 11(5):341–356

    Article  MATH  Google Scholar 

  7. Zadeh LA (2011) A note on z-numbers. Inf Sci 181(14):2923–2932

    Article  MATH  Google Scholar 

  8. Liu Q, Tian Y, Kang B (2019) Derive knowledge of z-number from the perspective of dempster–shafer evidence theory. Eng Appl Artif Intell 85:754–764

    Article  Google Scholar 

  9. Xue Y, Deng Y (2021) A new belief structure based on cardinality measure. Comput Appl Math 40(2):1–18

    Article  MathSciNet  MATH  Google Scholar 

  10. Liu Z, Liu Y, Dezert J, Cuzzolin F (2020) Evidence combination based on credal belief redistribution for pattern classification. IEEE Trans Fuzzy Syst 4:618–631

    Article  Google Scholar 

  11. Xue Y, Deng Y (2020) Entailment for intuitionistic fuzzy sets based on generalized belief structures. Int J Intell Syst 35(6):963–982

    Article  Google Scholar 

  12. Bai L, Liang J, Du H, Guo Y (2019) An information-theoretical framework for cluster ensemble. IEEE Trans Knowl Data Eng 31(8):1464–1477

    Google Scholar 

  13. Abellan J, Bosse E (2020) Critique of recent uncertainty measures developed under the evidence theory and belief intervals. IEEE Trans Syst Man Cybern 50(3):1186–1192

    Article  Google Scholar 

  14. Xiao F (2020) GIQ: A Generalized intelligent quality-based approach for fusing multi-source information. IEEE Transactions on Fuzzy Systems. https://doi.org/10.1109/TFUZZ.2020.2991296

  15. Zhao J, Deng Y (2020) Complex network modeling of evidence theory. IEEE Transactions on Fuzzy Systems. https://doi.org/10.1109/TFUZZ.2020.3023760

  16. Yang J, Xu D (2013) Evidential reasoning rule for evidence combination. Artif Intell 205:1–29

    Article  MathSciNet  MATH  Google Scholar 

  17. Akhoundi A, Nazif S (2018) Sustainability assessment of wastewater reuse alternatives using the evidential reasoning approach. J Cleaner Prod 195:1350–1376

    Article  Google Scholar 

  18. Razi S, Mollaei MRK, Ghasemi J (2019) A novel method for classification of bci multi-class motor imagery task based on dempster–shafer theory. Inf Sci 484:14–26

    Article  Google Scholar 

  19. Liu Z-G, Huang L-Q, Zhou K, Denoeux T Combination of transferable classification with multisource domain adaptation based on evidential reasoning. IEEE Transactions on Neural Networks and Learning Systems

  20. Deng X, Jiang W (2018) An evidential axiomatic design approach for decision making using the evaluation of belief structure satisfaction to uncertain target values. Int J Intell Syst 33(1):15–32

    Article  Google Scholar 

  21. Koksalmis E, Kabak Ö (2020) Sensor fusion based on dempster-shafer theory of evidence using a large scale group decision making approach. Int J Intell Syst 35(7):1126–1162

    Article  Google Scholar 

  22. Li D, Deng Y, Cheong KH (2021) Multisource basic probability assignment fusion based on information quality. Int J Intell Syst 36(4):1851–1875

    Article  Google Scholar 

  23. Gao X, Pan L, Deng Y (2021) Quantum pythagorean fuzzy evidence theory (qpfet): A negation of quantum mass function view. IEEE Transactions on Fuzzy Systems. https://doi.org/10.1109/TFUZZ.2021.3057993

  24. Vandoni J, Aldea E, Le Hégarat-Mascle S (2019) Evidential query-by-committee active learning for pedestrian detection in high-density crowds. Int J Approx Reason 104:166–184

    Article  MathSciNet  Google Scholar 

  25. Li Y, Xiao F (2021) A novel dynamic weight allocation method for multisource information fusion. Int J Intell Syst 36(2):736–756

    Article  Google Scholar 

  26. Su Z, Denoeux T (2019) Bpec: Belief-peaks evidential clustering. IEEE Trans Fuzzy Syst 27 (1):111–123

    Article  Google Scholar 

  27. Mi X, Kang B (2020) On the belief universal gravitation (bug). Comput Ind Eng 148:106685

  28. Kong G, Xu D, Yang J, Ma X (2015) Combined medical quality assessment using the evidential reasoning approach. Expert Syst Appl 42(13):5522–5530

    Article  Google Scholar 

  29. Deng Y (2021) Uncertainty measure in evidence theory. Sci China Inf Sci 63(11):1–19

    MathSciNet  Google Scholar 

  30. Wu X, Wang J (2017) Cross-entropy measures of multivalued neutrosophic sets and its application in selecting middle-level manager. Int J Uncertain Quantif 7(2):155–176

    Article  Google Scholar 

  31. Silva AMLD, Castro JFC, Billinton R (2018) Probabilistic assessment of spinning reserve via cross-entropy method considering renewable sources and transmission restrictions. IEEE Trans Power Syst 33 (4):4574–4582

    Article  Google Scholar 

  32. Qiao D, Wang X, Wang J, Chen K (2019) Cross entropy for discrete z -numbers and its application in multi-criteria decision-making. Int J Fuzzy Syst 21(6):1786–1800

    Article  Google Scholar 

  33. Silva AMLD, De Castro AM (2019) Risk assessment in probabilistic load flow via monte carlo simulation and cross-entropy method. IEEE Trans Power Syst 34(2):1193–1202

    Article  Google Scholar 

  34. Khalaj M, Tavakkoli-Moghaddam R, Khalaj F, Siadat A (2020) New definition of the cross entropy based on the dempster-shafer theory and its application in a decision-making process. Commun Stat-Theory Methods 49(4):909–923

    Article  MathSciNet  Google Scholar 

  35. Cao Z, Ding W, Wang Y, Hussain FK, Aljumaily A, Lin C (2020) Effects of repetitive ssveps on eeg complexity using multiscale inherent fuzzy entropy. Neurocomputing 389:198–206

    Article  Google Scholar 

  36. Jirousek R, Shenoy PP (2018) A new definition of entropy of belief functions in the dempster–shafer theory. Int J Approx Reason 92:49–65

    Article  MathSciNet  MATH  Google Scholar 

  37. Athira TM, John SJ, Garg H (2019) Entropy and distance measures of pythagorean fuzzy soft sets and their applications. J Intell Fuzzy Syst 37(3):4071–4084

    Article  Google Scholar 

  38. Deng Y (2016) Deng entropy. Chaos Solitons Fractals 91:549–553

    Article  MATH  Google Scholar 

  39. Jaunzemis AD, Holzinger MJ, Chan MW, Shenoy PP (2019) Evidence gathering for hypothesis resolution using judicial evidential reasoning. Inf Fusion 49:26–45

    Article  Google Scholar 

  40. Buono F, Longobardi M (2020) A dual measure of uncertainty: The deng extropy. Entropy 22(5):582

    Article  MathSciNet  Google Scholar 

  41. Song Y, Wang X, Lei L, Quan W, Huang W (2016) An evidential view of similarity measure for atanassov’s intuitionistic fuzzy sets. J Intell Fuzzy Syst 31(3):1653–1668

    Article  MATH  Google Scholar 

  42. Liu Z, Dezert J, Pan Q, Mercier G (2011) Combination of sources of evidence with different discounting factors based on a new dissimilarity measure 52(1):133–141

  43. Jousselme A-L, Grenier D, Bossé É (2001) A new distance between two bodies of evidence. Inf Fusion 2(2):91–101

    Article  Google Scholar 

  44. Diaz J, Rifqi M, Bouchon-Meunier B (2006) A similarity measure between basic belief assignments. In: 2006 9th International Conference on Information Fusion. IEEE, pp 1–6

  45. Sunberg Z, Rogers J (2013) A belief function distance metric for orderable sets. Inf Fusion 14 (4):361–373

    Article  Google Scholar 

  46. Jiang W (2018) A correlation coefficient for belief functions. Int J Approx Reason 103:94–106

    Article  MathSciNet  MATH  Google Scholar 

  47. Khalaj F, Khalaj M (2020) Developed cosine similarity measure on belief function theory: an application in medical diagnosis. Communications in Statistics-Theory and Methods, pp 1–12

  48. Xiao F (2019) Multi-sensor data fusion based on the belief divergence measure of evidences and the belief entropy. Inf Fusion 46:23–32

    Article  Google Scholar 

  49. Basir OA, Yuan X (2007) Engine fault diagnosis based on multi-sensor information fusion using dempster-shafer evidence theory. Inf Fusion 8(4):379–386

    Article  Google Scholar 

  50. Zhu J, Wang X, Song Y (2018) A new distance between bpas based on the power-set-distribution pignistic probability function. Appl Intell 48(6):1506–1518

    Article  Google Scholar 

  51. Smets P (1994) The transferable belief model. Artif Intell 66(2):191–234

    Article  MathSciNet  MATH  Google Scholar 

  52. Seiti H, Hafezalkotob A (2018) Developing pessimistic–optimistic risk-based methods for multi-sensor fusion: an interval-valued evidence theory approach. Appl Soft Comput 72:609–623

    Article  Google Scholar 

  53. Zhang P, Tian Y, Kang B (2020) A new synthesis combination rule based on evidential correlation coefficient. IEEE Access 8:39898–39906

    Article  Google Scholar 

  54. Dutta P (2018) An uncertainty measure and fusion rule for conflict evidences of big data via dempster–shafer theory. Int J Image Data Fusion 9(2):152–169

    Article  Google Scholar 

  55. Smets P, Kennes R (1994) The transferable belief model. Artif Intell 66(2):191–234

    Article  MathSciNet  MATH  Google Scholar 

  56. Shore J, Johnson R (1980) Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy. IEEE Trans Inf Theory 26(1):26–37

    Article  MathSciNet  MATH  Google Scholar 

  57. Garg H, Rani D (2021) Novel similarity measure based on the transformed right-angled triangles between intuitionistic fuzzy sets and its applications. Cogn Comput 13(2):447–465

    Article  Google Scholar 

  58. Pan L, Gao X, Deng Y, Cheong KH (2021) The constrained pythagorean fuzzy sets and its similarity measure. IEEE Transactions on Fuzzy Systems. https://doi.org/10.1109/TFUZZ.2021.3052559

  59. Xiao F (2020) A new divergence measure for belief functions in d–s evidence theory for multisensor data fusion. Inf Sci 514:462–483

    Article  MathSciNet  MATH  Google Scholar 

  60. Murphy CK (2000) Combining belief functions when evidence conflicts. Decis Support Syst 29 (1):1–9

    Article  Google Scholar 

  61. Yong D, Wenkang S, Zhenfu Z, Qi L (2004) Combining belief functions based on distance of evidence 38(3):489–493

Download references

Acknowledgments

The work is partially supported by National Natural Science Foundation of China (Grant Nos. 61973332), JSPS Invitational Fellowships for Research in Japan (Short-term), China Scholarship Council.

Author information

Authors and Affiliations

  1. Institute of Fundamental and Frontier Science, University of Electronic Science and Technology of China, Chengdu, 610054, China

    Xiaozhuan Gao, Lipeng Pan & Yong Deng

  2. School of Education, Shaanxi Normal University, Xi’an, China

    Yong Deng

  3. School of Knowledge Science, Japan Advanced Institute of Science and Technology, Nomi, Ishikawa, 923-1211, Japan

    Yong Deng

  4. Department of Management, Technology, and Economics, ETH Zurich, Zurich, Switzerland

    Xiaozhuan Gao & Yong Deng

Authors
  1. Xiaozhuan Gao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lipeng Pan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yong Deng
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yong Deng.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gao, X., Pan, L. & Deng, Y. Cross entropy of mass function and its application in similarity measure. Appl Intell 52, 8337–8350 (2022). https://doi.org/10.1007/s10489-021-02890-6

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-021-02890-6

Keywords

Search

Navigation