Generalized Information Theory Based on the Theory of Hints
- 684 Downloads
The aggregate uncertainty is the only known functional for Dempster-Shafer theory that generalizes the Shannon and Hartley measures and satisfies all classical requirements for uncertainty measures, including subadditivity. Although being posed several times in the literature, it is still an open problem whether the aggregate uncertainty is unique under these properties. This paper derives an uncertainty measure based on the theory of hints and shows its equivalence to the pignistic entropy. It does not satisfy subadditivity, but the viewpoint of hints uncovers a weaker version of subadditivity. On the other hand, the pignistic entropy has some crucial advantages over the aggregate uncertainty. i.e. explicitness of the formula and sensitivity to changes in evidence. We observe that neither of the two measures captures the full uncertainty of hints and propose an extension of the pignistic entropy called hints entropy that satisfies all axiomatic requirements, including subadditivity, while preserving the above advantages over the aggregate uncertainty.
KeywordsGeneralized Information Theory Theory of Hints Dempster-Shafer Theory Pignistic Entropy Hints Entropy
Unable to display preview. Download preview PDF.
- 4.Harmanec, D.: Toward a characterization of uncertainty measure for the dempster-shafer theory. In: UAI 1995: Proc. of the 11th Conference Annual Conference on Uncertainty in Artificial Intelligence, pp. 255–261 (1995)Google Scholar
- 5.Harmanec, D.: Measure of uncertainty and information. In: Imprecise Probability Project (1999)Google Scholar
- 10.Klir, G.J.: Uncertainty and Information: Foundations of Generalized Information Theory. John Wiley & Sons, Inc., Binghamton University (2005)Google Scholar
- 14.Kohlas, J., Monney, P.-A.: Statistical Information. Assumption-Based Statistical Inference. Sigma Series in Stochastics, vol. 3. Heldermann (2008)Google Scholar
- 18.Schneuwly, C.: Information - eine diskussion. Term Paper, University of Fribourg (1999)Google Scholar
- 21.Smith, R.: Generalized Information Theory: Resolving some old Questions and opening some new ones. PhD thesis, University of Binghamton (2000)Google Scholar