Common Sense and Maximum Entropy
- Jeff Paris
- … show all 1 hide
Rent the article at a discountRent now
* Final gross prices may vary according to local VAT.Get Access
This paper concerns the question of how to draw inferences common sensically from uncertain knowledge. Since the early work of Shore and Johnson (1980), Paris and Vencovská (1990), and Csiszár (1989), it has been known that the Maximum Entropy Inference Process is the only inference process which obeys certain common sense principles of uncertain reasoning. In this paper we consider the present status of this result and argue that within the rather narrow context in which we work this complete and consistent mode of uncertain reasoning is actually characterised by the observance of just a single common sense principle (or slogan).
- Csiszár, I.: 1989, 'Why Least Squares and Maximum Entropy? An Axiomatic Approach to Inverse Problems', Mathematics Institute of the Hungarian Academy of Sciences, Preprint No. 19/1989.
- Kern-Isberner, G.: forthcoming, 'Characterising the Principle of Minimum Cross-Entropy within a Conditional-Logical Framework', to appear in Artificial Intelligence.
- Maung, I. and J. B. Paris: 1990, 'A Note on the Infeasibility of Some Inference Processes', International Journal of Intelligent Systems 5, 595-604.
- Paris, J. B.: 1994, The Uncertain Reasoner's Companion — A Mathematical Perspective, Cambridge University Press, Cambridge, UK.
- Paris, J. B. and A. Vencovská: 1989, 'Maximum Entropy and Inductive Inference', in J. Skilling (ed.), Maximum Entropy and Bayesian Methods, Kluwer Academic Publishers, pp. 397-403.
- Paris, J. B. and A. Vencovská: 1990, 'A Note on the Inevitability of Maximum Entropy', International Journal of Approximate Reasoning 4, 183-224. CrossRef
- Paris, J. B. and A. Vencovská: 1996a, 'Principles of Uncertain Reasoning', in A. Clark et al. (eds.), Philosophy and Cognitive Science, Kluwer Academic Press, pp. 221-59.
- Paris, J. B. and A. Vencovská: 1996b, 'Some Observations on the Maximum Entropy Inference Process', Technical Report L1-96, Department of Mathematics, Manchester University, UK.
- Paris, J. B. and A. Vencovská: 1997, 'In Defence of the Maximum Entropy Inference Process', International Journal of Approximate Reasoning 17, 77-103. CrossRef
- Shore, J. E. and R. W. Johnson: 1980, 'Axiomatic Derivation of the Principle of Maximum Entropy and the Principle of Minimum Cross-Entropy', IEEE Transactions on Information Theory IT-26(1), 26-37. CrossRef
- Van Fraasssen, Bas.: 1989, Laws and Symmetry, Clarendon Press, Oxford, UK.
- Common Sense and Maximum Entropy
Volume 117, Issue 1 , pp 75-93
- Cover Date
- Print ISSN
- Online ISSN
- Kluwer Academic Publishers
- Additional Links
- Industry Sectors
- Jeff Paris (1)
- Author Affiliations
- 1. Department of Mathematics Manchester, University Manchester, M13 9PL, UK