Abstract
Four methods of statistical inference are discussed. These include the two well known non—entropy methods due to Fisher and Bayes and two entropic methods based on the principles of maximum entropy and minimum cross—entropy. The spheres of application of these methods are elucidated in order to give a comparative understanding. The discussion is interspersed with illustrative examples.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Burg, J. (1972). “The Relationship between Maximum Entropy Spectra and Maximum likelihood Spectra”. In Childrers, D., editor, Modern Spectral Analysis, pages 130–131. M.S.A.
Campbell, L. L. (1970). “Equivalence of Gauss’s Principle and Minimum Discrimination Estimation of Probabilities”. Ann. Math. Stat., 41, 1011–1013.
Cramer, H. (1957). “Mathematical Methods of Statistics”. Princeton University Press.
Fisher, R. (1921). “On the Mathematical Foundations of Theoretical Statistics”. Phil. Trans. Roy. Soc., 222 (A), 309–368.
Fougere, P., editor (1990). “Maximum Entropy And Bayesian Methods Proceedings of the 9th MaxEnt Workshop”. Kluwer Academic Publishers, New York.
Goel, P. K. and Zenner, A., editors (1986). “Bayesian Inference and Decision Techniques”. North-Holland, Amsterdam.
Grandy, W. T. J. and Schick, L. H., editors (1991). “Maximum Entropy and Bayesian Methods”. Kluwer Academic Press, Dordrecht.
Havrda, J. H. and Charvat, F. (1967). “Quantification Methods of Classication Processes: Concept of Structural a Entropy”. Kybernatika, 3, 30–35.
H.K.Kesavan and J.N.Kapur (1989). “The Generalized Maximum Entropy Principle”. IEEE Trans. Syst. Man. Cyb. 19, pages 1042–1052.
H.K.Kesavan and J.N.Kapur (1990a). Maximum Entropy and Minimum Cross Entropy Principles: Need for a Broader Perspective. In Fougere, P. F., editor, Maximum Entropy and Bayesian Methods, pages 419–432. Kluwer Academic Publishers.
H.K.Kesavan and J.N.Kapur (1990b). “On the Family of Solutions of Generalized Maximum and Minimum Cross-Entropy Models”. Int. Jour. Gen. Systems vol. 16, pages 199–219.
Jaynes, E. (1957). “Information Theory and Statistical Mechanics”. Physical Reviews, 106, 620–630.
J.G.Erickson and C.R.Smith, editors (1988). “Maximum Entropy and Bayesian Methods in Science and Engineering, vol 1 (Foundations), vol 2 ( Applications)”. Kluwer Academic Publishers, New York.
J.H.Justice, editor (1986). “Maximum Entropy and Bayesian Methods in Applied Statistics”. Cambridge University Press, Boston.
J.N.Kapur and H.K.Kesavan (1990). Inverse MaxEnt and MinxEnt Principles and their Applications. In Fougere, P. F., editor, Maximum Entropy and Bayesian Methods, pages 433–450. Kluwer Academic Publishers.
J.N.Kapur and Seth, A. (1990). A Comparative Assessment of Entropic and Non-Entropica Methods of Estimation. In Fougere, P. F., editor, Maximum Entropy and Bayesian Methods, pages 451–462. Kluwer Academic Publishers.
J.Skilling, editor (1989). “ Maximum Entropy and Baysean Methods”. Kluwer Academic Publishers, Doedrecht.
Kapur, J. (1989). “Maximum Entropy Models in Science and Engineering”. Wiley Eastern, New Delhi.
Kapur, J. and Kumar, V. (1987). “A measure of mutual divergence among a number of probability distributions”. Int. Jour. of Maths. and Math. Sci., 10, 3, 597–608.
Kapur, J. N. and Kesavan, H. K. (1989). “Generalized Maximum Entropy Principle (with Applications)”. Sandford Educational Press, University of Waterloo.
Kapur, J. N. and Kesavan, H. K. (1992). “Entropy Optimization Principles and their Applications”. Academic Press, San Diego.
Kullback, S. (1959). “Information Theory and Statistics”. John Wiley, New York.
Kullback, S. and Leibler, R. (1951). “On Information and Sufficiency”. Ann. Math. Stat., 22, 79–86.
Rao, C. R. (1989). “Statistical Data Analysis and Inference”. North-Holland, Amsterdam. Renyi, A. (1961). “On Measures of Entropy and Information”. Proc. 4th Berkeley Symp. Maths. Stat. Prob., 1, 547–561.
Seth, A. K. (1989). “Prof. J. N. Kapur’s Views on Entropy Optimization Principles”. Bull. Math Ass. Ind., 21,22, 1–38. 1–42.
Shannon, C. E. (1948). “Mathematical Theory of Communication”. Bell System Tech. Journal, 27, 1–4, 379–423, 623–656.
Smith, C. and W.T. Grandy, J., editors (1985). “Maximum-Entropy and Bayesian Methods on Inverse Problems”. D. Reidel, Doedrecht, Holland.
Theil, H. and Fiebig, D. (1984). “Exploiting Continuity: Maximum Entropy Estimation of Continuous Distributions”. Ballinger, Cambridge.
Tribus, M. (1966). “Rational Descriptions, Decisions and Designs”. Pergamon Press, Oxford. Wilks, S. S. (1963). “Mathematical Statistics”. John Wiley, New York.
Zellner, A. (1977). “Maximal data information prior distributions”. In Aykac, A. and Brumat, C., editors, New Developments in the Applications of Bayesian Methods. North Holland, Amsterdam.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1994 Springer Science+Business Media Dordrecht
About this chapter
Cite this chapter
Kapur, J.N., Kesavan, H.K., Baciu, G. (1994). Comparisons Between Bayesian and Entropic Methods for Statistical Inference. In: Hipel, K.W., McLeod, A.I., Panu, U.S., Singh, V.P. (eds) Stochastic and Statistical Methods in Hydrology and Environmental Engineering. Water Science and Technology Library, vol 10/3. Springer, Dordrecht. https://doi.org/10.1007/978-94-017-3083-9_12
Download citation
DOI: https://doi.org/10.1007/978-94-017-3083-9_12
Publisher Name: Springer, Dordrecht
Print ISBN: 978-90-481-4379-5
Online ISBN: 978-94-017-3083-9
eBook Packages: Springer Book Archive