Skip to main content
Log in

More on a New Concept of Entropy and Information

  • Published:
Journal of Theoretical Probability Aims and scope Submit manuscript

An alternative notion of entropy called CRE is proposed in [Ra1] Rao et al. (IEEE Trans. Inf. Theory 50, 2004). This preserves many of the properties of Shannon Entropy and possesses mathematical properties, which we hope will be of use in statistical estimates. In this article, we develop some more mathematical properties of CRE, show its relation to the L log L class, and characterize among others the Weibull distribution.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. T. M. Cover J. A. Thomas (1991) Elements of Information Theory Wiley New York

    Google Scholar 

  2. H. Federer (1969) Geometric Measure Theory Springer Berlin

    Google Scholar 

  3. Grendar M. Jr., and Grendar M. (2000). What is the Question that MaxEnt answers? Bayesian Inference And Maximum Entropy Methods In Science and Engineering. 20th International Workshop Gif-sur-Yvette, France. Ed. Ali Mohammad-Djafari American Institute of Physics Conference Proceedings 568.

  4. Jumarie G. (1990). Relative Information, Springer.

  5. Kalbfleisch J. D., and Prentice R. L. (1980). The Statistical Analysis of Failure Time Data Wiley Series in Probability.

  6. J. N. Kapur (1989) Maximum Entropy Methods in Science and Engineering Wiley New York

    Google Scholar 

  7. M. A. Krasnoselskli Ya.B. Rutickii (1961) Convex Functions and Orlicz Spaces Noordhoff Leiden

    Google Scholar 

  8. R. O’Neil (1966) ArticleTitleLes fonctiones conjugues et les integrales fractionnaires de la classe Llog+, L C.R. Acad.Sci.Paris 263 463–466

    Google Scholar 

  9. Rao M., Chen Y., Vemuri B., and Fei W. (2004). Cumulative residual entropy : a new measure of information. IEEE Trans.Inf.Theory 50.

  10. Shannon, C. E. (1948). A mathematical theory of communication. Bell System Tech.J. 27, 379–423, 623–656.

    Google Scholar 

  11. E. M. Stein (1969) ArticleTitleNote on the Class L log L Studia Math. 32 305–310

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Murali Rao.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Rao, M. More on a New Concept of Entropy and Information. J Theor Probab 18, 967–981 (2005). https://doi.org/10.1007/s10959-005-7541-3

Download citation

  • Received:

  • Revised:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10959-005-7541-3

Key words

Navigation