Skip to main content

Additive and non-additive entropies of finite measurable partitions

Part of the Lecture Notes in Mathematics book series (LNM,volume 296)

Abstract

A geometrical representation of entropy leads to a generalization which, in special cases, reduces to the Shannon entropy and may easily be connected to the Rényi entropy. This, in two dimensions, is here called Parabolic entropy (which may further be generalized to higher dimensions). Parabolic entropy happens to be a particular case of Polynomial entropies of finite measurable partitions. Finally, some conditional entropies are defined and their properties have been studied in order to prepare a background for the study of entropy of endomorphisms etc. in ergodic theory and for proving Shannon-Wolfowitz coding theorem.

Keywords

  • Finite Field
  • Shannon Entropy
  • Concave Function
  • Continuous Solution
  • Conditional Entropy

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

This research work was supported by the NRC (Canada) grant No. A2977.

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (Canada)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   54.99
Price excludes VAT (Canada)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   69.99
Price excludes VAT (Canada)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Aczél, J. (1966), Lectures on Functional equations and their applications, Academic Press, New York.

    MATH  Google Scholar 

  2. Arnold, V. I. and Avez, A., (1968), Ergodic Problems of Classical Mechanics, W. A. Benjamin, Inc., New York.

    MATH  Google Scholar 

  3. Behara, M. (1968), "Entropy as a Measure of Utility in Decision Theory. Invited paper presented at Mathematisches Institut, Oberwolfach, W. Germany.

    Google Scholar 

  4. Billingsley, P. (1965), Ergodic Theory and Information, John Wiley and Sons, Inc., New York.

    MATH  Google Scholar 

  5. Brown, T. A. (1963), Entropy and Conjugacy, Ann. Math. Stat., 34, 226–232.

    CrossRef  MathSciNet  MATH  Google Scholar 

  6. Chaundy, T. W.; Mcleod, J. B. (1960). "On a Functional equation", Proc. Edin. Math. Soc. Notes, 43 7–8.

    CrossRef  MathSciNet  MATH  Google Scholar 

  7. Hardy, G. H.; Littlewood, J. E.; Polya, G. (1952), Inequalities, London, Cambridge Univ. Press.

    MATH  Google Scholar 

  8. Meshalkin, L. D. (1959), "A case of isomorphism of Bernoulli schemes", Dokl. Akad. Nauk. SSSR, 128, 41–44

    MathSciNet  Google Scholar 

  9. Renyi, A. (1961) "On Measures of Entropy and Information", Proc. Fourth Berk. Symp. on Math. Stat. and Prob. 1, 547–561.

    MathSciNet  MATH  Google Scholar 

  10. Renyi, A. (1960), "Az informacióelmélét Nehány alepvető kerdése", A Mag. Tud. Akad. III (Mat. es Fiz), Ostal. kozl. 257–282.

    Google Scholar 

  11. Shannon, C. E. (1948), "A Mathematical theory of communication", Bell Sys. Tech. Jour., 27; 379–423, 623–656.

    CrossRef  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 1973 Springer-Verlag

About this paper

Cite this paper

Behara, M., Nath, P. (1973). Additive and non-additive entropies of finite measurable partitions. In: Behara, M., Krickeberg, K., Wolfowitz, J. (eds) Probability and Information Theory II. Lecture Notes in Mathematics, vol 296. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0059821

Download citation

  • DOI: https://doi.org/10.1007/BFb0059821

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-06211-0

  • Online ISBN: 978-3-540-38485-4

  • eBook Packages: Springer Book Archive