Skip to main content
Log in

Approximate determination of the distribution of entropy

  • Published:
Automatic Control and Computer Sciences Aims and scope Submit manuscript

Abstract

Contrary to the popular in the technical literature quantitative representation of entropy as a measure of the uncertainty of the occurrence of random events, its estimation is proposed based on the density and probability distribution functions. Constructing them using approximation methods is shown. At the core of the construction, the method of moments is used. In applied terms, two problems for the research of the transfer properties of a device with a constant and random coefficient of transmission are solved.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Stratonovich, R.L. Information Theory, Moscow: Sov. Radio, 1975.

    Google Scholar 

  2. Hartley, R.V.L., The Information Transfer.In the book “Theory of Information and its Applications”, Moscow: IFML, 1958, pp. 5–35.

    Google Scholar 

  3. Gatsenko, O.Yu., Information Protection. Basis of Organizational Management, Saint-Petersburg: Sentyabr, 2001.

    Google Scholar 

  4. Smagin, V.A., About one method of study of non-Markov systems, Izvestiya AN of URSS. Technicheskaya kibernetica, 1983, vol. 6, pp. 31–36.

    MathSciNet  Google Scholar 

  5. Smagin, V.A. and Philimonihin, G.V., About modelling of random processes in base of hyperdelta distribution, AVT, 1990, vol. 5, pp. 25–31.

    Google Scholar 

  6. Pugachev, V.S., Theory of random functions, Moscow: GIFML, 1962.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to V. A. Smagin.

Additional information

Original Russian Text © V.A. Smagin, S.Yu. Smagin, 2010, published in Avtomatika i Vychislitel’naya Tekhnika, 2010, No. 2, pp. 27–37.

About this article

Cite this article

Smagin, V.A., Smagin, S.Y. Approximate determination of the distribution of entropy. Aut. Conrol Comp. Sci. 44, 78–84 (2010). https://doi.org/10.3103/S0146411610020033

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.3103/S0146411610020033

Keywords

Navigation