Abstract
Contrary to the popular in the technical literature quantitative representation of entropy as a measure of the uncertainty of the occurrence of random events, its estimation is proposed based on the density and probability distribution functions. Constructing them using approximation methods is shown. At the core of the construction, the method of moments is used. In applied terms, two problems for the research of the transfer properties of a device with a constant and random coefficient of transmission are solved.
Similar content being viewed by others
References
Stratonovich, R.L. Information Theory, Moscow: Sov. Radio, 1975.
Hartley, R.V.L., The Information Transfer.In the book “Theory of Information and its Applications”, Moscow: IFML, 1958, pp. 5–35.
Gatsenko, O.Yu., Information Protection. Basis of Organizational Management, Saint-Petersburg: Sentyabr, 2001.
Smagin, V.A., About one method of study of non-Markov systems, Izvestiya AN of URSS. Technicheskaya kibernetica, 1983, vol. 6, pp. 31–36.
Smagin, V.A. and Philimonihin, G.V., About modelling of random processes in base of hyperdelta distribution, AVT, 1990, vol. 5, pp. 25–31.
Pugachev, V.S., Theory of random functions, Moscow: GIFML, 1962.
Author information
Authors and Affiliations
Corresponding author
Additional information
Original Russian Text © V.A. Smagin, S.Yu. Smagin, 2010, published in Avtomatika i Vychislitel’naya Tekhnika, 2010, No. 2, pp. 27–37.
About this article
Cite this article
Smagin, V.A., Smagin, S.Y. Approximate determination of the distribution of entropy. Aut. Conrol Comp. Sci. 44, 78–84 (2010). https://doi.org/10.3103/S0146411610020033
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.3103/S0146411610020033