Skip to main content
SpringerLink
Log in

Some Notes on the Concepts of Entropy and Information

  • Published:
Scientific and Technical Information Processing Aims and scope

Abstract—The definition of entropy as the intensity of a probabilistic process is substantiated. The concept of an abstract process is introduced, on the basis of which information is defined as the internal relation of feedback systems. A new approach to determining the amount of information for deterministic systems is proposed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

REFERENCES

  1. Chernavskii, D.S., Sinergetika i informatsiya: Dinamicheskaya teoriya informatsii (Synergetics and Information: Dynamic Information Theory), Moscow: Nauka, 2001.

  2. Shannon, C., Raboty po teorii informatsii i kibernetike (Works on Information Theory and Cybernetics), Moscow: Ionstr. Liter., 1963.

  3. Kolmogorov, A.N., Teoriya informatsii i teoriya algoritmov (Information Theory and Algorithm Theory), Moscow: Nauka, 1987.

  4. Ross, A.W., An Introduction to Cibernetics, Chapman and Hall LTD, 1956.

    Google Scholar 

  5. Wiener, N., Cibernetics: Or Control and Communication in the Animal and the Machine, New York–London: The M.I.T. Press and John Willey & Sons Inc., 1961.

    MATH  Google Scholar 

  6. Kurtseva, G.V., Theses on cybernetics and synergetics, in Novye idei v filosofii. Evristicheskiye funktsii nauchnoy filosofii: Mezhvuz. sb. nauch. tr. (New Ideas in Philosophy. Heuristic Functions of Scientific Philosophy: Interuniversity Papers), Perm: Permsk. Gos. Univ., 2002, vol. 11, pp. 169–173.

  7. Shen’, A.Kh., Algoritmicheskaya teoriya informatsii (Algorithmic information theory), Moscow: Nauka, 1987, p. 257.

  8. Korshunov, A.I., Introduction to the theory of structural and technological complexity of engineering products, Sovrem. Naukoemkie Tekhnol., 2004, no. 2, pp. 66–67.

  9. Sharin, Yu.S., Yakimovich, B.A., Tolmachev, V.G., and Korshunov, A.I., Teoriya slozhnosti (Complexity Theory), Izhevsk: Izhevsk. Gos. Tekh. Univ., 1999.

  10. Vigo, R., Categorical invariance and structural complexity in human concept learning, J. Math. Psychol., 2009, vol. 53, pp. 203–221.

    Article  MathSciNet  Google Scholar 

  11. Vigo, R., Representational information: A new general notion and measure of information, Inf. Sci., 2011, vol. 181, no. 21, pp. 4847–4859.

    Article  MathSciNet  Google Scholar 

  12. Murphy, G.L., The Big Book of Concepts, Cambridge, MA: MIT Press, 2002.

    Book  Google Scholar 

  13. Blyumenfel’d, L.A., Thermodynamics, information, and design of biological systems, Sorovskii Obraz. Zh., 1996, no. 7, pp. 88–92.

  14. Opanasyuk, Z.V., The psychophysiological paradox and the problem of development, in Novye idei v filosofii. Evristicheskie funktsii nauchnoi filosofii: Mezhvuz. sb. nauch. tr. (New Ideas in Philosophy. Heuristic Functions of Scientific Philosophy: Interuniversity Papers), Perm: Permsk. Gos. Univ., 2002, vol. 11, pp. 118–123.

  15. Maklakov, A.G., Obshchaya psikhologiya (General Psychology), St. Petersburg: Piter, 2001.

  16. Anokhin, P.K., Ocherki po fiziologii funktsional’nykh sistem (Essays on the Physiology of Functional Systems), Moscow: Meditsina, 1975, pp. 17–62.

  17. Anokhin, P.K., Filosofskie aspekty teorii funktsional’noi sistemy: Izbr. tr. (Philosophical Aspects of the Theory of Functional Systems: Selected Works), Moscow: Nauka, 1978.

  18. Miloslavov, A.S., What is complexity?, Nauchno-Tekh. Vestn. SPbGU ITMO, 2007, no. 36, pp. 27–35.

  19. Buslenko, N.P., Kalashnikov, N.N., and Kovalenko, I.N., Lektsii po teorii slozhnykh sistem (Lectures on the Theory of Complex Systems), Moscow: Sov. Radio, 1973.

Download references

Author information

Authors and Affiliations

  1. All-Russian Institute of Scientific and Technical Information, 125315, Moscow, Russia

    G. V. Kurtseva

Authors
  1. G. V. Kurtseva
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to G. V. Kurtseva.

Ethics declarations

The authors declare that they have no conflicts of interest.

Additional information

Translated by L. Solovyova

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kurtseva, G.V. Some Notes on the Concepts of Entropy and Information. Sci. Tech. Inf. Proc. 47, 65–71 (2020). https://doi.org/10.3103/S0147688220010116

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.3103/S0147688220010116

Keywords:

Search

Navigation