Theoretic Information Approach to Identification and Signal Processing

  • Kazimierz Sobczyk
Part of the Lecture Notes in Engineering book series (LNENG, volume 33)


In his pionieering work on the theory of communication systems Shannon showed that the concepts of entropy and mutual information are extremely useful and effective for evaluating the performance of communication systems. The fact that these concepts are so effective in communication theory is, very likely, responsible for the fact that the information theory is often considered as synonymous with communication. theory. This may also be a reason that relatively few conclusive results have been.obtained in other fields.with.use of the information theoretic approach.


Mutual Information Window Function Random Signal Random Initial Condition Information Theoretic Approach 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Kullback S., Information Theory and Statistics, Chapman and Hall New York, 1959.Google Scholar
  2. 2.
    Poplayskij R. P., Thermodynamical models of information processes, Usp.Fiz.Nauk, Vol. 115, Nr 3, 1975 (in Russian).Google Scholar
  3. 3.
    Csiszar I., Information measures: a critical survey, Seventh Prague Conf.on Inform.Theory, Statistical Decisions Functions and Stoch.Processes, Reidel, Dodrecht, 73–86, 1978.Google Scholar
  4. 4.
    Kerridge D. F., Inacuracy and inference, J.Roy.Statist.Soc., Ser.B Vol.23, 184–194, 1961.MATHMathSciNetGoogle Scholar
  5. 5.
    Goodwin C. C., Payne R. I., Dynamic System Identification; Experiment Design and Data Analysis, Acad.Press, N.York, 1977.MATHGoogle Scholar
  6. 6.
    Sobczyk K., On system identification, IFTR Reports, 26/1986Google Scholar
  7. 7.
    Blackman R. B., Tukey J. W., The Measurement of Power Spectra from the Point of View of Communication Engineering, Dover, N.York, 1959.Google Scholar
  8. 8.
    Oppenheim A. V., Schafer R. W., Digital Signal Processing, Prentice-Hall, N.York,l975.Google Scholar
  9. 9.
    Burg J. P., New concepts in power spectra estimation, 40-th Ann. Intern.Meeting, Soc.Exploration Geophysists, New Orleans, 1970.Google Scholar
  10. 10.
    Stratonovich R.L., Theory of Information (in Russian), Sov.Radio. Moskow,1975.Google Scholar
  11. 11.
    Bolotin V. V., Random Vibrations of Elastic Systems (in Russian), Nauka, Moskow, 1979.Google Scholar

Copyright information

© Springer-Verlag Berlin, Heidelberg 1987

Authors and Affiliations

  • Kazimierz Sobczyk
    • 1
  1. 1.Institute of Fundamental Technological ResearchPolish Academy of SciencesWarsawPoland

Personalised recommendations