Theoretic Information Approach to Identification and Signal Processing
In his pionieering work on the theory of communication systems Shannon showed that the concepts of entropy and mutual information are extremely useful and effective for evaluating the performance of communication systems. The fact that these concepts are so effective in communication theory is, very likely, responsible for the fact that the information theory is often considered as synonymous with communication. theory. This may also be a reason that relatively few conclusive results have been.obtained in other fields.with.use of the information theoretic approach.
KeywordsEntropy Covariance Autocorrelation Tral Tempo
Unable to display preview. Download preview PDF.
- 1.Kullback S., Information Theory and Statistics, Chapman and Hall New York, 1959.Google Scholar
- 2.Poplayskij R. P., Thermodynamical models of information processes, Usp.Fiz.Nauk, Vol. 115, Nr 3, 1975 (in Russian).Google Scholar
- 3.Csiszar I., Information measures: a critical survey, Seventh Prague Conf.on Inform.Theory, Statistical Decisions Functions and Stoch.Processes, Reidel, Dodrecht, 73–86, 1978.Google Scholar
- 6.Sobczyk K., On system identification, IFTR Reports, 26/1986Google Scholar
- 7.Blackman R. B., Tukey J. W., The Measurement of Power Spectra from the Point of View of Communication Engineering, Dover, N.York, 1959.Google Scholar
- 8.Oppenheim A. V., Schafer R. W., Digital Signal Processing, Prentice-Hall, N.York,l975.Google Scholar
- 9.Burg J. P., New concepts in power spectra estimation, 40-th Ann. Intern.Meeting, Soc.Exploration Geophysists, New Orleans, 1970.Google Scholar
- 10.Stratonovich R.L., Theory of Information (in Russian), Sov.Radio. Moskow,1975.Google Scholar
- 11.Bolotin V. V., Random Vibrations of Elastic Systems (in Russian), Nauka, Moskow, 1979.Google Scholar