Radioelectronics and Communications Systems

, Volume 61, Issue 9, pp 419–430 | Cite as

Criterion for Minimum of Mean Information Deviation for Distinguishing Random Signals with Similar Characteristics

  • Vladimir V. Savchenko


The problem of distinguishing random signals with similar spectral and correlational characteristics is considered. To solve this problem, a criterion for a minimum of the mean divergence of the hypotheses taken with respect to the true distribution in the Kullback–Liebler information metric is proposed. Using this criterion, an optimal algorithm is synthesized, which allows achieving a guaranteed efficiency gain in discriminating random signals of similar structure. An example of its implementation in the problem of automatic speech recognition at the basic, phonetic level of signal processing is considered. Estimates of its effectiveness are obtained. Theoretical estimates of the effectiveness are confirmed by the results of the experiment. The author’s special-purpose information system was used for this. On the basis of the obtained results, recommendations are given for the practical application of the proposed criterion in problems of statistical signal processing, where a problem of verifying close statistical hypotheses arises.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    A. A. Kolchev, A. E. Nedopekin, “Application of model of mixture of probabilistic distributions for definition of the signals of radiophysical probing,” Radioelectron. Commun. Syst. 59, No. 8, 362 (2016). DOI: 10.3103/S0735272716080057.CrossRefGoogle Scholar
  2. 2.
    V. V. Skachkov, V. V. Chepkyi, H. D. Bratchenko, A. N. Efymchykov, “Entropy approach to the investigation of information capabilities of adaptive radio engineering system in conditions of intrasystem uncertainty,” Radioelectron. Commun. Syst. 58, No. 6, 241 (2015). DOI: 10.3103/S0735272715060011.CrossRefGoogle Scholar
  3. 3.
    A. M. Prodeus, V. S. Didkovskyi, “Objective estimation of the quality of radical noise suppression algorithms,” Radioelectron. Commun. Syst. 59, No. 11, 502 (2016). DOI: 10.3103/S0735272716110042.CrossRefGoogle Scholar
  4. 4.
    V. V. Savchenko, “Enhancement of the noise immunity of a voice-activated robotics control system based on phonetic word decoding method,” J. Commun. Technol. Electron. 61, No. 12, 1374 (2016). DOI: 10.1134/S1064226916120226.CrossRefGoogle Scholar
  5. 5.
    V. V. Savchenko, “Estimation of the phonetic speech quality using the information theoretic approach,” J. Commun. Technol. Electron. 63, No. 1, 53 (2018). DOI: 10.1134/S1064226918010126.CrossRefGoogle Scholar
  6. 6.
    A. V. Akimov, A. A. Sirota, “Synthesis and analysis of algorithms for digital signal recognition in conditions of deforming distortions and additive noise,” Radioelectron. Commun. Syst. 60, No. 10, 458 (2017). DOI: 10.3103/S0735272717100041.CrossRefGoogle Scholar
  7. 7.
    O. S. Neuimin, S. Ya. Zhuk, “Adaptive sequential detection of target trajectory using decision statistics of pips at the unknown signal-to-noise ratio,” Radioelectron. Commun. Syst. 59, No. 8, 352 (2016). DOI: 10.3103/S0735272716080045.CrossRefGoogle Scholar
  8. 8.
    V. V. Savchenko, “Solving the problem of multiple comparisons for automatic signal recognition at the output of the voice communication path,” Elektrosvyaz’, No. 12, 22 (2017).Google Scholar
  9. 9.
    A. V. Savchenko, “Clustering and maximum likelihood search for efficient statistical classification with medium-sized databases,” Optimization Lett. 11, No. 2, 329 (2017). DOI: 10.1007/s11590-015-0948-6.MathSciNetCrossRefzbMATHGoogle Scholar
  10. 10.
    E. Leman, Testing of Statistical Hypotheses [in Russian] (Nauka, Moscow, 1979).Google Scholar
  11. 11.
    A. A. Borovkov, Mathematical Statistics [in Russian] (Lan’, St. Petersburg, 2010).Google Scholar
  12. 12.
    B. R. Levin, Theoretical Fundamentals of Statistical Radioenginering, 3rd ed. (Radio i Svyaz’, Moscow, 1989).Google Scholar
  13. 13.
    E. L. Lehmann, J. P. Romano, Testing Statistical Hypotheses, 3rd ed. (Springer, New York, 2005). DOI: 10.1007/0-387-27605-X.zbMATHGoogle Scholar
  14. 14.
    A. I. Rybin, Yu. Kh. Nizhebetskaya, “Analysis of images similarity and difference using normal orthogonal conversion,” Radioelectron. Commun. Syst. 53, No. 3, 167 (2010). DOI: 10.3103/S0735272710030076.CrossRefGoogle Scholar
  15. 15.
    A. A. Popov, “Sampling theorem for signals of the space built on the generalized Boolean algebra with measure,” Radioelectron. Commun. Syst. 53, No. 1, 25 (2010). DOI: 10.3103/S073527271001005X.CrossRefGoogle Scholar
  16. 16.
    B. Y. Lemeshko, S. B. Lemeshko, S. N. Postovalov, “The power of goodness of fit tests for close alternatives,” Meas. Tech. 50, No. 2, 132 (2007). DOI: 10.1007/s11018-007-0036-0.CrossRefzbMATHGoogle Scholar
  17. 17.
    V. V. Savchenko, A. V. Savchenko, “Information-theoretic analysis of efficiency of the phonetic encoding-decoding method in automatic speech recognition,” J. Commun. Technol. Electron. 61, No. 4, 430 (2016). DOI: 10.1134/S1064226916040112.CrossRefGoogle Scholar
  18. 18.
    S. Ya. Zhuk, V. I. Kovalev, “Algorithm for combined filtering of the speech signal and estimate of the synchronization error in a two-channel measuring system,” Radioelectron. Commun. Syst. 43, No. 6, 36 (2000). URI: Scholar
  19. 19.
    A. V. Savchenko, “Sequential three-way decisions in efficient classification of piecewise stationary speech signals,” Int. Joint Conf. Rough Sets 10314, 264 (2017). DOI: 10.1007/978-3-319-60840-2_19.CrossRefGoogle Scholar
  20. 20.
    S. Kullback, Information Theory and Statistics (Dover Publications, New York, 1997).zbMATHGoogle Scholar
  21. 21.
    V. V. Savchenko, “Principle of minimax entropy for statistical classification problems,” Radioelectron. Commun. Syst. 33, No. 12, 35 (1990).Google Scholar
  22. 22.
    D. Zhou, J. C. Platt, S. Basu, Yi. Mao, “Learning from the Wisdom of crowds by minimax entropy,” Proc. of 25th Int. Conf. on Neural Information Processing Systems, 3–6 Dec. 2012, Lake Tahoe, Nevada, USA. 2012, Vol. 2, pp. 2195–2203.Google Scholar
  23. 23.
    S. L. Marple, Digital Spectral Analysis (Prentice Hall, Englewood Cliffs. NJ, 1987).Google Scholar
  24. 24.
    A. A. Bylinkin, S. L. Konov, “Methods of random signals recognition according to the form of spectrum,” Information Security Questions, No. 2, 30 (2017). URI: Scholar
  25. 25.
    A. A. Konev, R. V. Meshcheryakov, I. A. Khodashynskiy, “Recognition of vowel sounds using first and second harmonics,” Proc. of Sixth Interdisciplinary Seminar on Analysis of Spoken Russian Language (Saint Petersburg State University, 2012) [ed. by A. L. Ronzhyn], p. 35.Google Scholar

Copyright information

© Allerton Press, Inc. 2018

Authors and Affiliations

  1. 1.Nizhny Novgorod State Linguistic UniversityNizhny NovgorodRussia

Personalised recommendations