Application of l1 Estimation of Gaussian Mixture Model Parameters for Language Identification

  • Danila Doroshin
  • Maxim Tkachenko
  • Nikolay Lubimov
  • Mikhail Kotov
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8113)


In this paper we explore the using of l 1 optimization for a parameter estimation of Gaussian mixture models (GMM) applied to the language identification. To train the Universal background model (UBM) at each step of Expectation maximization (EM) algorithm the problem of the GMM means estimation is stated as l 1 optimization. The approach is Iteratively reweighted least squares (IRLS). Also here is represented the corresponding solution of the Maximum a posteriori probability (MAP) adaptation. The results of the above UBM-MAP system combined with Support vector machine (SVM) are reported on the LDC and GlobalPhone datasets.


language identification irls map robust gmm estimation 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Penagarikano, M., Varona, A., Diez, M., Rodriguez Fuentes, L.J., Bordel, G.: Study of Different Backends in a State-Of-the-Art Language Recognition System. In: Proceedings of Interspeech, Portland, Oregon, USA (2012)Google Scholar
  2. 2.
    Martinez, D., Plchot, O., Burget, L., Glembek, O., Matejka, P.: Language Recognition in iVectors Space. In: Proceedings of Interspeech, Firenze, Italy, pp. 861–864 (2011)Google Scholar
  3. 3.
    Huber, P.J., Ronchetti, E.M.: Robust Statistics, 2nd edn. Wiley, New York (2009)zbMATHCrossRefGoogle Scholar
  4. 4.
    Forero, P.A., Kekatos, V., Giannakis, G.B.: Robust clustering using outlier-sparsity regularization. IEEE Trans. Sig. Proc. 60(8), 4163–4177 (2012)MathSciNetCrossRefGoogle Scholar
  5. 5.
    Kersten, P.: Fuzzy order statistics and their application to fuzzy clustering. IEEE Trans. Fuzzy Syst. 7(6), 708–712 (1999)MathSciNetCrossRefGoogle Scholar
  6. 6.
    Bobrowski, L., Bezdek, J.C.: C-means clustering with the l 1 and l  ∞  norms. IEEE Trans. Syst., Man, Cybern. 21(3), 545–554 (1991)MathSciNetzbMATHCrossRefGoogle Scholar
  7. 7.
    Frigui, H., Krishnapuram, R.: A robust competitive clustering algorithm with applications in computer vision. IEEE Trans. Pattern Anal. Mach. Intell. 21(5), 450–465 (1999)CrossRefGoogle Scholar
  8. 8.
    Chartrand, R., Yin, W.: Iteratively reweighted algorithms for compressive sensing. In: Proceedings of the 33rd International Conference on Acoustics, Speech, and Signal Processing, ICASSP (2008)Google Scholar
  9. 9.
    Dempster, A.P., Laird, N.M., Rubin, D.B.: Maximum likelihood from incomplete data via the EM algorithm. J. Royal Stat. Soc. B 39(1), 1–38 (1977)MathSciNetzbMATHGoogle Scholar
  10. 10.
    Young, S.J., Evermann, G., Gales, M.J.F., Hain, T., Kershaw, D., Moore, G., Odell, J., Ollason, D., Povey, D., Valtchev, V., Woodland, P.C.: The HTK Book, version 3.4, Cambridge University Engineering Department, Cambridge, UK (2006)Google Scholar
  11. 11.
    Gauvain, J.L., Lee, C.H.: Maximum a posteriori estimation for multivariate Gaussian mixture observations of Markov chains. IEEE Trans. Speech Audio Process. 2, 291–298 (1994)CrossRefGoogle Scholar
  12. 12.
    Campbell, W.M., Singer, E., Torres-Carrasquillo, P.A., Reynolds, D.A.: Language recognition with support vector machines. In: Proc. ODYS, pp. 41–44 (2004)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2013

Authors and Affiliations

  • Danila Doroshin
    • 1
  • Maxim Tkachenko
    • 1
  • Nikolay Lubimov
    • 1
  • Mikhail Kotov
    • 1
  1. 1.STEL Computer Systems Ltd.MoscowRussia

Personalised recommendations