Abstract
The aim of this work is to propose a refinement of the shift-MLLR (shift Maximum Likelihood Linear Regression) adaptation of an acoustics model in the case of limited amount of adaptation data, which can lead to ill-conditioned transformations matrices. We try to suppress the influence of badly estimated transformation parameters utilizing the Artificial Neural Network (ANN), especially Convolutional Neural Network (CNN) with bottleneck layer on the end. The badly estimated shift-MLLR transformation is propagated through an ANN (suitably trained beforehand), and the output of the net is used as the new refined transformation. To train the ANN the well and the badly conditioned shift-MLLR transformations are used as outputs and inputs of ANN, respectively.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Gales, M.J.F.: Maximum likelihood linear transformations for HMM-based speech recognition. Computer Speech and Language 12, 75–98 (1997)
Povey, D., Yao, K.: A Basis Representation of Constrained MLLR Transforms for Robust Adaptation. Computer Speech & Language 26, 35–51 (2012)
Li, Y., Erdogan, H., Gao, T., Marcheret, E.: Incremental on-line feature space MLLR adaptation for telephony speech recognition. In: 7th International Conference on Spoken Language Processing, pp. 1417–1420 (2002)
Zajíc, Z., Machlica, L., Müller, L.: Initialization of fMLLR with Sufficient Statistics from Similar Speakers. In: Habernal, I., Matoušek, V. (eds.) TSD 2011. LNCS, vol. 6836, pp. 187–194. Springer, Heidelberg (2011)
Zajíc, Z., Machlica, L., Müller, L.: Bottleneck ANN: Dealing with small amount of data in shift-MLLR adaptation. In: Proc. of the IEEE 11th ICSP, pp. 507–510 (2012)
LeCun, Y., Bengio, Y.: Convolutional networks for images, speech, and time-series. In: Arbib, M.A. (ed.) The Handbook of Brain Theory and Neural Networks. MIT Press (1995)
Ciresan, D., Meier, U., Masci, J., Schmidhuber, J.: A Committee of Neural Networks for Traffic Sign Classification. In: Proc. of the IJCNN, pp. 1918–1921 (2011)
Gales, M.J.F.: The Generation and use of Regression class Trees for MLLR Adaptation, Techreport Cambridge University Engineering Department (1996)
Giuliani, D., Brugnara, F.: Acoustic model adaptation with multiple supervisions, TC-STAR Workshop on Speech-to-Speech Translation, pp. 151–154 (2006)
Parviainen, E.: Dimension Reduction for Regression with Bottleneck Neural Networks. In: Fyfe, C., Tino, P., Charles, D., Garcia-Osorio, C., Yin, H. (eds.) IDEAL 2010. LNCS, vol. 6283, pp. 37–44. Springer, Heidelberg (2010)
Bishop, C.M.: Neural Networks for Pattern Recognition. Oxford University Press, USA (1996)
Grézl, F., Karafiát, M., Burget, L.: Investigation into bottle-neck features for meeting speech recognition. In: Interspeech, vol. 9, pp. 2947–2950 (2009)
Zelinka, J., Trmal, J., Müller, L.: Low-dimensional Space Transforms of Posteriors in Speech Recognition. In: Interspeech, vol. 10, pp. 1193–1196 (2010)
Igel, C., Hsken, M.: Improving the Rprop Learning Algorithm. In: Second International Symposium on Neural Computation, pp. 115–121 (2000)
Pollak, P., et al.: SpeechDat(E) - Eastern European Telephone Speech Databases, In: XLDB - Very Large Telephone Speech Databases, ELRA (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Zajíc, Z., Zelinka, J., Vaněk, J., Müller, L. (2014). Convolutional Neural Network for Refinement of Speaker Adaptation Transformation. In: Ronzhin, A., Potapova, R., Delic, V. (eds) Speech and Computer. SPECOM 2014. Lecture Notes in Computer Science(), vol 8773. Springer, Cham. https://doi.org/10.1007/978-3-319-11581-8_20
Download citation
DOI: https://doi.org/10.1007/978-3-319-11581-8_20
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-11580-1
Online ISBN: 978-3-319-11581-8
eBook Packages: Computer ScienceComputer Science (R0)