Speech Synthesis for Error Training Models in CALL

  • Xin Zhang
  • Qin Lu
  • Jiping Wan
  • Guangguang Ma
  • Tin Shing Chiu
  • Weiping Ye
  • Wenli Zhou
  • Qiao Li
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5459)

Abstract

A computer assisted pronunciation teaching system (CAPT) is a fundamental component in a computer assisted language learning system (CALL). A speech recognition based CAPT system often requires a large amount of speech data to train the incorrect phone models in its speech recognizer. But collecting incorrectly pronounced speech data is a labor intensive and costly work. This paper reports an effort on training the incorrect phone models by making use of synthesized speech data. A special formant speech synthesizer is designed to filter the correctly pronounced phones into incorrect phones by modifying the formant frequencies. In a Chinese Putonghua CALL system for native Cantonese speakers to learn Mandarin, a small experimental CAPT system is built with a synthetic speech data trained recognizer. Evaluation shows that a CAPT system using synthesized data can perform as good as or even better than that using real data provided that the size of the synthetic data are large enough.

Keywords

training data preparation computer aided language learning Speech synthesis formant modification 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Bailin, A.: Intelligent Computer-Assisted Language Learning. A Bibliography Computers and the Humanities 29, 375–387 (1995)CrossRefGoogle Scholar
  2. 2.
    Bernstein, J., Cohen, M., Murveit, H., Ritschev, D., Weintraub, M.: Automatic evaluation and training in English pronunciation. In: ICSLP 1990, Kobe, Japan, pp. 1185–1188 (1990)Google Scholar
  3. 3.
    Ronen, O., Neumeyer, L., Franco, H.: Automatic detection of mispronunciation for language instruction. In: Eurospeech 1997 (1997)Google Scholar
  4. 4.
    Zhou, W., et al.: A computer aided language learning system based on error trend grouping. In: IEEE NLP-KE 2007, pp. 256–261 (2007)Google Scholar
  5. 5.
    Anderson, O., Dalsgaard, P., Barry, W.: On the use of data-driven clustering technique for identificationof poly- and mono-phonemes for four European languages, Acoustics, Speech, and Signal Processing (1994)Google Scholar
  6. 6.
    Klatt, D.H.: Software for a cascade/parallel formant synthesizer, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139 (October 1979)Google Scholar
  7. 7.
    McCandless, S.S.: An algorithm for automatic formant extraction using linear prediction spectra. IEEE transactions on acoustics, speech, and signal processing assp-22(2) (April 1974)Google Scholar
  8. 8.
    Wang, L.: Cantonese how to learn speaking Chinese mandarin(广东人怎样学习普通话). Peking university press (1997)Google Scholar
  9. 9.
    Rabiner, L., Juang, B.-H.: Fundamentals of Speech Recognition. Prentice-Hall International, Inc., Englewood CliffsGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Xin Zhang
    • 1
  • Qin Lu
    • 2
  • Jiping Wan
    • 1
  • Guangguang Ma
    • 1
  • Tin Shing Chiu
    • 2
  • Weiping Ye
    • 1
  • Wenli Zhou
    • 1
  • Qiao Li
    • 1
  1. 1.Department of ElectronicsBeijing Normal UniversityChina
  2. 2.Department of ComputingHong Kong Polytechnic UniversityChina

Personalised recommendations