Multilingual Speech Corpora for TTS System Development

  • Hsi-Chun Hsiao
  • Hsiu-Min Yu
  • Yih-Ru Wang
  • Sin-Horng Chen
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4274)


In this paper, four speech corpora collected in the Speech Lab of NCTU in recent years are discussed. They include a Mandarin tree-bank speech corpus, a Min-Nan speech corpus, a Hakka speech corpus, and a Chinese-English mixed speech corpus. Currently, they are used separately to develop a corpus-based Mandarin TTS system, a Min-Nan TTS system, a Hakka TTS system, and a Chinese-English bilingual TTS system. These systems will be integrated in the future to construct a multilingual TTS system covering the four primary languages used in Taiwan.


English Word Chinese Character Automatic Speech Recognition Pitch Contour Pause Duration 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Huang, C.-R., Chen, K.-J., Chen, F.-Y., Chen, K.-J., Gao, Z.-M., Chen, K.-Y.: Sinica Treebank: Design Criteria, Annotation Guidelines, and Online Interface. In: Proceedings of 2nd Chinese Language Processing Workshop 2000, Hong Kong, pp. 29–37 (2000)Google Scholar
  2. 2.
    Wightman, C.W., Ostendorf, M.: Automatic Labeling of Prosodic Patterns. IEEE Transactions on Speech and Audio Processing 2(4), 469–481 (1994)CrossRefGoogle Scholar
  3. 3.
    Chiang, C.-Y., Wang, Y.-R., Chen, S.-H.: On the inter-syllable coarticulation effect of pitch modeling for Mandarin speech. In: Interspeech 2005, pp. 3269–3272 (2005)Google Scholar
  4. 4.
    Chou, F.-C., Tseng, C.-Y., Lee, L.-S.: A Set of Corpus-Based Text-to-Speech Synthesis Technologies for Mandarin Chinese. IEEE Transactions on Speech and Audio Processing 10(7), 481–494 (2002)CrossRefGoogle Scholar
  5. 5.
    Cheng, R.L.: Taiwanese pronunciation and Romanization – with rules and examples for teachers and students. Wang Wen Publishing Company (1993)Google Scholar
  6. 6.
    Kuo, W.-C., Wang, Y.-R., Chen, S.-H.: A model-based tone labeling method for Min-Nan/Taiwanese speech. In: ICASSP 2004 (2004)Google Scholar
  7. 7.
    Kuo, W.-C., Zhong, X.-R., Wang, Y.-R., Chen, S.-H.: High-Performance Min-Nan/Taiwanese TTS System. In: ICASSP 2003 (2003)Google Scholar
  8. 8.
    Kuo, W.-C., Lin, L.-F., Wang, Y.-R., Chen, S.-H.: An NN-based Approach to Prosodic Information Generation for Synthesizing English Words Embedded in Chinese Text. In: Proc. of Eurospeech 2003 (2003)Google Scholar
  9. 9.
    Chen, S.H., Hwang, S.H., Wang, Y.R.: An RNN-based Prosodic Information Synthesizer for Mandarin Text-to-Speech. IEEE Trans. Speech and Audio Processing 6(3), 226–239 (1998)CrossRefGoogle Scholar
  10. 10.
    Chen, S.-H., Lai, W.-H., Wang, Y.-R.: A New Duration Modeling Approach for Mandarin Speech. IEEE Trans. on Speech and Audio Processing 11(4) (July 2003)Google Scholar
  11. 11.
    Chen, S.-H., Lai, W.-H., Wang, Y.-R.: A statistics-based pitch contour model for Mandarin speech. J. Acoust. Soc. Am. 117(2), 908–925 (2005)CrossRefGoogle Scholar
  12. 12.
    Chen, S.H., Ho, C.C.: A Min-Nan Text-to-Speech System. In: ISCSLP 2000, Beijing, China (October 2000)Google Scholar
  13. 13.
    Yu, H.-M., Hwang, H.-T., Lin, D.-Y., Chen, S.-H.: A Hakka Text-to- Speech System. Submitted to ISCSLP 2006 (2006)Google Scholar
  14. 14.
    Chen, S.H., et al.: Technical Report of NCTU, MOE project EX-94-E-FA06-4-4Google Scholar
  15. 15.
    Cutler, A., Otake, T.: Rhythmic categories in spoken-word recognition. Journal of Memory and Language 46(2), 296–322 (2002)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Hsi-Chun Hsiao
    • 2
  • Hsiu-Min Yu
    • 1
  • Yih-Ru Wang
    • 2
  • Sin-Horng Chen
    • 2
  1. 1.Department of Foreign LanguagesChung Hua UniversityHsinchu
  2. 2.Department of Communication EngineeringChiao Tung UniversityHsinchu

Personalised recommendations