Abstract
A polyglot text-to-speech synthesis system which is able to read aloud mixed-lingual text has first of all to derive the correct pronunciation. This is achieved with an accurate morpho-syntactic analyzer that works simultaneously as language detector, followed by a phonological component which performs various phonological transformations. The result of these symbol processing steps is a complete phonological description of the speech to be synthesized. The subsequent processing step, i.e. prosody control, has to generate numerical values for the physical prosodic parameters from this description, a task that is very different from the former ones. This article shows appropriate solutions to both types of tasks, namely a particular rule-based approach for the phonological component and a statistical or machine learning approach to prosody control.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bierwisch, M.: Regeln für die Intonation deutscher Sätze. Studia Grammatica VII, 99–201 (1966)
Chomsky, N., Halle, M.: The Sound Pattern of English. Harper and Row, New York (1968)
Kiparsky, P.: Über den deutschen Akzent. Studia Grammatica VII, 69–98 (1966)
Koskenniemi, K.: Two-Level Morphology: A General Computational Model for Word-Form Recognition and Production. PhD thesis, Department of General Linguistics, University of Helsinki, Finland (1983)
Pfister, B., Romsdorfer, H.: Mixed-lingual text analysis for polyglot TTS synthesis. In: Proceedings of the Eurospeech 2003, Geneva, September 2003, pp. 2037–2040 (2003)
Riedi, M.: Controlling Segmental Duration in Speech Synthesis Systems. PhD thesis, No. 12487, Computer Engineering and Networks Laboratory, ETH Zurich (TIK-Schriftenreihe Nr. 26, ISBN 3-906469-05-0) (February 1998)
Romsdorfer, H.: An Approach to an Improved Segmentation of Speech Signals for the Training of Statistical Prosody Models. Technischer Bericht Nr. 2 zum KTI-Projekt Nr. 6233.1 SUS-ET. Institut TIK, ETH Zürich (May 2004)
Romsdorfer, H., Pfister, B.: Multi-context rules for phonological processing in polyglot TTS synthesis. In: Proceedings of the Interspeech 2004 - ICSLP, Jeju Island (Korea) (October 2004)
Sproat, R.: Multilingual text analysis for text-to-speech synthesis. In: Proceedings of the ICSLP 1996, Philadelphia (October 1996)
Traber, C., Pfister, B., et al.: From multilingual to polyglot speech synthesis. In: Proceedings of the Eurospeech, September 1999, pp. 835–838 (1999)
Traber, C.: SVOX: The Implementation of a Text-to-Speech System for German. PhD thesis, No. 11064, Computer Engineering and Networks Laboratory, ETH Zurich (TIK-Schriftenreihe Nr. 7, ISBN 3 7281 2239 4) (March 1995)
Werbos, P.J.: Backpropagation through time: What it does and how to do it. Proceedings of the IEEE 78(10), 1550–1560 (1990)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Romsdorfer, H., Pfister, B., Beutler, R. (2005). A Mixed-Lingual Phonological Component Which Drives the Statistical Prosody Control of a Polyglot TTS Synthesis System. In: Bengio, S., Bourlard, H. (eds) Machine Learning for Multimodal Interaction. MLMI 2004. Lecture Notes in Computer Science, vol 3361. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30568-2_23
Download citation
DOI: https://doi.org/10.1007/978-3-540-30568-2_23
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-24509-4
Online ISBN: 978-3-540-30568-2
eBook Packages: Computer ScienceComputer Science (R0)