Skip to main content
SpringerLink
Log in

Remote-based text-to-speech modules’ evaluation framework: the RES framework

  • Published:
Language Resources and Evaluation Aims and scope Submit manuscript

Abstract

The ECESS consortium (European Center of Excellence in Speech Synthesis) aims to speed up progress in speech synthesis technology, by providing an appropriate evaluation framework. The key element of the evaluation framework is based on the partition of a text-to-speech synthesis system into distributed TTS modules. A text processing, prosody generation, and an acoustic synthesis module have been specified currently. A split into various modules has the advantage that the developers of an institution active in ECESS, can concentrate its efforts on a single module, and test its performance in a complete system using missing modules from the developers of other institutions. In this way, complete TTS systems can be built using high performance modules from different institutions. In order to evaluate the modules and to connect modules efficiently, a remote evaluation platform—the Remote Evaluation System (RES) based on the existing internet infrastructure—has been developed within ECESS. The RES is based on client–server architecture. It consists of RES module servers, which encapsulate the modules of the developers, a RES client, which sends data to and receives data from the RES module servers, and a RES server, which connects the RES module servers, and organizes the flow of information. RES can be used by developers for selecting RES module from the internet, which contains a missing TTS module needed to test and improve the performances of their own modules. Finally, the RES allows for the evaluation of TTS modules running at different institutions worldwide. When using the RES client, the institution performing the evaluation is able to set-up and performs various evaluation tasks by sending test data via the RES client and receiving results from the RES module servers. Currently ELDA www.elda.org is setting-up an evaluation using the RES client, which will then be extended to an evaluation client specializing in the envisaged evaluation tasks.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. EU project TC-STAR (Technology and Corpora for Speech to Speech Translation) www.tc-star.org.

  2. The Blizzard challenge: http://festvox.org/blizzard/.

  3. www.ecess.eu. The ECESS consortium is from its beginning an open, non funded consortium for institutions active in speech synthesis and related topics.

References

  • Bonafonte, A., Höge, H., Kiss, I., Moreno, A., Ziegenhain, U., Van den Heuvel, H., et al. (2006). TC-STAR: Specifications of language resources and evaluation for speech synthesis, Proceedings of LREC.

  • Burke, D. (2007). Speech processing for IP networks/media resource control protocol (MRCP). West Sussex: Wiley.

    Google Scholar 

  • Copeland, T. (2007). Generating parsers with JavaCC. Alexandria: Centennial Books.

    Google Scholar 

  • Höge, H., Kacic, Z., Kotnik, B., Rojc, M., Moreau, N., & Hain, H.-U. (2008). Evaluation of modules and tools for speech synthesis—The ECESS framework. Proceedings of LREC.

  • Perez, J., Bonafonte, A., Hain, H-U., Keller, E., Breuer, S. & Tian, J. (2006). ECESS inter-module interface specification for speech synthesis, Proceedings of LREC.

  • Shalyto, A. A. (2001). Logic control and “reactive” systems: Algorithmization and programming. Automation and remote control, Vol. 62, No. 1, pp. 1–29. (Avtomatika i Telemekhanika, Trans. No. 1, pp. 3–39).

  • Terrazas, A., Ostuni, J., & Barlow, M. (2002). Java media APIs: Cross-platform imaging, media and visualization. Sams publishing.

  • Weyns, D., Boucke, N., Holvoet, T., & Demarsin, B. (2007). DynCNET: A protocol for flexible transport assignment in AGV transportation systems. Katholieke Universiteit Leuven, Report CW 478.

Download references

Author information

Authors and Affiliations

  1. Faculty of Electrical Engineering and Computer Science, University of Maribor, Maribor, Slovenia

    Matej Rojc & Zdravko Kačič

  2. IC 5, Siemens AG, Corporate Technology, München, Germany

    Harald Höge

Authors
  1. Matej Rojc
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Harald Höge
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zdravko Kačič
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Matej Rojc.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Rojc, M., Höge, H. & Kačič, Z. Remote-based text-to-speech modules’ evaluation framework: the RES framework. Lang Resources & Evaluation 44, 371–386 (2010). https://doi.org/10.1007/s10579-009-9110-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10579-009-9110-3

Keywords

Search

Navigation