Some Experiments in Evaluating ASR Systems Applied to Multimedia Retrieval

  • Julián Moreno
  • Marta Garrote
  • Paloma Martínez
  • José L. Martínez-Fernández
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6535)


This paper describes some tests performed on different types of voice/audio input applying three commercial speech recognition tools. Three multimedia retrieval scenarios are considered: a question answering system, an automatic transcription of audio from video files and a real-time captioning system used in the classroom for deaf students. A software tool, RET (Recognition Evaluation Tool), has been developed to test the output of commercial ASR systems.


Automatic Speech Recognition (ASR) Evaluation Measurements audio transcription voice interaction 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Altova, Altova DiffDog, (viewed July 2010)
  2. 2.
    DiffDoc, Softinterface Inc., (viewed July 2010)
  3. 3.
  4. 4.
    IDM Computer Solutions, Inc., UltraCompare, (viewed June 2010)
  5. 5.
    Iglesias, A., Moreno, L., Revuelta, P., Jimenez, J.: APEINTA: a Spanish educational project aiming for inclusive education In and Out of classroom. In: 14th ACM–SIGCSE Annual Conference on Innovation and Technology in Computer Science Education (ITiCSE 2009), Paris, July 3-8, vol. 8 (2009)Google Scholar
  6. 6.
    Media Mining Indexer, Sail Labs Technology, (viewed June 2010)
  7. 7.
    NIST, Speech recognition scoring toolkit (SCTK) version 1.2c. (2000), (viewed May 2010)
  8. 8.
    Nuance Dragon Naturally Speaking, (viewed March 2010)
  9. 9.
    WinMerge, (viewed June 2009)

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Julián Moreno
    • 1
  • Marta Garrote
    • 1
  • Paloma Martínez
    • 1
  • José L. Martínez-Fernández
    • 2
  1. 1.Computer Science DepartmentUniversidad Carlos III de MadridLeganés, MadridSpain
  2. 2.DAEDALUS – Data, Decisions and Language S.A.MadridSpain

Personalised recommendations