Practical Speech Recognition for Contextualized Service Robots

  • Ivan Vladimir Meza Ruiz
  • Caleb Rascón
  • Luis A. Pineda Cortes
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8266)


In this work, we present the speech recognition module of a service robot that performs various tasks, such as being a host party, receiving multiple commands or giving a tour guide. These tasks take place in diverse acoustic environments, e.g., a home or a supermarket, in which speech is one of the main modalities of interaction. Our approach relies on three strategies: 1) making the recognizer aware of the task context, 2) providing prompting strategies to guide the recognition, and 3) calibrating the audio setting specific to the environment. We provide an evaluation with recordings from real interactions with a service robot in different environments.


speech recognition service robots language models 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Paliwal, K.K., Yao, K.: Robust speech recognition under noisy ambient conditions. In: Human-Centric Interfaces for Ambient Intelligence, ch. 6, pp. 135–162. Academic Press, Elsevier (2009)Google Scholar
  2. 2.
    Iocchi, I., Ruiz-del-Solar, J., van der Zant, T.: Domestic Service Robots in the Real World. Intelligent & Robotic Systems 66, 183–186 (2012)CrossRefGoogle Scholar
  3. 3.
    Kanda, T., Shiomi, M., Miyashita, Z., Ishiguro, H., Hagita, N.: A Communication Robot in a Shopping Mall. IEEE Transctions on Robotics 26(5), 897–913 (2010)CrossRefGoogle Scholar
  4. 4.
    Doostdar, M., Schiffer, S., Lakemeyer, G.: A Robust Speech Recognition System for Service-Robotics Applications. In: Iocchi, L., Matsubara, H., Weitzenfeld, A., Zhou, C. (eds.) RoboCup 2008. LNCS, vol. 5399, pp. 1–12. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  5. 5.
    Heinrich, S., Wermter, S.: Towards Robust Speech Recognition for Human-Robot Interaction In. In: Proc. IROS 2011 Workshop on Cognitive Neuroscience Robotics, pp. 29–34 (2011)Google Scholar
  6. 6.
    Ishi, C.T., Matsuda, S., Kanda, T., Jitsuhiro, T., Ishiguro, H., Nakamura, S., Hagita, N.: Robust speech recognition system for communication robots in real environments. In: Proceedings of IEEE International Conference on Humanoid Robots (Humanoids 2006), pp. 340–345 (2006)Google Scholar
  7. 7.
    Shiomi, M., Sakamoto, D., Kanda, T., Ishi, C., Ishiguro, H., Hagita, N.: A semi-autonomous Communication Robot - A field Trail ar a Train Station. In: Proc. ACM/IEEE Int. Conference on Human Robot Interaction, pp. 380–389 (2008)Google Scholar
  8. 8.
    Pineda, L., Meza, I., Avilés, H., Gershenson, C., Rascón, C., Alvarado, M., Salinas, L.: IOCA: Interaction-Oriented Cognitive Architecture Research in Computer Science, vol. 54, pp. 273–284 (2011)Google Scholar
  9. 9.
    Bharatheesha, M., Rudinac, M., Chandarr, A., Gaisser, F., Pons, S., Küpers, B., Driessen, S., Bruinink, M., Wisse, M., Jonker, P.: Delf+ Robotics RoboCup@Home 2012 team Description Paper. In: Proccedings of RoboCup 2012 (2012)Google Scholar
  10. 10.
    Lemon, O., Gruenstein, A.: Multithreaded context for robust conversational interfaces: context-sensitive speech recognition and interpretation of corrective fragments. ACM Transactions on Computer-Human Interaction (ACM TOCHI) 11(3), 241–267 (2004)CrossRefGoogle Scholar
  11. 11.
    Galescu, L., Allen, J., Ferguson, G., Quinn, J., Swift, M.: Speech Recognition in a Dialog System for Patient Health Monitoring. In: Proceedings of the IEEE International Conference on Bioinformatics and Biomedicine (BIBM 2009) Workshop on NLP Approaches (2009)Google Scholar
  12. 12.
    Ruiz-del-Solar, J., Correa, M., Smith, F., Loncomilla, P., Pairo, W., Verschae, R.: UChile HomeBreakers 2012 Team Description Paper. In: Proceedings of RoboCup 2012 (2012)Google Scholar
  13. 13.
    Hegger, F., Müller, C., Jin, Z., Álvarez, J., Giorgana, G., Hochgeschwender, N., Reckhaus, M., Paulus, J., Ploeger, P., Kraetzschmar, G.: The b-it-bots RoboCup@Home 2011 Team Description Paper. In: Proceedings of RoboCup 2011 (2011)Google Scholar
  14. 14.
    van der Zant, T., Wisspeintner, T.: RoboCup X: A proposal for a new league where roboCup goes real world. In: Bredenfeld, A., Jacoff, A., Noda, I., Takahashi, Y. (eds.) RoboCup 2005. LNCS (LNAI), vol. 4020, pp. 166–172. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  15. 15.
    Huggins-Dainesi, D., Kumar, M., Chan, A., Black, A.W., Ravishankar, M., Rudnicky, A.I.: PocketSphinx: A Free, Real-Time Continuous Speech Recognition System for Hand-Held Devices. In: Proc. of ICASSP 2006 (2006)Google Scholar
  16. 16.
    Dean, D., Sridharan, S., Vogt, R., Mason, M.: The QUT-NOISE-TIMIT corpus for the evaluation of voice activity detection algorithms. In: Proceedings of INTERSPEECH 2010, pp. 3110–3113 (2010)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Ivan Vladimir Meza Ruiz
    • 1
  • Caleb Rascón
    • 1
  • Luis A. Pineda Cortes
    • 1
  1. 1.Instituto de Investigaciones en Matemáticas Aplicdas y en Sistemas (IIMAS)Universidad Nacional Autónoma de México (UNAM)México

Personalised recommendations