Skip to main content

A User-Centric Design of Service Robots Speech Interface for the Elderly

  • Chapter
  • First Online:
Recent Advances in Nonlinear Speech Processing

Part of the book series: Smart Innovation, Systems and Technologies ((SIST,volume 48))

Abstract

The elderly population in the Europe have quickly increased and will keep growing in the coming years. In facing the elder care challenges posed by the amount of seniors staying alone in their own homes, great efforts have been made to develop advanced robotic systems that can operate in intelligent environments, and to enable the robot to ultimately work in real conditions and cooperate with elderly end-users favoring independent living. In this paper, we describe the design and implementation of a user-centric speech interface tailored for the elderly. The speech user interface incorporating the state of the art speech technologies, is fully integrated into application contexts and facilitates the actualization of the robotic services in different scenarios. Contextual information is taken into account in the speech recognition to reduce system complexity and to improve recognition success rate. Under the framework of the EU FP7 Robot-Era Project, the usability of the speech user interface on a multi-robots service platform has been evaluated by elderly users recruited in Italy and Sweden through questionnaire interview. The quantitative analysis results show that the majority of end-users strongly agree that the speech interaction experienced during the Robot-Era services is acceptable.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://www.apple.com/ios/siri/.

  2. 2.

    http://www.google.com/landing/now/.

  3. 3.

    http://www.robot-era.eu/.

  4. 4.

    http://www.nuance.com/.

  5. 5.

    http://wiki.speech.cs.cmu.edu/olympus/index.php/Olympus/.

  6. 6.

    http://www.acapela-group.com/.

References

  1. Robot-Era project: Implementation and integration of advanced robotic systems and intelligent environments in real scenarios for the ageing population. In: FP7-ICT-Challenge 5: ICT for Health, Ageing Well, Inclusion and Governance. Grant agreement number 288899

    Google Scholar 

  2. Active ageing and solidarity between generations. European Union (2011)

    Google Scholar 

  3. Al-Razgan, M., Al-Khalifa, H., Al-Shahrani, M., Al-Ajmi, H.: Touch-based mobile phone interface guidelines and design recommendations for elderly people: a survey of the literature. In: Lecture Notes in Computer Science, vol. 7666, pp. 568–574. Springer, Berlin Heidelberg (2012)

    Google Scholar 

  4. Arch, A., Abou-Zahra, S., Henry, S.: Older users online: WAI guidelines address the web experiences of older users. User Experience Mag. 8(1), 18–19 (2009)

    Google Scholar 

  5. Bohus, D., Rudnicky, A.: The ravenclaw dialog management framework: architecture and systems. Comput. Speech Lang. 23(3), 332–361 (2009)

    Article  Google Scholar 

  6. Breazeal, C., Kidd, C., Thomaz, A., Hoffman, G., Berlin, M.: Effects of nonverbal communication on efficiency and robustness in human-robot teamwork. In: Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 708–713 (2005)

    Google Scholar 

  7. Di Nuovo, A., Broz, F., Belpaeme, T., Cangelosi, A., Cavallo, F., Esposito, R., Dario, P.: A web based multi-modal interface for elderly users of the Robot-Era multi-robot services. In: Proceedings of IEEE International Conference on Systems, Man and Cybernetics, pp. 2186–2191 (2014)

    Google Scholar 

  8. Karpov, A., Ronzhin, A., Leontyeva, A.: A semi-automatic wizard of oz technique for Let’sFly spoken dialogue system. In: Lecture Notes in Computer Science: Text, Speech and Dialogue, pp. 585–592. Springer (2008)

    Google Scholar 

  9. Kipp, A., Kummert, F.: Dynamic dialog system for human robot collaboration—Playing a game of pairs. In: Proceedings of 2nd International Conference on Human-Agent Interaction, pp. 225–228 (2014)

    Google Scholar 

  10. Lamel, L., Rosset, S., Gauvain, J., Bennacef, S.: The LIMSI arise system for train travel information. In: Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 501–504 (1999)

    Google Scholar 

  11. Lemon, O.: Context-sensitive speech recognition in information-state update dialogue systems: results for the grammar switching approach. In: Proceedings of Eighth Workshop on the Semantics and Pragmatics of Dialogue, pp. 49–55 (2004)

    Google Scholar 

  12. Lemon, O., Georgila, K., Henderson, J., Stuttle, M.: An ISU dialogue system exhibiting reinforcement learning of dialogue policies: generic slot-filling in the TALK in-car system. In: Proceedings of Eleventh Conference of the European Chapter of the Association for Computational Linguistics, pp. 119–122 (2006)

    Google Scholar 

  13. Mayer, P., Beck, C., Panek, P.: Examples of multimodal user interfaces for socially assistive robots in ambient assisted environments. In: Proceedings of IEEE International Conference on Cognitive Infocommunications, pp. 401–406 (2012)

    Google Scholar 

  14. Portet, F., Vacher, M., Golanski, C., Roux, C., Meillon, B.: Design and evaluation of a smart home voice interface for the elderly: acceptability and objection aspects. Pers. Ubiquit. Comput. 17(1), 127–144 (2013)

    Article  Google Scholar 

  15. Sainath, T., Mohamed, A., Kingsbury, B., Ramabhadran, B.: Deep convolutional neural networks for LVCSR. In: Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 8614–8618 (2013)

    Google Scholar 

  16. Sainath, T., Peddinti, V., Kingsbury, B., Fousek, P., Ramabhadran, B., Nahamoo, D.: Deep scattering spectra with deep neural networks for LVCSR tasks. In: Proceedings of INTERSPEECH, pp. 900–904 (2014)

    Google Scholar 

  17. Smarr, C., Prakash, A., Beer, J., Mitzner, T., Kemp, C., Rogers, W.: Older adults preferences for and acceptance of robot assistance for everyday living tasks. In: Proceedings of Human Factors and Ergonomics Society Annual Meeting, pp. 153–157 (2012)

    Google Scholar 

  18. Tang, D., Yusuf, B., Botzheim, J., Kubota, N., Chan, C.: A novel multimodal communication framework using robot partner for aging population. Expert Syst. Appl. 42(9), 4540–4555 (2015)

    Article  Google Scholar 

  19. Weninger, F., Schuller, B., Eyben, F., Wöllmer, M., Rigoll, G.: A broadcast news corpus for evaluation and tuning of German LVCSR systems (2014). eprint arXiv:1412.4616

  20. World Health Organization: 10 facts on ageing and the life course. http://www.who.int/features/factfiles/ageing/en/ (2014)

Download references

Acknowledgments

This work is fully supported by the European Union Seventh Framework Programme (FP7/2007-2013) grant no. 288899.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ning Wang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Wang, N., Broz, F., Di Nuovo, A., Belpaeme, T., Cangelosi, A. (2016). A User-Centric Design of Service Robots Speech Interface for the Elderly. In: Esposito, A., et al. Recent Advances in Nonlinear Speech Processing. Smart Innovation, Systems and Technologies, vol 48. Springer, Cham. https://doi.org/10.1007/978-3-319-28109-4_28

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-28109-4_28

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-28107-0

  • Online ISBN: 978-3-319-28109-4

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics