Skip to main content
SpringerLink
Log in

Easy Deployment of Spoken Dialogue Technology on Smartwatches for Mental Healthcare

  • Conference paper
  • First Online:
Pervasive Computing Paradigms for Mental Health (MindCare 2015)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 604))

Abstract

Smartwatches are becoming increasingly sophisticated and popular as several major smartphone manufacturers, including Apple, have released their new models recently. We believe that these devices can serve as smart objects for people suffering from mental disorders such as memory loss. In this paper, we describe how to utilise smartwatches to create intelligent user interfaces that can be used to provide cognitive assistance in daily life situations of dementia patients. By using automatic speech recognisers and text-to-speech synthesis, we create a dialogue application that allows patients to interact through natural language. We compare several available libraries for Android and show an example of integrating a smartwatch application into an existing healthcare infrastructure.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://kognit.dfki.de.

  2. 2.

    http://www.samsung.com/global/microsite/gear.

  3. 3.

    http://getpebble.com.

  4. 4.

    http://www.apple.com/watch.

  5. 5.

    http://www.android.com/wear.

  6. 6.

    http://www.ispeech.org.

  7. 7.

    http://cmusphinx.sourceforge.net/.

  8. 8.

    http://www.ivona.com/.

  9. 9.

    http://www.spry.org/pdf/cbtcoa_english.pdf.

References

  1. Weber, M., Schulz, C.H., Sonntag, D., Toyama, T.: Digital pens as smart objects in multimodal medical application frameworks. In: Proceedings of the Second Workshop on Interacting with Smart Objects. ACM Press (2013)

    Google Scholar 

  2. Pollack, M.: Intelligent technology for an aging population: The use of AI to assist elders with cognitive impairment. AI Mag. 26(2), 9–24 (2005)

    Google Scholar 

  3. Alzheimer’s Association, 2014 Alzheimer’s Disease Facts and Figures. http://www.alz.org/downloads/facts_figures_2014.pdf

  4. Prange, A., Sandrala, I.P., Weber, M., Sonntag, D.: Robot companions and smartpens for improved social communication of dementia patients. In: Proceedings of the 20th International Conference on Intelligent User Interfaces Companion (IUI Companion 2015) (2015)

    Google Scholar 

  5. Toyama, T., Kieninger, T., Shafait, F., Dengel, A.: Gaze guided object recognition using a head-mounted eye tracker. In: Proceedings of the Symposium on Eye Tracking Research and Applications, pp. 91–98. ACM Press (2012)

    Google Scholar 

  6. Sonntag, D., Schulz, C.H.: Multimodal multi-device discourse and dialogue infrastructure for collaborative decision making in medicine. In: Proceedings of the International Workshop on Spoken Dialogue Systems Technology, IWSDS12. Springer (2012)

    Google Scholar 

  7. Sonntag, D., Engel, R., Herzog, G., Pfalzgraf, A., Pfleger, N., Romanelli, M., Reithinger, N.: SmartWeb handheld — Multimodal interaction with ontological knowledge bases and semantic web services. In: Huang, T.S., Nijholt, A., Pantic, M., Pentland, A. (eds.) ICMI/IJCAI Workshops 2007. LNCS (LNAI), vol. 4451, pp. 272–295. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  8. Wahlster, W.: Towards symmetric multimodality: fusion and fission of speech, gesture, and facial expression. In: Günter, A., Kruse, R., Neumann, B. (eds.) KI 2003. LNCS (LNAI), vol. 2821, pp. 1–18. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. German Research Center for Artificial Intelligence (DFKI), Stuhlsatzenhausweg 3, 66123, Saarbrücken, Germany

    Alexander Prange & Daniel Sonntag

Authors
  1. Alexander Prange
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Daniel Sonntag
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Alexander Prange .

Editor information

Editors and Affiliations

  1. Istituto Auxologico Italiano, Milano, Italy

    Silvia Serino

  2. Telefonica I+D, Barcelona, Spain

    Aleksandar Matic

  3. The Centre for Research and Technology, Thessalomiki/Thermi, Greece

    Dimitris Giakoumis

  4. Aoyama Gakuin University, Tokyo, Japan

    Guillaume Lopez

  5. Istituto Auxologico Italiano, Milano, Italy

    Pietro Cipresso

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Prange, A., Sonntag, D. (2016). Easy Deployment of Spoken Dialogue Technology on Smartwatches for Mental Healthcare. In: Serino, S., Matic, A., Giakoumis, D., Lopez, G., Cipresso, P. (eds) Pervasive Computing Paradigms for Mental Health. MindCare 2015. Communications in Computer and Information Science, vol 604. Springer, Cham. https://doi.org/10.1007/978-3-319-32270-4_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-32270-4_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-32269-8

  • Online ISBN: 978-3-319-32270-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation