Abstract
In this paper, we enhance systems interacting in healthcare domains by means of incorporating emotionally sensitive spoken conversational interfaces. The emotion recognizer is integrated in these systems as an intermediate phase between natural language understanding and dialog management in the architecture of a spoken dialog system. The prediction of the user’s emotional state, carried out for each user turn in the dialog, makes it possible to adapt the system dynamically selecting the next system response taking into account this valuable information. We have applied our proposal to develop an emotionally sensitive conversational system adapted to patients suffering from chronic pulmonary diseases, and provide a discussion of the positive influence of our proposal in the perceived quality.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Allen, J., Ferguson, G., Blaylock, N., Byron, D., Chambers, N., Dzikovska, M., Galescu, L., Swift, M.: Chester: towards a personal medication advisor. Journal of Biomedical Informatics 39(5), 500–513 (2006)
Antoniu, S.: Outcomes of adult domiciliary oxygen therapy in pulmonary diseases. Expert Review of Pharmacoeconomics and Outcomes Research 6(1), 9–66 (2006)
El Ayadi, M., Kamel, M., Karray, F.: Survey on speech emotio nrecognition: Features, classification schemes, and databases. Pattern Recognition 44, 572–587 (2011)
Bickmore, T., Giorgino, T.: Health dialog systems for patients and consumers. Journal of Biomedical Informatics 39(5), 556–571 (2006)
Bickmore, T., Puskar, K., Schlenk, E., Pfeifer, L., Sereika, S.: Maintaining reality: Relational agents for antipsychotic medication adherence. Interacting with Computers 22, 276–288 (2010)
Burkhardt, F., van Ballegooy, M., Engelbrecht, K., Polzehl, T., Stegmann, J.: Emotion detection in dialog systems - Usecases, strategies and challenges. In: Proc. ACII 2009, pp. 1–6 (2009)
Callejas, Z., López-Cózar, R.: Influence of contextual information in emotion annotation for spoken dialogue systems. Speech Communication 50(5), 416–433 (2008)
Delichatsios, H., Friedman, R., Glanz, K., Tennstedt, S., Smigelski, C., Pinto, B.: Randomized trial of a talking computer to improve adults eating habits. American Journal of Health Promotion 15, 215–224 (2000)
Farzanfar, R., Frishkopf, S., Migneault, J., Friedman, R.: Telephone-linked care for physical activity: A qualitative evaluation of the use patterns of an information technology program for patients. Biomedical Informatics 38, 220–228 (2005)
Griol, D., Hurtado, L., Sanchis, E., Segarra, E.: Acquiring and evaluating a dialog corpus through a dialog simulation technique. In: Proc. SIGdial 2007, pp. 29–42 (2007)
Hansen, J.: Analysis and compensation of speech under stress and noise for environmental robustness in speech recognition. Speech Communication 20(2), 151–170 (1996)
Hubal, R., Day, R.: Informed consent procedures: An experimental test using a virtual character in a dialog systems training application. Journal of Biomedical Informatics 39, 532–540 (2006)
Jindal, S.: Oxygen therapy: important considerations. Indian Journal of Chest Disease and Allied Science 50(1), 97–107 (2008)
Migneault, J.P., Farzanfar, R., Wright, J., Friedman, R.: How to write health dialog for a talking computer. Journal of Biomedical Informatics 39(5), 276–288 (2006)
Morrison, D., Wang, R., DeSilva, L.: Ensemble methods for spoken emotion recognition in call-centres. Speech Communication 49(2), 98–112 (2007)
Pfeifer, L., Bickmore, T.: Designing Embodied Conversational Agents to Conduct Longitudinal Health Interviews. In: Proc. IVA 2010, pp. 4698–4703 (2010)
Pieraccini, R.: The Voice in the Machine: Building Computers That Understand Speech. MIT Press (2012)
Ramelson, H., Friedman, R., Ockene, J.: An automated telephone-based smoking cessation education and counseling system. Patient Education and Counseling 36, 131–143 (1999)
Saz, O., Yin, S.C., Lleida, E., Rose, R., Vaquero, C., Rodríguez, W.R.: Tools and Technologies for Computer-Aided Speech and Language Therapy. Speech Communication 51(10), 948–967 (2009)
Schuller, B., Batliner, A., Steidl, S., Seppi, D.: Recognising realistic emotions and affect in speech: state of the art and lessons learnt from the first challenge. Speech Communication 53(9-10), 1062–1087 (2011)
Shah, N., Ragaswamy, H., Govindugari, K., Estanol, L.: Performance of three new-generation pulse oximeters during motion and low perfusion in volunteers. Journal of Clinical Anesthesia 24(5), 385–391 (2012)
Ververidis, D., Kotropoulos, C.: Emotional speech recognition: resources, features and methods. Speech Communication 48, 1162–1181 (2006)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Griol, D., Molina, J.M., Callejas, Z. (2015). Towards Emotionally Sensitive Conversational Interfaces for E-therapy. In: Ferrández Vicente, J., Álvarez-Sánchez, J., de la Paz López, F., Toledo-Moreo, F., Adeli, H. (eds) Artificial Computation in Biology and Medicine. IWINAC 2015. Lecture Notes in Computer Science(), vol 9107. Springer, Cham. https://doi.org/10.1007/978-3-319-18914-7_52
Download citation
DOI: https://doi.org/10.1007/978-3-319-18914-7_52
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-18913-0
Online ISBN: 978-3-319-18914-7
eBook Packages: Computer ScienceComputer Science (R0)