Abstract
Nonverbal communication plays a vital role in human interaction. In the context of Human-Robot Interaction (HRI), social robots are designed primarily for verbal-based communication with humans, making nonverbal communication an open research area. We present a flexible, open framework designed to facilitate nonverbal interactions in HRI. Among its components is a P2P Browser-Based Computational Notebook, leveraged to code, run, and share reactive programs. Machine-learning models can be included for real-time recognition of gestures, poses, and moods, employing protocols such as MQTT. Another key component is a broker for distributing data among different physical devices like the robot, wearables, and environmental sensors. We demonstrate this framework’s utility through two interaction scenarios: (i) the first one employing proxemics and gaze direction to initiate an impromptu encounter, and (ii) a second one incorporating object recognition and a Large-Language Model to suggest meals to be cooked based on available ingredients. These scenarios illustrate how the framework’s components can be seamlessly integrated to address new scenarios, where robots need to infer nonverbal cues from users.
E. A. Lozano, C. E. Sánchez-Torres, I. H. López-Nava and J. Favela—These authors contributed equally to this work.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Saunderson, S., Nejat, G.: How robots influence humans: a survey of nonverbal communication in social human–robot interaction. Int J. Soc. Rob. 11, 575–608 (2019). https://doi.org/10.1007/s12369-019-00523-0
Juan, E., Frum, C., Bianchi-Demicheli, F., Wang, Y.W., Lewis, J., Cacioppo, S.: Beyond human intentions and emotions. Front. Human Neurosci. 7, 99 (2013) https://doi.org/10.3389/fnhum.2013.00099
Hall, J.A., Horgan, T.G., Murphy, N.A.: Nonverbal communication. Annu. Rev. Psychol. 70, 271–294 (2019). https://doi.org/10.1146/annurev-psych-010418-10314
Robaczewski, A., Bouchard, J., Bouchard, K., Gaboury, S.: Socially assistive robots: the specific case of the Nao. Int. J. Social Rob. 13, 795–831 (2021). https://doi.org/10.1007/s12369-020-00664-7
Rocha, E.: Débora: a 3D simulator proposal for the social robotics platform. FRED (2023)
Rocha, M.M., Muchaluat-Saade, D.C.: Evaml e evasim: Proposta de linguagem baseada em xml e simulador para o robˆo eva. In: Anais do XXXVI Concurso de Teses e Disserta¸c˜oes, pp. 98–107. SBC (2023). https://doi.org/10.5753/ctd.2023.23008
Robinson, H., MacDonald, B., Broadbent, E.: The role of healthcare robots for older people at home: a review. Int. J. Soc. Robot. 6, 575–591 (2014). https://doi.org/10.1007/s12369-014-0242-
Urakami, J., Seaborn, K.: Nonverbal cues in human–robot interaction: a communication studies perspective. ACM Trans. Human-Robot Interact. 12(2), 1–21 (2023). https://doi.org/10.1145/357016
Pineda, L.A., Rodríguez, A., Fuentes, G., Rascon, C., Meza, I.V.: Concept and functional structure of a service robot. Int. J. Adv. Rob. Syst. 12(2), 6 (2015) https://doi.org/10.5772/6002
Cruz-Sandoval, D., Morales-Tellez, A., Sandoval, E.B., Favela, J.: A social robot as therapy facilitator in interventions to deal with dementia-related behavioral symptoms. In: Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction. HRI 2020, pp. 161–169. Association for Computing Machinery, New York (2020). https://doi.org/10.1145/3319502.3374840
Filipe, L., Peres, R.S., Tavares, R.M.: Voice-activated smart home controller using machine learning. IEEE Access 9, 66852–66863 (2021). https://doi.org/10.1109/ACCESS.2021.3076750
Villa, L., Hervás, R., Cruz-Sandoval, D., Favela, J.: Design and evaluation of proactive behavior in conversational assistants: approach with the eva companion robot. In: Bravo, J., Ochoa, S., Favela, J. (eds.) Proceedings of the International Conference on Ubiquitous Computing & Ambient Intelligence (UCAmI 2022), pp. 234–245. Springer, Cham (2023). https://doi.org/10.1007/978-3-031-21333-52
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Lozano, E.A., Sánchez-Torres, C.E., López-Nava, I.H., Favela, J. (2023). An Open Framework for Nonverbal Communication in Human-Robot Interaction. In: Bravo, J., Urzáiz, G. (eds) Proceedings of the 15th International Conference on Ubiquitous Computing & Ambient Intelligence (UCAmI 2023). UCAmI 2023. Lecture Notes in Networks and Systems, vol 842. Springer, Cham. https://doi.org/10.1007/978-3-031-48642-5_3
Download citation
DOI: https://doi.org/10.1007/978-3-031-48642-5_3
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-48641-8
Online ISBN: 978-3-031-48642-5
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)