Abstract
With the development of artificial intelligence and computer technology, more and more intelligent robots come into people’s view. And we can see the application of social robots in various scenarios, but these robots are insufficient in terms of anthropomorphism and personalization. In this paper, an interaction framework based on multimodal perception and cognition is proposed. This framework allows for more individualized engagement behaviors while also enhancing the cognitive system of social robots by gathering information on users’ words, expressions, and posture. The application of the interactive framework was demonstrated in the hospital scenario.
Supported by the National Key Research and Development Program of China under Grant No.2020YFB1313602.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Chen, C., Liu, Y., Kreiss, S., Alahi, A.: Crowd-robot interaction: Crowd-aware robot navigation with attention-based deep reinforcement learning. In: 2019 International Conference on Robotics and Automation (ICRA), pp. 6015–6022 (2019). https://doi.org/10.1109/ICRA.2019.8794134
Devlin, J., Chang, M.W., Lee, K., Toutanova, K.: Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018)
Ghaffar, F.: Controlling traffic with humanoid social robot. arXiv preprint arXiv:2204.04240 (2022)
Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, vol. 25 (2012)
Liu, X., Li, X., Su, H., Zhao, Y., Ge, S.S.: The opening workspace control strategy of a novel manipulator-driven emission source microscopy system. ISA Trans. (2022)
Najibi, M., Samangouei, P., Chellappa, R., Davis, L.S.: Ssh: Single stage headless face detector, pp. 4875–4884 (2017)
Rothe, R., Timofte, R., Gool, L.V.: Deep expectation of real and apparent age from a single image without facial landmarks. Int. J. Comput. Vision 126(2–4), 144–157 (2018)
Rothe, R., Timofte, R., Van Gool, L.: Dex: Deep expectation of apparent age from a single image. In: Proceedings of the IEEE international conference on computer vision workshops, pp. 10–15 (2015)
Saaybi, S., Majid, A.Y., Prasad, R.V., Koubaa, A., Verhoeven, C.: Covy: An ai-powered robot for detection of breaches in social distancing. arXiv preprint arXiv:2207.06847 (2022)
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)
Tang, X., Du, D.K., He, Z., Liu, J.: Pyramidbox: A context-assisted single shot face detector. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 797–813 (2018)
Vaswani, A., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems, vol. 30 (2017)
Wang, D., Ma, G., Liu, X.: An intelligent recognition framework of access control system with anti-spoofing function. AIMS Math. 7(6), 10495–10512 (2022)
Xu, Y., Su, H., Ma, G., Liu, X.: A novel dual-modal emotion recognition algorithm with fusing hybrid features of audio signal and speech context. Complex & Intelligent Systems, pp. 1–13 (2022). https://doi.org/10.1007/s40747-022-00841-3
Yang, F., Wu, Y., Sakti, S., Nakamura, S.: Make skeleton-based action recognition model smaller, faster and better. In: Proceedings of the ACM multimedia asia, pp. 1–6 (2019)
Yang, T.Y., Huang, Y.H., Lin, Y.Y., Hsiu, P.C., Chuang, Y.Y.: Ssr-net: A compact soft stagewise regression network for age estimation. In: IJCAI. vol. 5, p. 7 (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Dong, L., Hu, P., Xiao, X., Tang, Y., Mao, M., Li, G. (2022). A Multimodal Perception and Cognition Framework and Its Application for Social Robots. In: Cavallo, F., et al. Social Robotics. ICSR 2022. Lecture Notes in Computer Science(), vol 13817. Springer, Cham. https://doi.org/10.1007/978-3-031-24667-8_42
Download citation
DOI: https://doi.org/10.1007/978-3-031-24667-8_42
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-24666-1
Online ISBN: 978-3-031-24667-8
eBook Packages: Computer ScienceComputer Science (R0)