Ontology-Based Human-Robot Interaction: An Approach and Case Study on Adaptive Remote Control Interface
The paper presents an approach to human-robot interaction in socio-cyberphysical systems. The paper propose a socio-cyberphysical system ontology that is aimed at describing the knowledge of the system resources. Humans are interacted with robots using personal smartphones. Every robot and mobile application for smartphone are designed based on the ontology that allows to support their semantic interoperability in socio-cyberphysical system. A case study considered in the paper is aimed at controlling the robots by group of humans. Group of robot consists of several robot types. Every type of robot has competencies that are described in the robot competency profile. Human experts also have own competencies that are described in the human profile. To control a robot a human should be available and have an appropriate competency for such type of robot. The paper describes the developed prototype for Android-based smartphone. The prototype implements the proposed approach and based on the developed ontology and Smart-M3 information sharing platform.
KeywordsSemantic interoperability Ontology Socio-cyberphysical system Competency
The work has been partially financially supported by grants #16-29-04349, 16-07-00462 of Russian Foundation for Basic Research, by Russian State Research #0073-2018-0002, and by ITMO University (Project #617038).
- 2.Kryuchkov, B., Syrkin, L., Usov, V., Ivanko, D., Ivanko, D.: Using augmentative and alternative communication for human-robot interaction during maintaining habitability of a lunar base. In: Ronzhin, A., Rigoll, G., Meshcheryakov, R. (eds.) ICR 2017. LNCS (LNAI), vol. 10459, pp. 95–104. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-66471-2_11CrossRefGoogle Scholar
- 4.Korzun, D., Kashevnik, A.: Balandin S.: Novel Design and the Applications of Smart-M3 Platform in the Internet of Things: Emerging Research and Opportunities, p. 150 (2017)Google Scholar
- 7.Seo, Y., Jung, H., Lee, C., Yang, T.: Remote data acquisition and touch-based control of a mobile robot using a smart phone. Comm. Comp. Inf. Sc. 265, 219–226 (2011)Google Scholar
- 8.Wang, M., Ganjineh, T., Gohring, D.: Reuschenbach, A.: iDriver - human machine interface for autonomous cars. In: 2011 Eighth International Conference on Information Technology: New Generations (ITNG), Las Vegas, NV, pp. 435–440 (2011)Google Scholar
- 9.Chua, C., Foo, F., Lee, L.: Interactive methods of tele-operating a single unmanned ground vehicle on a small screen interface. In: Proceedings of the 6th International Conference on Human-Robot Interaction (HRI 2011), p. 121. ACM Press, New York (2011)Google Scholar
- 10.Chen, G., King, S.A., Scherger, M.: Robot remote control using bluetooth and a smartphone augmented system. In: Yang, D. (ed.) Informatics in Control, Automation and Robotics. Lecture Notes in Electrical Engineering, vol. 133, pp. 453–463. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-25992-0_63CrossRefGoogle Scholar
- 11.Abdullahi, Z., Muhammad, N., Kazaure, J., Amuda, F.: Mobile robot voice recognition in control movements. Int. J. Comput. Sci. Electron. Eng. (IJCSEE) 3(1), 11–16 (2015)Google Scholar
- 12.Varcholik, P., Barber, D., Nicholson, D.: Interactions and training with unmanned systems and the nintendo wiimote. In: Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC), Orlando, Florida, USA, no. 8255 (2008)Google Scholar
- 13.Jokisch, O., Huber, M.: Advances in the development of a cognitive user interface. In: 13th International Scientific-Technical Conference on Electromechanics and Robotics “Zavalishin’s Readings”, vol. 161, 6 p. (2018)Google Scholar
- 14.Gundelakh, F., Stankevich, L., Sonkin, K.: Mobile robot control based on noninvasive brain-computer interface using hierarchical classifier of imagined motor commands. In: 13th International Scientific-Technical Conference on Electromechanics and Robotics “Zavalishin’s Readings”, vol. 161, 5 p. (2018)Google Scholar
- 15.IEEE Robotics and Automation Society. IEEE Standard Ontologies for Robotics and Automation (2015)Google Scholar