Ontology-Based Human-Robot Interaction: An Approach and Case Study on Adaptive Remote Control Interface

  • Alexey KashevnikEmail author
  • Darya Kalyazina
  • Vladimir Parfenov
  • Anton Shabaev
  • Olesya Baraniuc
  • Igor Lashkov
  • Maksim Khegai
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11097)


The paper presents an approach to human-robot interaction in socio-cyberphysical systems. The paper propose a socio-cyberphysical system ontology that is aimed at describing the knowledge of the system resources. Humans are interacted with robots using personal smartphones. Every robot and mobile application for smartphone are designed based on the ontology that allows to support their semantic interoperability in socio-cyberphysical system. A case study considered in the paper is aimed at controlling the robots by group of humans. Group of robot consists of several robot types. Every type of robot has competencies that are described in the robot competency profile. Human experts also have own competencies that are described in the human profile. To control a robot a human should be available and have an appropriate competency for such type of robot. The paper describes the developed prototype for Android-based smartphone. The prototype implements the proposed approach and based on the developed ontology and Smart-M3 information sharing platform.


Semantic interoperability Ontology Socio-cyberphysical system Competency 



The work has been partially financially supported by grants #16-29-04349, 16-07-00462 of Russian Foundation for Basic Research, by Russian State Research #0073-2018-0002, and by ITMO University (Project #617038).


  1. 1.
    Lemaignan, S., Warnier, M., Sisbot, E., Clodic, A., Alami, R.: Artificial cognition for social human–robot interaction: an implementation. Artif. Intell. 247, 45–69 (2017)MathSciNetCrossRefGoogle Scholar
  2. 2.
    Kryuchkov, B., Syrkin, L., Usov, V., Ivanko, D., Ivanko, D.: Using augmentative and alternative communication for human-robot interaction during maintaining habitability of a lunar base. In: Ronzhin, A., Rigoll, G., Meshcheryakov, R. (eds.) ICR 2017. LNCS (LNAI), vol. 10459, pp. 95–104. Springer, Cham (2017). Scholar
  3. 3.
    Andreev, V., Pletenev, P.: Method of information interaction for distributed control systems of robots with modular architecture. SPIIRAS Proc. 2(57), 134–160 (2018)CrossRefGoogle Scholar
  4. 4.
    Korzun, D., Kashevnik, A.: Balandin S.: Novel Design and the Applications of Smart-M3 Platform in the Internet of Things: Emerging Research and Opportunities, p. 150 (2017)Google Scholar
  5. 5.
    Mikhailov, S., Kashevnik, A.: Smart-M3-based smart space creation using a DD-WRTbased device. SPIIRAS Proc. 3(52), 180–203 (2017)CrossRefGoogle Scholar
  6. 6.
    Luo, Y., Liu, J., Gao, Y., Lu, Z.: Smartphone-controlled robot snake for urban search and rescue. In: Zhang, X., Liu, H., Chen, Z., Wang, N. (eds.) ICIRA 2014. LNCS (LNAI), vol. 8917, pp. 352–363. Springer, Cham (2014). Scholar
  7. 7.
    Seo, Y., Jung, H., Lee, C., Yang, T.: Remote data acquisition and touch-based control of a mobile robot using a smart phone. Comm. Comp. Inf. Sc. 265, 219–226 (2011)Google Scholar
  8. 8.
    Wang, M., Ganjineh, T., Gohring, D.: Reuschenbach, A.: iDriver - human machine interface for autonomous cars. In: 2011 Eighth International Conference on Information Technology: New Generations (ITNG), Las Vegas, NV, pp. 435–440 (2011)Google Scholar
  9. 9.
    Chua, C., Foo, F., Lee, L.: Interactive methods of tele-operating a single unmanned ground vehicle on a small screen interface. In: Proceedings of the 6th International Conference on Human-Robot Interaction (HRI 2011), p. 121. ACM Press, New York (2011)Google Scholar
  10. 10.
    Chen, G., King, S.A., Scherger, M.: Robot remote control using bluetooth and a smartphone augmented system. In: Yang, D. (ed.) Informatics in Control, Automation and Robotics. Lecture Notes in Electrical Engineering, vol. 133, pp. 453–463. Springer, Heidelberg (2011). Scholar
  11. 11.
    Abdullahi, Z., Muhammad, N., Kazaure, J., Amuda, F.: Mobile robot voice recognition in control movements. Int. J. Comput. Sci. Electron. Eng. (IJCSEE) 3(1), 11–16 (2015)Google Scholar
  12. 12.
    Varcholik, P., Barber, D., Nicholson, D.: Interactions and training with unmanned systems and the nintendo wiimote. In: Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC), Orlando, Florida, USA, no. 8255 (2008)Google Scholar
  13. 13.
    Jokisch, O., Huber, M.: Advances in the development of a cognitive user interface. In: 13th International Scientific-Technical Conference on Electromechanics and Robotics “Zavalishin’s Readings”, vol. 161, 6 p. (2018)Google Scholar
  14. 14.
    Gundelakh, F., Stankevich, L., Sonkin, K.: Mobile robot control based on noninvasive brain-computer interface using hierarchical classifier of imagined motor commands. In: 13th International Scientific-Technical Conference on Electromechanics and Robotics “Zavalishin’s Readings”, vol. 161, 5 p. (2018)Google Scholar
  15. 15.
    IEEE Robotics and Automation Society. IEEE Standard Ontologies for Robotics and Automation (2015)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  • Alexey Kashevnik
    • 1
    Email author
  • Darya Kalyazina
    • 2
  • Vladimir Parfenov
    • 2
  • Anton Shabaev
    • 3
  • Olesya Baraniuc
    • 2
  • Igor Lashkov
    • 2
  • Maksim Khegai
    • 2
  1. 1.SPIIRASSt. PetersburgRussia
  2. 2.ITMO UniversitySt. PetersburgRussia
  3. 3.Petrozavodsk State University (PetrSU)PetrozavodskRussia

Personalised recommendations