Application of Augmented Reality in Mobile Robot Teleoperation

  • Tomáš KotEmail author
  • Petr Novák
  • Ján Babjak
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10756)


The paper deals with the utilisation of augmented reality on the operator control panel of a teleoperated mobile robot. The work is a continuation of the previous research, which resulted in the creation and successful practical implementation of a virtual operator station based on the virtual reality head-mounted display (HMD) Oculus Rift. The new approach suggests using the new Microsoft Hololens augmented reality headset to add the virtual control elements directly to the real world, which has some very important benefits – especially the fact that the operator is not visually isolated from his surroundings. The device is introduced in the beginning of the article and then follows the description of all tasks required to create the augmented reality operator station. Mentioned are also other possible ways of using augmented reality to assist the operator of a mobile robot.


Mobile robot Teleoperation HMD Oculus Rift Hololens Augmented reality Virtual reality 



This article has been elaborated in the framework of the research project “Augmented Reality Lab” under the programme “Support of Science and Research in the Moravian-Silesian Region 2016” (RCC/08/2016) and supported by the specific research project HS3541602 in cooperation with VOP CZ s. p. The article was also supported by the project “Research Centre of Advanced Mechatronic Systems” (Ministry of Education, Youth and Sports of the Czech Republic).


  1. 1.
    Cybernet: Operator Control Unit.
  2. 2.
    Orpheus Robotic System Project.
  3. 3.
    Fong, T., Thorpe, C.: Vehicle teleoperation interfaces. Auton. Robots. 11, 9–18 (2001). ISSN 0929-5593CrossRefGoogle Scholar
  4. 4.
    Wikipedia: Head-mounted Display.
  5. 5.
    Oculus VR: Oculus Rift.
  6. 6.
  7. 7.
  8. 8.
    Františ, P., Hodický, J.: Human machine interface in command and control system. In: Proceedings of 2010 IEEE International Conference on Virtual Environments, Human-Computer Interfaces and Measurement Systems, VECIMS 2010, pp. 38–41 (2010). Art. no. 5609345Google Scholar
  9. 9.
    Františ, P., Hodický, J.: Virtual reality in presentation layer of C3I system. In: Proceedings of International Congress on Modelling and Simulation: Advances and Applications for Management and Decision Making, MODSIM 2005, pp. 3045–3050 (2005)Google Scholar
  10. 10.
    Chen, G.S., Chen, J.P.: Applying virtual reality to remote control of mobile robot. In: Proceedings of the 2nd International Conference on Intelligent Technologies and Engineering Systems (ICITES 2013), pp. 383–390 (2013)Google Scholar
  11. 11.
    Benaoumeur, I., Zoubir, A., Reda, H.E.A.: Remote control of mobile robot using the virtual reality. Int. J. Electr. Comput. Eng. (IJECE) 5(5), 1062–1074 (2015)Google Scholar
  12. 12.
    Kot, T., Novák, P.: Utilization of the Oculus Rift HMD in mobile robot teleoperation. Appl. Mech. Mater. 555, 199–208 (2014). ISBN 978-3-03835-111-5CrossRefGoogle Scholar
  13. 13.
    Kot, T., Novák, P., Babjak, J.: Virtual operator station for teleoperated mobile robots. In: International Workshop on Modelling and Simulation for Autonomous Systems, MESAS 2015, Prague, Czech Republic, 29–30 April 2015, pp. 144–153 (2015). ISBN 978-3-319-22383-4Google Scholar
  14. 14.
  15. 15.
    Oculus Support Centre: My Oculus Rift Headset isn’t Connecting.
  16. 16.
  17. 17.
  18. 18.
    CNET: Augmented Reality comes to Mobile Phones.
  19. 19.
    Vuzix: AR3000 Series of Smart Glasses.
  20. 20.
    Sony: SmartEyeglass Developer Edition.
  21. 21.
  22. 22.
    Meta: Meta 2 AR.
  23. 23.
    Microsoft: Microsoft HoloLens.
  24. 24.
    Department of Robotics: Mobile Robot Hercules.
  25. 25.
  26. 26.
    Unity: Unity Game Engine.
  27. 27.
    Aguiar, J., Pinto, A.M., Cruz, N.A., Matos, A.C.: The impact of convergence cameras in a stereoscopic system for AUVs. In: International Conference Image Analysis and Recognition, pp. 521–529 (2016). ISBN 978-3-319-41500-0Google Scholar
  28. 28.
    Hayes, J.: Is Augmented Reality a Breakthrough for Field Service Teams.

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Department of Robotics, Faculty of Mechanical EngineeringVŠB-Technical University OstravaOstravaCzech Republic

Personalised recommendations