Skip to main content

A Preliminary Study on Virtual Reality Tools in Human-Robot Interaction

  • 1383 Accesses

Part of the Lecture Notes in Computer Science book series (LNIP,volume 12980)

Abstract

Choosing the best interaction modalities and protocols in Human-Robot Interaction (HRI) is far from being straightforward, as it strictly depends on the application domain, the tasks to be executed, the types of robots and sensors involved. In the last years, a growing number of HRI researchers exploited Virtual Reality (VR) as a mean to evaluate proposed solutions, focusing in particular on safety and correctness of collaborative tasks. This allows to prove the effectiveness and robustness of a certain approach in a simulated environment, thus permitting to converge more easily to the best solution, also avoiding to experiment potentially harmful actions in a real scenario. In this paper, we aim at reviewing existing VR based approaches targeting or embodying HRI.

Keywords

  • Human-robot interaction
  • Virtual Reality
  • Speech acts
  • Communication modalities

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-030-87595-4_7
  • Chapter length: 10 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   109.00
Price excludes VAT (USA)
  • ISBN: 978-3-030-87595-4
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   149.99
Price excludes VAT (USA)
Fig. 1.

References

  1. Arntz, A., Eimler, S.C.: Experiencing AI in VR: a qualitative study on designing a human-machine collaboration scenario. In: Stephanidis, C., Antona, M., Ntoa, S. (eds.) HCI International 2020 - Late Breaking Posters, pp. 299–307 (2020)

    Google Scholar 

  2. Aschenbrenner, D., Tol, D.v., Rusak, Z., Werker, C.: Using virtual reality for scenario-based responsible research and innovation approach for human robot co-production. In: 2020 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR), pp. 146–150 (2020)

    Google Scholar 

  3. Bach, K., Harnish, R.M.: Linguistic Communication and Speech Acts. MIT Press, Cambridge (1979)

    Google Scholar 

  4. Bolano, G., Juelg, C., Roennau, A., Dillmann, R.: Transparent robot behavior using augmented reality in close human-robot interaction. In: 28th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), pp. 1–7 (2019)

    Google Scholar 

  5. Bonarini, A.: Communication in human-robot interaction. In: Current Robotics Reports, pp. 1–7 (2020)

    Google Scholar 

  6. Chang, C.T., Hayes, B.: A survey of augmented reality for human-robot collaboration (2020)

    Google Scholar 

  7. Cockburn, J., Solomon, Y.: Multi-modal human robot interaction in a simulation environment (2013)

    Google Scholar 

  8. Dianatfar, M., Latokartano, J., Lanz, M.: Review on existing vr/ar solutions in human-robot collaboration. Procedia CIRP 97, 407–411 (2021)

    CrossRef  Google Scholar 

  9. Dimitrokalli, A., Vosniakos, G.C., Nathanael, D., Matsas, E.: On the assessment of human-robot collaboration in mechanical product assembly by use of virtual reality. Procedia Manuf. 51, 627–634 (2020)

    CrossRef  Google Scholar 

  10. Etzi, R., et al.: Using virtual reality to test human-robot interaction during a collaborative task. In: International Design Engineering Technical Conference and Computers and Information in Engineering Conference. ASME Digital Collection (2019)

    Google Scholar 

  11. Flacco, F., Kröger, T., Luca, A.D., Khatib, O.: A depth space approach for evaluating distance to objects. J. Intell. Rob. Syst. 80, 7–22 (2015)

    CrossRef  Google Scholar 

  12. Fratczak, P., Goh, Y.M., Kinnell, P., Soltoggio, A., Justham, L.: Understanding human behaviour in industrial human-robot interaction by means of virtual reality. In: Proceedings of the Halfway to the Future Symposium 2019, pp. 1–7 (2019)

    Google Scholar 

  13. Galin, R., Meshcheryakov, R.: Review on human-robot interaction during collaboration in a shared workspace. In: Ronzhin, A., Rigoll, G., Meshcheryakov, R. (eds.) Interactive Collaborative Robotics, pp. 63–74 (2019)

    Google Scholar 

  14. Goodrich, M., Schultz, A.: Human-robot interaction: a survey. Found. Trends Human-Comput. Interact. 1, 203–275 (2007)

    CrossRef  Google Scholar 

  15. Hidayat, A.: Speech acts: force behind words (2016)

    Google Scholar 

  16. Inamura, T., Mizuchi, Y.: Sigverse: a cloud-based vr platform for research on multimodal human-robot interaction. Front. Rob. AI 8, 158 (2021)

    Google Scholar 

  17. Kaufeld, M., Nickel, P.: Level of robot autonomy and information aids in human-robot interaction affect human mental workload - an investigation in virtual reality, pp. 278–291 (06 2019)

    Google Scholar 

  18. Khambhaita, H., Alami, R.: Assessing the social criteria for human-robot collaborative navigation: A comparison of human-aware navigation planners. In: 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), pp. 1140–1145 (2017)

    Google Scholar 

  19. Kostavelis, I., Gasteratos, A.: Semantic maps from multiple visual cues. Expert Syst. Appl. 68(C), 45–57 (2017)

    Google Scholar 

  20. Kurth, J., Marcel Wagner, A.: New planning methods for systems with human-robot collaboration. Carl Hanser Verlag Munich 115, 698–702 (12 2020)

    Google Scholar 

  21. Liu, D., Bhagat, K.K., Gao, Y., Chang, T.W., Huang, R.: The potentials and trends of virtual reality in education (2017)

    Google Scholar 

  22. Malik, A.A., Masood, T., Bilberg, A.: Virtual reality in manufacturing: immersive and collaborative artificial-reality in design of human-robot workspace. Int. J. Comput. Integr. Manuf. 33(1), 22–37 (2020)

    CrossRef  Google Scholar 

  23. Mara, M., et al.: Cobot studio vr: A virtual reality game environment for transdisciplinary research on interpretability and trust in human-robot collaboration (2021)

    Google Scholar 

  24. Matsas, E., Vosniakos, G.C., Batras, D.: Prototyping proactive and adaptive techniques for human-robot collaboration in manufacturing using virtual reality. Rob. Comput.-Integr. Manuf. 50 (2017)

    Google Scholar 

  25. Mavridis, N.: A review of verbal and non-verbal human-robot interactive communication. Rob. Auton. Syst. 63, 22–35 (2015)

    MathSciNet  CrossRef  Google Scholar 

  26. Milliez, G., Ferreira, E., Fiore, M., Alami, R., Lefèvre, F.: Simulating human-robot interactions for dialogue strategy learning. In: Brugali, D., Broenink, J.F., Kroeger, T., MacDonald, B.A. (eds.) SIMPAR 2014. LNCS (LNAI), vol. 8810, pp. 62–73. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-11900-7_6

    CrossRef  Google Scholar 

  27. Mohammed, A., Schmidt, B., Wang, L.: Active collision avoidance for human-robot collaboration driven by vision sensors. Int. J. Comput. Integr. Manuf. 30(9), 970–980 (2017)

    CrossRef  Google Scholar 

  28. Moniri, M.M., Valcarcel, F.A.E., Merkel, D., Sonntag, D.: Human gaze and focus-of-attention in dual reality human-robot collaboration. In: 2016 12th International Conference on Intelligent Environments (IE), pp. 238–241 (2016)

    Google Scholar 

  29. Morato, C., Kaipa, K.N., Zhao, B., Gupta, S.: Toward safe human robot collaboration by using multiple kinects based real-time human tracking. J. Comput. Inf. Sci. Eng. 14, 011006 (2014)

    CrossRef  Google Scholar 

  30. Murnane, M., Higgins, P., Saraf, M., Ferraro, F., Matuszek, C., Engel, D.: A simulator for human-robot interaction in virtual reality. In: 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, pp. 470–471 (2021)

    Google Scholar 

  31. Nikolakis, N., Maratos, V., Makris, S.: A cyber physical system (cps) approach for safe human-robot collaboration in a shared workplace. Rob. Comput.-Integr. Manuf. 56, 233–243 (2019)

    CrossRef  Google Scholar 

  32. Novitzky, M., Semmens, R., Franck, N.H., Chewar, C.M., Korpela, C.: Virtual reality for immersive human machine teaming with vehicles. In: Chen, J.Y.C., Fragomeni, G. (eds.) HCII 2020. LNCS, vol. 12190, pp. 575–590. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-49695-1_39

    CrossRef  Google Scholar 

  33. Palmarini, R., del Amo, I.F., Bertolino, G., Dini, G., Erkoyuncu, J.A., Roy, R., Farnsworth, M.: Designing an ar interface to improve trust in human-robots collaboration. Procedia CIRP 70, 350–355 (2018)

    CrossRef  Google Scholar 

  34. Schmitz, N., Hirth, J., Berns, K.: A simulation framework for human-robot interaction. In: 2010 Third International Conference on Advances in Computer-Human Interactions, pp. 79–84. IEEE (2010)

    Google Scholar 

  35. Shi, D., Collins Jr, E.G., Goldiez, B., Donate, A., Liu, X., Dunlap, D.: Human-aware robot motion planning with velocity constraints. In: 2008 International Symposium on Collaborative Technologies and Systems, pp. 490–497 (2008)

    Google Scholar 

  36. Shu, B., Sziebig, G., Pieters, R.: Architecture for safe human-robot collaboration: multi-modal communication in virtual reality for efficient task execution, pp. 2297–2302 (2019)

    Google Scholar 

  37. Wijnen, L., Bremner, P., Lemaignan, S., Giuliani, M.: Performing human-robot interaction user studies in virtual reality*. In: 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), pp. 794–794 (2020)

    Google Scholar 

  38. Yan, H., Ang, M.A., Poo, A.: A survey on perception methods for human-robot interaction in social robots. Int. J. Soc. Rob. 6, 85–119 (2014)

    CrossRef  Google Scholar 

  39. Zacharaki, A., Kostavelis, I., Gasteratos, A., Dokas, I.: Safety bounds in human robot interaction: A survey. Saf. Sci. 127, 104667 (2020)

    CrossRef  Google Scholar 

Download references

Acknowledgements

The work of S. Kaszuba, F. Leotta and D. Nardi has been partly supported by the H2020 EU project CANOPIES - A Collaborative Paradigm for Human Workers and Multi-Robot Teams in Precision Agriculture Systems, Grant Agreement 101016906.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Francesco Leotta .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Verify currency and authenticity via CrossMark

Cite this paper

Kaszuba, S., Leotta, F., Nardi, D. (2021). A Preliminary Study on Virtual Reality Tools in Human-Robot Interaction. In: De Paolis, L.T., Arpaia, P., Bourdot, P. (eds) Augmented Reality, Virtual Reality, and Computer Graphics. AVR 2021. Lecture Notes in Computer Science(), vol 12980. Springer, Cham. https://doi.org/10.1007/978-3-030-87595-4_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-87595-4_7

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-87594-7

  • Online ISBN: 978-3-030-87595-4

  • eBook Packages: Computer ScienceComputer Science (R0)