Skip to main content
SpringerLink
Log in

A Preliminary Study on Virtual Reality Tools in Human-Robot Interaction

  • Conference paper
  • First Online:
Augmented Reality, Virtual Reality, and Computer Graphics (AVR 2021)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 12980))

Abstract

Choosing the best interaction modalities and protocols in Human-Robot Interaction (HRI) is far from being straightforward, as it strictly depends on the application domain, the tasks to be executed, the types of robots and sensors involved. In the last years, a growing number of HRI researchers exploited Virtual Reality (VR) as a mean to evaluate proposed solutions, focusing in particular on safety and correctness of collaborative tasks. This allows to prove the effectiveness and robustness of a certain approach in a simulated environment, thus permitting to converge more easily to the best solution, also avoiding to experiment potentially harmful actions in a real scenario. In this paper, we aim at reviewing existing VR based approaches targeting or embodying HRI.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 109.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 139.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Arntz, A., Eimler, S.C.: Experiencing AI in VR: a qualitative study on designing a human-machine collaboration scenario. In: Stephanidis, C., Antona, M., Ntoa, S. (eds.) HCI International 2020 - Late Breaking Posters, pp. 299–307 (2020)

    Google Scholar 

  2. Aschenbrenner, D., Tol, D.v., Rusak, Z., Werker, C.: Using virtual reality for scenario-based responsible research and innovation approach for human robot co-production. In: 2020 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR), pp. 146–150 (2020)

    Google Scholar 

  3. Bach, K., Harnish, R.M.: Linguistic Communication and Speech Acts. MIT Press, Cambridge (1979)

    Google Scholar 

  4. Bolano, G., Juelg, C., Roennau, A., Dillmann, R.: Transparent robot behavior using augmented reality in close human-robot interaction. In: 28th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), pp. 1–7 (2019)

    Google Scholar 

  5. Bonarini, A.: Communication in human-robot interaction. In: Current Robotics Reports, pp. 1–7 (2020)

    Google Scholar 

  6. Chang, C.T., Hayes, B.: A survey of augmented reality for human-robot collaboration (2020)

    Google Scholar 

  7. Cockburn, J., Solomon, Y.: Multi-modal human robot interaction in a simulation environment (2013)

    Google Scholar 

  8. Dianatfar, M., Latokartano, J., Lanz, M.: Review on existing vr/ar solutions in human-robot collaboration. Procedia CIRP 97, 407–411 (2021)

    Article  Google Scholar 

  9. Dimitrokalli, A., Vosniakos, G.C., Nathanael, D., Matsas, E.: On the assessment of human-robot collaboration in mechanical product assembly by use of virtual reality. Procedia Manuf. 51, 627–634 (2020)

    Article  Google Scholar 

  10. Etzi, R., et al.: Using virtual reality to test human-robot interaction during a collaborative task. In: International Design Engineering Technical Conference and Computers and Information in Engineering Conference. ASME Digital Collection (2019)

    Google Scholar 

  11. Flacco, F., Kröger, T., Luca, A.D., Khatib, O.: A depth space approach for evaluating distance to objects. J. Intell. Rob. Syst. 80, 7–22 (2015)

    Article  Google Scholar 

  12. Fratczak, P., Goh, Y.M., Kinnell, P., Soltoggio, A., Justham, L.: Understanding human behaviour in industrial human-robot interaction by means of virtual reality. In: Proceedings of the Halfway to the Future Symposium 2019, pp. 1–7 (2019)

    Google Scholar 

  13. Galin, R., Meshcheryakov, R.: Review on human-robot interaction during collaboration in a shared workspace. In: Ronzhin, A., Rigoll, G., Meshcheryakov, R. (eds.) Interactive Collaborative Robotics, pp. 63–74 (2019)

    Google Scholar 

  14. Goodrich, M., Schultz, A.: Human-robot interaction: a survey. Found. Trends Human-Comput. Interact. 1, 203–275 (2007)

    Article  Google Scholar 

  15. Hidayat, A.: Speech acts: force behind words (2016)

    Google Scholar 

  16. Inamura, T., Mizuchi, Y.: Sigverse: a cloud-based vr platform for research on multimodal human-robot interaction. Front. Rob. AI 8, 158 (2021)

    Google Scholar 

  17. Kaufeld, M., Nickel, P.: Level of robot autonomy and information aids in human-robot interaction affect human mental workload - an investigation in virtual reality, pp. 278–291 (06 2019)

    Google Scholar 

  18. Khambhaita, H., Alami, R.: Assessing the social criteria for human-robot collaborative navigation: A comparison of human-aware navigation planners. In: 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), pp. 1140–1145 (2017)

    Google Scholar 

  19. Kostavelis, I., Gasteratos, A.: Semantic maps from multiple visual cues. Expert Syst. Appl. 68(C), 45–57 (2017)

    Google Scholar 

  20. Kurth, J., Marcel Wagner, A.: New planning methods for systems with human-robot collaboration. Carl Hanser Verlag Munich 115, 698–702 (12 2020)

    Google Scholar 

  21. Liu, D., Bhagat, K.K., Gao, Y., Chang, T.W., Huang, R.: The potentials and trends of virtual reality in education (2017)

    Google Scholar 

  22. Malik, A.A., Masood, T., Bilberg, A.: Virtual reality in manufacturing: immersive and collaborative artificial-reality in design of human-robot workspace. Int. J. Comput. Integr. Manuf. 33(1), 22–37 (2020)

    Article  Google Scholar 

  23. Mara, M., et al.: Cobot studio vr: A virtual reality game environment for transdisciplinary research on interpretability and trust in human-robot collaboration (2021)

    Google Scholar 

  24. Matsas, E., Vosniakos, G.C., Batras, D.: Prototyping proactive and adaptive techniques for human-robot collaboration in manufacturing using virtual reality. Rob. Comput.-Integr. Manuf. 50 (2017)

    Google Scholar 

  25. Mavridis, N.: A review of verbal and non-verbal human-robot interactive communication. Rob. Auton. Syst. 63, 22–35 (2015)

    Article  MathSciNet  Google Scholar 

  26. Milliez, G., Ferreira, E., Fiore, M., Alami, R., Lefèvre, F.: Simulating human-robot interactions for dialogue strategy learning. In: Brugali, D., Broenink, J.F., Kroeger, T., MacDonald, B.A. (eds.) SIMPAR 2014. LNCS (LNAI), vol. 8810, pp. 62–73. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-11900-7_6

    Chapter  Google Scholar 

  27. Mohammed, A., Schmidt, B., Wang, L.: Active collision avoidance for human-robot collaboration driven by vision sensors. Int. J. Comput. Integr. Manuf. 30(9), 970–980 (2017)

    Article  Google Scholar 

  28. Moniri, M.M., Valcarcel, F.A.E., Merkel, D., Sonntag, D.: Human gaze and focus-of-attention in dual reality human-robot collaboration. In: 2016 12th International Conference on Intelligent Environments (IE), pp. 238–241 (2016)

    Google Scholar 

  29. Morato, C., Kaipa, K.N., Zhao, B., Gupta, S.: Toward safe human robot collaboration by using multiple kinects based real-time human tracking. J. Comput. Inf. Sci. Eng. 14, 011006 (2014)

    Article  Google Scholar 

  30. Murnane, M., Higgins, P., Saraf, M., Ferraro, F., Matuszek, C., Engel, D.: A simulator for human-robot interaction in virtual reality. In: 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, pp. 470–471 (2021)

    Google Scholar 

  31. Nikolakis, N., Maratos, V., Makris, S.: A cyber physical system (cps) approach for safe human-robot collaboration in a shared workplace. Rob. Comput.-Integr. Manuf. 56, 233–243 (2019)

    Article  Google Scholar 

  32. Novitzky, M., Semmens, R., Franck, N.H., Chewar, C.M., Korpela, C.: Virtual reality for immersive human machine teaming with vehicles. In: Chen, J.Y.C., Fragomeni, G. (eds.) HCII 2020. LNCS, vol. 12190, pp. 575–590. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-49695-1_39

    Chapter  Google Scholar 

  33. Palmarini, R., del Amo, I.F., Bertolino, G., Dini, G., Erkoyuncu, J.A., Roy, R., Farnsworth, M.: Designing an ar interface to improve trust in human-robots collaboration. Procedia CIRP 70, 350–355 (2018)

    Article  Google Scholar 

  34. Schmitz, N., Hirth, J., Berns, K.: A simulation framework for human-robot interaction. In: 2010 Third International Conference on Advances in Computer-Human Interactions, pp. 79–84. IEEE (2010)

    Google Scholar 

  35. Shi, D., Collins Jr, E.G., Goldiez, B., Donate, A., Liu, X., Dunlap, D.: Human-aware robot motion planning with velocity constraints. In: 2008 International Symposium on Collaborative Technologies and Systems, pp. 490–497 (2008)

    Google Scholar 

  36. Shu, B., Sziebig, G., Pieters, R.: Architecture for safe human-robot collaboration: multi-modal communication in virtual reality for efficient task execution, pp. 2297–2302 (2019)

    Google Scholar 

  37. Wijnen, L., Bremner, P., Lemaignan, S., Giuliani, M.: Performing human-robot interaction user studies in virtual reality*. In: 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN), pp. 794–794 (2020)

    Google Scholar 

  38. Yan, H., Ang, M.A., Poo, A.: A survey on perception methods for human-robot interaction in social robots. Int. J. Soc. Rob. 6, 85–119 (2014)

    Article  Google Scholar 

  39. Zacharaki, A., Kostavelis, I., Gasteratos, A., Dokas, I.: Safety bounds in human robot interaction: A survey. Saf. Sci. 127, 104667 (2020)

    Article  Google Scholar 

Download references

Acknowledgements

The work of S. Kaszuba, F. Leotta and D. Nardi has been partly supported by the H2020 EU project CANOPIES - A Collaborative Paradigm for Human Workers and Multi-Robot Teams in Precision Agriculture Systems, Grant Agreement 101016906.

Author information

Authors and Affiliations

  1. Department of Computer, Control, and Management Engineering (DIAG), Sapienza University of Rome, via Ariosto 25, Rome, Italy

    Sara Kaszuba, Francesco Leotta & Daniele Nardi

Authors
  1. Sara Kaszuba
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Francesco Leotta
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Daniele Nardi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Francesco Leotta .

Editor information

Editors and Affiliations

  1. University of Salento, Lecce, Italy

    Lucio Tommaso De Paolis

  2. University of Naples Federico II, Naples, Italy

    Pasquale Arpaia

  3. University of Paris-Sud, Orsay, France

    Patrick Bourdot

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Kaszuba, S., Leotta, F., Nardi, D. (2021). A Preliminary Study on Virtual Reality Tools in Human-Robot Interaction. In: De Paolis, L.T., Arpaia, P., Bourdot, P. (eds) Augmented Reality, Virtual Reality, and Computer Graphics. AVR 2021. Lecture Notes in Computer Science(), vol 12980. Springer, Cham. https://doi.org/10.1007/978-3-030-87595-4_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-87595-4_7

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-87594-7

  • Online ISBN: 978-3-030-87595-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation