Advertisement

Highly immersive virtual reality laparoscopy simulation: development and future aspects

  • 1000 Accesses

  • 16 Citations

Abstract

Purpose

Virtual reality (VR) applications with head-mounted displays (HMDs) have had an impact on information and multimedia technologies. The current work aimed to describe the process of developing a highly immersive VR simulation for laparoscopic surgery.

Methods

We combined a VR laparoscopy simulator (LapSim) and a VR-HMD to create a user-friendly VR simulation scenario. Continuous clinical feedback was an essential aspect of the development process. We created an artificial VR (AVR) scenario by integrating the simulator video output with VR game components of figures and equipment in an operating room. We also created a highly immersive VR surrounding (IVR) by integrating the simulator video output with a \(360{^{\circ }}\) video of a standard laparoscopy scenario in the department’s operating room.

Results

Clinical feedback led to optimization of the visualization, synchronization, and resolution of the virtual operating rooms (in both the IVR and the AVR). Preliminary testing results revealed that individuals experienced a high degree of exhilaration and presence, with rare events of motion sickness. The technical performance showed no significant difference compared to that achieved with the standard LapSim.

Conclusion

Our results provided a proof of concept for the technical feasibility of an custom highly immersive VR-HMD setup. Future technical research is needed to improve the visualization, immersion, and capability of interacting within the virtual scenario.

This is a preview of subscription content, log in to check access.

Access options

Buy single article

Instant unlimited access to the full article PDF.

US$ 39.95

Price includes VAT for USA

Subscribe to journal

Immediate online access to all issues from 2019. Subscription will auto renew annually.

US$ 99

This is the net price. Taxes to be calculated in checkout.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

References

  1. 1.

    Aggarwal R, Grantcharov TP, Eriksen JR, Blirup D, Kristiansen VB, Funch-Jensen P, Darzi A (2006) An evidence-based virtual reality training program for novice laparoscopic surgeons. Ann Surg 244(2):310–314. https://doi.org/10.1097/01.sla.0000218094.92650.44

  2. 2.

    van Dongen KW, van der Wal WA, Rinkes IH, Schijven MP, Broeders IA (2008) Virtual reality training for endoscopic surgery: voluntary or obligatory? Surg Endosc 22(3):664–667. https://doi.org/10.1007/s00464-007-9456-9

  3. 3.

    Huber T, Kirschniak A, Johannink J (2017) Survey of training in laparoscopic skills in Germany. Zentralbl Chir 142(1):67–71. https://doi.org/10.1055/s-0042-116327

  4. 4.

    Earle D, Betti D, Scala E (2017) Development of a rapid response plan for intraoperative emergencies: the Circulate, Scrub, and Technical Assistance Team. Am J Surg 213(1):181–186. https://doi.org/10.1016/j.amjsurg.2016.01.047

  5. 5.

    Chirico A, Yaden DB, Riva G, Gaggioli A (2016) The potential of virtual reality for the investigation of awe. Front Psychol 7:1766. https://doi.org/10.3389/fpsyg.2016.01766

  6. 6.

    Schmitt YS, Hoffman HG, Blough DK, Patterson DR, Jensen MP, Soltani M, Carrougher GJ, Nakamura D, Sharar SR (2011) A randomized, controlled trial of immersive virtual reality analgesia, during physical therapy for pediatric burns. Burns 37(1):61–68. https://doi.org/10.1016/j.burns.2010.07.007

  7. 7.

    Rizzo A, Hartholt A, Grimani M, Leeds A, Liewer M (2014) Virtual reality exposure therapy for combat-related posttraumatic stress disorder. Computer 47(7):31–37

  8. 8.

    Laver KE, George S, Thomas S, Deutsch JE, Crotty M (2015) Virtual reality for stroke rehabilitation. Cochrane Database Syst Rev. https://doi.org/10.1002/14651858.CD008349.pub3

  9. 9.

    Parsons TD (2015) Virtual reality for enhanced ecological validity and experimental control in the clinical, affective and social neurosciences. Front Hum Neurosci 9:660. https://doi.org/10.3389/fnhum.2015.00660

  10. 10.

    Riva G (2003) Applications of virtual environments in medicine. Methods Inf Med 42(5):524–534

  11. 11.

    Olasky J, Sankaranarayanan G, Seymour NE, Magee JH, Enquobahrie A, Lin MC, Aggarwal R, Brunt LM, Schwaitzberg SD, Cao CG, De S, Jones DB (2015) Identifying opportunities for virtual reality simulation in surgical education: a review of the proceedings from the innovation, design, and emerging alliances in surgery (IDEAS) conference: VR surgery. Surg Innov 22(5):514–521. https://doi.org/10.1177/1553350615583559

  12. 12.

    Paschold M, Schroder M, Kauff DW, Gorbauch T, Herzer M, Lang H, Kneist W (2011) Virtual reality laparoscopy: which potential trainee starts with a higher proficiency level? Int J Comput Assist Radiol Surg 6(5):653–662. https://doi.org/10.1007/s11548-010-0542-4

  13. 13.

    Larsen CR, Soerensen JL, Grantcharov TP, Dalsgaard T, Schouenborg L, Ottosen C, Schroeder TV, Ottesen BS (2009) Effect of virtual reality training on laparoscopic surgery: randomised controlled trial. BMJ 338:b1802. https://doi.org/10.1136/bmj.b1802

  14. 14.

    Nagendran M, Gurusamy KS, Aggarwal R, Loizidou M, Davidson BR (2013) Virtual reality training for surgical trainees in laparoscopic surgery. Cochrane Database Syst Rev. https://doi.org/10.1002/14651858.CD006575.pub3

  15. 15.

    Paschold M, Huber T, Kauff DW, Buchheim K, Lang H, Kneist W (2014) Preconditioning in laparoscopic surgery-results of a virtual reality pilot study. Langenbecks Arch Surg 399(7):889–895. https://doi.org/10.1007/s00423-014-1224-4

  16. 16.

    Kneist W, Huber T, Paschold M, Lang H (2016) 3D virtual reality laparoscopic simulation in surgical education—results of a pilot study. Zentralbl Chir 141(3):297–301. https://doi.org/10.1055/s-0033-1350609

  17. 17.

    Sorensen SM, Savran MM, Konge L, Bjerrum F (2016) Three-dimensional versus two-dimensional vision in laparoscopy: a systematic review. Surg Endosc 30(1):11–23. https://doi.org/10.1007/s00464-015-4189-7

  18. 18.

    Tillou X, Collon S, Martin-Francois S, Doerfler A (2016) Robotic surgery simulator: elements to build a training program. J Surg Educ 73(5):870–878. https://doi.org/10.1016/j.jsurg.2016.04.008

  19. 19.

    Sankaranarayanan G, Li B, Manser K, Jones SB, Jones DB, Schwaitzberg S, Cao CG, De S (2016) Face and construct validation of a next generation virtual reality (Gen2-VR) surgical simulator. Surg Endosc 30(3):979–985. https://doi.org/10.1007/s00464-015-4278-7

  20. 20.

    LaValle SM, Yershova A, Katsev M, Antonov M (2014) Head tracking for the Oculus Rift. In: IEEE international conference on robotics and automation (ICRA). IEEE, pp 187–194

  21. 21.

    Evangelakos D, Mara M (2016) Extended TimeWarp latency compensation for virtual reality. In: Proceedings of the 20th ACM SIGGRAPH symposium on interactive 3D graphics and games, ACM, pp 193–194

  22. 22.

    Coburn JQ, Freeman I, Salmon JL (2017) A review of the capabilities of current low-cost virtual reality technology and its potential to enhance the design process. J Comput Inf Sci Eng 17(3):031013

  23. 23.

    Nichols S, Haldane C, Wilson JR (2000) Measurement of presence and its consequences in virtual environments. Int J Hum Comput Stud 52(3):471–491. https://doi.org/10.1006/ijhc.1999.0343

  24. 24.

    Madary M, Metzinger TK (2016) Real virtuality: a code of ethical conduct. Recommendations for good scientific practice and the consumers of VR-technology. Front Robot AI. https://doi.org/10.3389/frobt.2016.00003

  25. 25.

    Keshavarz B, Hecht H (2011) Validating an efficient method to quantify motion sickness. Hum Factors J Hum Factors Ergon Soc 53(4):415–426. https://doi.org/10.1177/0018720811403736

  26. 26.

    Huber T, Paschold M, Hansen C, Wunderling T, Lang H, Kneist W (2017) New dimensions in surgical training: immersive virtual reality laparoscopic simulation exhilarates surgical staff. Surg Endosc. https://doi.org/10.1007/s00464-017-5500-6

  27. 27.

    Huber T, Paschold M, Hansen C, Lang H, Kneist W (2017) I will do laparoscopy somewhere else: total, highly immersive virtual reality without side effects? Chirurg. https://doi.org/10.1007/s00104-017-0465-5

  28. 28.

    Bowman DA, McMahan RP (2007) Virtual reality: how much immersion is enough? Computer 40(7):36–43. https://doi.org/10.1109/MC.2007.257

  29. 29.

    Milgram P, Takemura H, Utsumi A, Kishino F (1995) Augmented reality: a class of displays on the reality-virtuality continuum. SPIE Proceedings 2351(1):282–292. https://doi.org/10.1117/12.197321

  30. 30.

    Cho J-M, Kim Y-D, Jung SH, Shin H, Kim T (2017) 78-4: Screen door effect mitigation and its quantitative evaluation in VR display. SID Symposium Digest of Technical Papers 48(1):1154–1156. https://doi.org/10.1002/sdtp.11846

Download references

Acknowledgements

The authors thank S. Rohde, B. Golla, and M. Kosta (University of Magdeburg) for technical support. Additionally, we appreciate the support from and discussions with H. Hecht, Department of General Experimental Psychology, Johannes Gutenberg University, Mainz.

Funding Financial support for the laparoscopy simulator was provided by the medical education project, “MAICUM,” from the Medical Center of the Johannes Gutenberg University of Mainz. Funding for the additional immersive virtual reality hardware was provided by intramural funding from the Medical Center of the Johannes Gutenberg University of Mainz, Germany, and educational intramural funding by the Otto-von-Guericke University Magdeburg, Germany.

Author information

Correspondence to Tobias Huber.

Ethics declarations

Conflict of interest

The authors TH, TW, MP, HL, WK and CH declare no conflicts of interest or financial ties related to this study.

Ethical approval

For this type of study, formal consent was not required. This study did not include patients or animals.

Informed consent

This article does not contain patient data.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (mp4 57811 KB)

Supplementary material 1 (mp4 57811 KB)

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Huber, T., Wunderling, T., Paschold, M. et al. Highly immersive virtual reality laparoscopy simulation: development and future aspects. Int J CARS 13, 281–290 (2018). https://doi.org/10.1007/s11548-017-1686-2

Download citation

Keywords

  • Surgical training
  • Virtual reality
  • Laparoscopic surgery
  • Human–computer interaction
  • Visualization