Abstract
Purpose
Exposure to procedures varies in the neonatal intensive care unit (NICU). A method to teach procedures should be available without patient availability, expert oversight, or simulation laboratories. To fill this need, we developed a virtual reality (VR) simulation for umbilical vein catheter (UVC) placement and sought to establish its face and content validity and usability.
Methods
Engineers, software developers, graphic designers, and neonatologists developed a VR UVC placement simulator following a participatory design approach. The software was deployed on the Meta Quest 2 head-mounted display (HMD). Neonatal nurse practitioners (NNPs) from a level 4 NICU used the simulator and completed an 11-item questionnaire to establish face and content validity. Participants also completed the validated simulation task load index and system usability scale to assess the usability of the simulator. Group 1 tested the VR simulation, which was optimized based on feedback, prior to Group 2’s participation.
Results
A total of 14 NNPs with 2–37 years of experience participated in testing. Participants scored the content and face validity of the simulator highly, with most giving scores ≥ 4/5. Usability was established with relatively high average system usability scores for both groups (Group 1: 67.14 ± 7.8, Group 2: 71 ± 14.1) and low SIM-TLX scores indicating manageable load while using the simulator.
Conclusion
After optimization, Group 2 found the UVC simulator to be realistic and effective. Both groups felt the simulator was easy to use and did not cause physical or cognitive strain. All participants felt the UVC simulator provided a safe environment to make mistakes, and the majority would recommend this experience to trainees.
Similar content being viewed by others
References
Gaies MG, Landrigan CP, Hafler JP, Sandora TJ (2007) Assessing procedural skills training in pediatric residency programs. Pediatrics 120(4):715–722. https://doi.org/10.1542/PEDS.2007-0325
Backes CH, Bonachea EM, Rivera BK, Reynolds MM, Kovalchin CE, Reber KM, Ball MK, Sutsko R, Guntupalli SR, Smith CV, Mahan JD, Carbajal MM (2016) Preparedness of pediatric residents for fellowship: a survey of US neonatal-perinatal fellowship program directors. J Perinatol 36(12):1132–1137. https://doi.org/10.1038/JP.2016.153
Lee HC, Rhee CJ, Sectish TC, Hintz SR (2009) Changes in attendance at deliveries by pediatric residents 2000 to 2005. Am J Perinatol 26(2):129–134. https://doi.org/10.1055/S-0028-1091395
Sawyer T, White M, Zaveri P, Chang T, Ades A, French H, Anderson J, Auerbach M, Johnston L, Kessler D (2015) Learn, see, practice, prove, do, maintain: an evidence-based pedagogical framework for procedural skill training in medicine. Acad Med 90(8):1025–1033. https://doi.org/10.1097/ACM.0000000000000734
Patel J, Posencheg M, Ades A (2012) Proficiency and retention of neonatal resuscitation skills by pediatric residents. Pediatrics 130(3):515–521. https://doi.org/10.1542/PEDS.2012-0149
Hardy A, Fuller DG, Forrester M, Anderson KP, Cooper C, Jenner B, Marshall I, Sanderson C, Standish J, Worth J, Vuillermin P, McCloskey K (2019) Survey of procedural and resuscitation requirements for paediatricians working in a non-tertiary centre: implications for training. J Paediatr Child Health 55(4):441–445. https://doi.org/10.1111/JPC.14224
Pottle J (2019) Virtual reality and the transformation of medical education. Future Healthc J 6(3):181. https://doi.org/10.7861/FHJ.2019-0036
Ruthenbeck GS, Reynolds KJ (2015) Virtual reality for medical training: the state-of-the-art. J Simul 9(1):16–26. https://doi.org/10.1057/JOS.2014.14/FIGURES/2
Carruth DW (2017) Virtual reality for education and workforce training. In: ICETA 2017—15th IEEE international conference on emerging elearning technologies and applications, proceedings. https://doi.org/10.1109/ICETA.2017.8102472.
Baniasadi T, Ayyoubzadeh SM, Mohammadzadeh N (2020) Challenges and practical considerations in applying virtual reality in medical education and treatment. Oman Med J 35(3):e125. https://doi.org/10.5001/OMJ.2020.43
Adapting virtual reality and augmented reality systems for naval aviation training. https://apps.dtic.mil/sti/citations/AD1063175. Accessed 31 May 2023
Lee L, Nisar H, Roberts J, Blackford J, Kesavadas TK (2022) Face and content validation of food safety training in virtual reality (VR). In: SeGAH 2022—2022 IEEE 10th international conference on serious games and applications for health. https://doi.org/10.1109/SEGAH54908.2022.9978588
Van Wyk E, De Villiers R (2009) Virtual reality training applications for the mining industry. In: Proceedings of AFRIGRAPH 2009: 6th international conference on computer graphics, virtual reality, visualisation and interaction in Africa, pp 53–64. https://doi.org/10.1145/1503454.1503465
Patel D, Hawkins J, Chehab LZ, Martin-Tuite P, Feler J, Tan A, Alpers BS, Pink S, Wang J, Freise J, Kim P, Peabody C, Bowditch J, Williams ER, Sammann A (2020) Developing virtual reality trauma training experiences using 360-degree video: tutorial. J Med Internet Res 22(12):22420. https://doi.org/10.2196/22420
Sankaran NK, Nisar HJ, Zhang J, Formella K, Amos J, Barker LT, Vozenilek JA, Lavalle SM, Kesavadas T (2019) Efficacy study on interactive mixed reality (IMR) software with sepsis prevention medical education. In: 26th IEEE conference on virtual reality and 3D user interfaces, VR 2019—proceedings, pp 664–670. https://doi.org/10.1109/VR.2019.8798089
O’Sullivan DM, Foley R, Proctor K, Gallagher S, Deery A, Eidem BW, McMahon CJ (2021) The use of virtual reality echocardiography in medical education. Pediatr Cardiol 42(4):723–726. https://doi.org/10.1007/S00246-021-02596-Z/FIGURES/4
Curran V, Xu X, Simmons K, Fleet L, Coombs H, Porter R, White S, Bessell C, Deshpandey A, Shah A, Waheed S, Nuttall RM (2022) A phenomenological study of the use of 360° virtual reality (VR) video in pediatric and neonatal resuscitation training. Health Technol (Berl) 12(1):151–159. https://doi.org/10.1007/S12553-021-00615-W/TABLES/2
Evens M, Empsen M, Hustinx W (2022) A literature review on 360-degree video as an educational tool: towards design guidelines. J Comput Educ 10(2):325–375. https://doi.org/10.1007/S40692-022-00233-Z/TABLES/8
Falah J, Khan S, Alfalah T, Alfalah SFM, Chan W, Harrison DK, Charissis V (2014) Virtual reality medical training system for anatomy education. In: Proceedings of 2014 science and information conference, SAI 2014, pp 752–758, https://doi.org/10.1109/SAI.2014.6918271
Negrillo-Cárdenas J, Jiménez-Pérez JR, Madeira J, Feito FR (2022) A virtual reality simulator for training the surgical reduction of patient-specific supracondylar humerus fractures. Int J Comput Assist Radiol Surg 17(1):65–73. https://doi.org/10.1007/S11548-021-02470-6/TABLES/2
Cecil J, Gupta A, Pirela-Cruz M (2018) An advanced simulator for orthopedic surgical training. Int J Comput Assist Radiol Surg 13(2):305–319. https://doi.org/10.1007/S11548-017-1688-0/TABLES/5
Gupta A, Cecil J, Pirela-Cruz M, Ramanathan P (2019) A virtual reality enhanced cyber-human framework for orthopedic surgical training. IEEE Syst J 13(3):3501–3512. https://doi.org/10.1109/JSYST.2019.2896061
Nisar H, Shah A, Gupta A, Kocheril A (2023) A participatory design approach to develop a VR-based electrocardiogram training simulator, pp 478–489. https://doi.org/10.1007/978-3-031-35634-6_34
Williams J, Jones D, Walker R (2018) Consideration of using virtual reality for teaching neonatal resuscitation to midwifery students. Nurse Educ Pract 31:126–129. https://doi.org/10.1016/J.NEPR.2018.05.016
Yu M, Yang M, Ku B, Mann JS (2021) Effects of virtual reality simulation program regarding high-risk neonatal infection control on nursing students. Asian Nurs Res (Korean Soc Nurs Sci) 15(3):189–196. https://doi.org/10.1016/J.ANR.2021.03.002
Farra S, Hodgson E, Miller ET, Timm N, Brady W, Gneuhs M, Ying J, Hausfeld J, Cosgrove E, Simon A, Bottomley M (2019) Effects of virtual reality simulation on worker emergency evacuation of neonates. Disaster Med Public Health Prep 13(2):301–308. https://doi.org/10.1017/DMP.2018.58
Sullivan A, Elshenawy S, Ades A, Sawyer T (2019) Acquiring and maintaining technical skills using simulation: initial, maintenance, booster, and refresher training. Cureus 11(9):5729. https://doi.org/10.7759/CUREUS.5729
Acknowledgements
This project was funded by the Jump ARCHES endowment through the Health Care Engineering Systems Center.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors have no conflict of interest.
Ethical approval
University of Illinois College of Medicine at Peoria IRB 1 determined this project does not meet the definition of human subject research under the purview of the IRB according to federal regulations.
Consent to participate
Verbal consent was obtained from all participants.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Supplementary file1 (MP4 370908 kb)
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Gohman, T., Nisar, H., Gupta, A. et al. Development and usability of a virtual reality umbilical venous catheter placement simulator. Int J CARS 19, 881–889 (2024). https://doi.org/10.1007/s11548-024-03072-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11548-024-03072-8