Abstract
The objective of this work was to provide pilot data on feasibility of using virtual reality (VR) to train undergraduate students in pediatric emergency scenarios. We staged VR sessions for a total of 45 medical and nursing students; in every session, each student managed two pediatric emergency virtual scenarios. At the end of the sessions, students completed a Technology Assessment Questionnaire to evaluate the perceived usefulness and perceived ease-of-use of their VR training experience and rated their perceived level of competence in managing the two clinical scenarios. The median perceived usefulness was 91.7/100 (interquartile range (IQR) 80.6–100), while the median perceived ease-of-use was 77.8/100 (IQR 63.9–88.9). The perceived level of competence increased from 2 (IQR 1–3) to 4 (IQR 3–4) on a 5-point Likert scale, for both scenarios (p < 0.001, Wilcoxon test for paired samples).
Conclusions: The staged VR sessions had a good perceived usefulness and resulted in an increase in the perceived level of competence. The results on the ease-of-use, however, show that an assumption that millennials and younger students can navigate with confidence VR hardware in a healthcare training setting should not be made; further work is required to ease the integration of VR into curricula.
What is Known: • Virtual reality (VR) is a rising simulation training methodology in Pediatric Emergency Medicine (PEM), however little experience is reported about its use for undergraduate students | |
What is New: • VR PEM trainiing was found useful by undergraduate students and its use increased their perceived level of competence, although ease-of-use received lower ratings. • Despite the young age, an assumption that millennials and younger students can navigate with confidence VR hardware in a healthcare training setting should not be made |
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Pediatric Emergency Medicine (PEM) is not formally recognized as board-certified specialty in most European countries [1]. Trainees and physicians have expressed discomfort with pediatric emergency management [2,3,4], and optimal methods to increase their comfort and competence are needed. Virtual reality (VR) is a rising and common simulation training methodology used in PEM [5,6,7,8,9] that has increased since 2020 [10]. While it has been deployed in many areas of the world, its feasibility among European physician trainees and students for PEM is relatively unknown. The objective of our work was to provide pilot data on feasibility in an academic Italian medical school using a localized VR simulation program previously used in the USA, called ResuscitationVR (i3 Simulations, London, UK) [11]. We describe the pilot project with students, report data collected from this initial cohort, and the resultant implementation changes for the subsequent years.
In 2021, we staged nine VR sessions, involving 5 students each at the University of Padova, Italy. ResuscitationVR was provided on 5 separate Oculus Quest 2 headsets (Meta, San Jose, CA, USA). The sessions were offered to last year medical and nursing students. Students managed two pediatric virtual scenarios: an infant with status epilepticus and a child with anaphylaxis.
ResuscitationVR was initially developed to elicit a heightened psychological state [11]. Immersive audio provides sounds typical of the setting (monitor alarms, patient’s moans, the mother’s vocalizations, and intercom announcements), which adds stress and creates a realistic environment.
To help students to familiarize with the headset, a 15-min introduction on its use and a software tutorial were given beforehand. The tutorial had been developed to blind the students from the actual scenario details. We replaced all of the medical equipment, medications, and characters, and instead placed virtual rubber duckies in different locations in the emergency room to teach navigation and interactivity with the ducks using the VR controllers (Fig. 1a). It was meant to help students understand how to use the VR controllers to interact with equipment and medications in the medical scenario.
During the scenarios, the student plays the emergency department physician beginning at the foot of the patient’s bed. Patient information is briefed by associated characters including a paramedic; the rest of the scenario requires interaction with other characters, including a nurse and respiratory therapist. A distraught mother is present in the scenario as a potential distraction (Fig. 1b). The student interacts with the characters and various equipment and medications in the room in response to changing patient states. Medication doses or age-based size of equipment are not required in the scenarios.
Nursing students were primed to engage in the VR sessions and play the physician role in the scenarios, with the purpose of learning the ABCDE systematic approach to the assessment and management of pediatric emergencies. All students participated in the VR sessions on a voluntary basis, as this was a pilot innovative teaching module.
A facilitator-centered debriefing was done after each scenario, and students could then rerun the scenarios to apply what they had learned.
At the end of the sessions, students completed a Technology Assessment Questionnaire to evaluate the perceived usefulness and perceived ease-of-use (Supplementary file 1). This questionnaire was developed from an engineering and programming perspective and is used for digital training products by i3 Simulations. Students were also asked to rate their perceived level of competence in managing a clinical scenario of pediatric status epilepticus and of pediatric anaphylaxis before and after the VR session on a five-point Likert scale, from “very low” to “very high.”
Overall, 45 students participated in this pilot project, 38 last year medical students and 7 last year nursing students. One felt nauseated and could not complete the VR session.
The median perceived usefulness was 91.7/100 (interquartile range (IQR) 80.6–100), while the median perceived ease-of-use was 77.8/100 (IQR 63.9–88.9). The perceived level of competence increased from 2 (IQR 1–3) to 4 (IQR 3–4) for both scenarios (p < 0.001, from Wilcoxon test for paired samples).
We noted that ease-of-use was high, but not as high as the perceived usefulness. When triangulating these findings with student comments, students had more comments about the feasibility and suggestions for improvement. In particular, despite the students’ generational advantage with general technologies, they uniformly requested further efforts to familiarize themselves with the VR hardware and an opportunity to “play around” in the digital VR environment, including with medical equipment and medications, before using them on the “real” patient.
Our work presents some limitations inherent to its pilot design, including the single center location and the small sample size. In addition, we included both medical and nursing students as these pilot sessions aimed to assess the feasibility and usefulness of the VR simulation training across mixed clinical background, so that to gear the introduction and debriefing to the participants’ needs. While we could not analyze nursing students’ responses separately, as the questionnaires were completed anonymously using a personal identifier code unknown to the research team, we did not find outliers in our analyses.
The feedback and information from this pilot group of students on feasibility were well-received, and further work went into closing the gap between their unfamiliarity with VR hardware in general and lack of familiarity with the software. Several iterative meetings among all authors, including the initial programmers of the software, yielded two implementable changes.
First, we have learned that despite a generational advantage for technologies among millennials and younger medical students, an assumption that they will navigate VR hardware in a medical training setting should not be made. We discussed as a team whether an in-person hardware demonstration could be enhanced by a video-based hardware demonstration available to participants for watching before the VR session. We have thus developed a video-based demonstration for students to watch at their own leisure prior to a VR session. This approach is currently being evaluated in a new VR project where we expect to find an overall higher participants’ rating of perceived ease-of-use.
Second, the programmers agreed on revamping the tutorial. The initial resuscitationVR tutorial was made to eliminate the possibility that the student will be primed about the topic of the case scenario for the purposes of prior research studies [9, 11]. Ultimately, for VR implementation on PEM training among students, we felt that it was important for students to take the time to explore their digital surroundings just like they would explore their real surroundings on their first day of a clinical rotation, including familiarity with equipment locations and medication availability. Therefore, we introduced a “sandbox” tutorial in which students were free to use and interact with all of the available equipment, medications, and virtual patient outside of a scripted scenario to gain contextual understanding of how the scenario functioned.
Finally, we demonstrate a successful collaboration between industry and an academic teaching center. While contractual relationships between industry and academia are not new, this type of pilot feasibility trial in its intended context provides valuable needs assessment data not just for programming changes but for implementation changes as a whole for curricular development.
Data availability
Data will be made available upon request.
References
Benito J, Mintegi S, Ruddy RM, del Rey JA (2012) Changing clinical practices and education in pediatric emergency medicine through global health partnerships. Clinical Pediatric Emergency Medicine 13(1):37–43
Sahyoun C, Cantais A, Gervaix A, Bressan S, Löllgen R, Krauss B (2021) Pediatric Emergency Medicine Comfort and Analgesia Research in Europe (PemCARE) group of the Research in European Pediatric Emergency Medicine. Pediatric procedural sedation and analgesia in the emergency department: surveying the current European practice. Eur J Pediatr 180(6):1799–1813. https://doi.org/10.1007/s00431-021-03930-6. Epub 2021 Jan 28. Erratum in: Eur J Pediatr. 2021 Feb 13;: PMID: 33511466; PMCID: PMC8105204
Brossier D, Bellot A, Villedieu F, Fazilleau L, Brouard J, Guillois B (2017) Implementation and assessment of a training course for residents in neonatology and pediatric emergency medicine. Arch Pediatr 24(5):432–438. https://doi.org/10.1016/j.arcped.2017.02.020. (Epub 2017 Mar 30 PMID: 28365188)
Lecadet N, Roupie E, Macrez R, Jokic M, Brossier D (2020) Assessment of general emergency medicine physicians’ medical education regarding management of pediatric emergencies in western Normandy. France Arch Pediatr 27(5):239–243. https://doi.org/10.1016/j.arcped.2020.05.005. (Epub 2020 May 12 PMID: 32409248)
Ralston BH, Willett RC, Namperumal S, Brown NM, Walsh H, Muñoz RA et al (2021) Use of virtual reality for pediatric cardiac critical care simulation. Cureus 13(6):e15856. https://doi.org/10.7759/cureus.15856. PMID: 34327083; PMCID: PMC8301287
Putnam EM, Rochlen LR, Alderink E, Augé J, Popov V, Levine R et al (2021) Virtual reality simulation for critical pediatric airway management training. J Clin Transl Res 7(1):93–99. PMID: 34104812; PMCID: PMC8177020
Zaveri PP, Davis AB, O’Connell KJ, Willner E, Aronson Schinasi DA, Ottolini M (2016) Virtual reality for pediatric sedation: a randomized controlled trial using simulation. Cureus 8(2):e486. https://doi.org/10.7759/cureus.486. PMID: 27014520; PMCID: PMC4786378
Perron JE, Coffey MJ, Lovell-Simons A, Dominguez L, King ME, Ooi CY (2021) Resuscitating cardiopulmonary resuscitation training in a virtual reality: prospective interventional study. J Med Internet Res 23(7):e22920. https://doi.org/10.2196/22920. PMID: 34326040; PMCID: PMC8367149
Chang TP, Beshay Y, Hollinger T, Sherman JM (2019) Comparisons of stress physiology of providers in real-life resuscitations and virtual reality-simulated resuscitations. Simul Healthc 14(2):104–112. https://doi.org/10.1097/SIH.0000000000000356. (PMID: 30730471)
Chang TP, Weiner D (2016) Screen-based simulation and virtual reality for pediatric emergency medicine. Clinical Pediatric Emergency Medicine 17(3):224–230
Chang TP, Hollinger T, Dolby T, Sherman JM (2021) Development and considerations for virtual reality simulations for resuscitation training and stress inoculation. Simulation in Healthcare 16(6):e219–e226
Acknowledgements
The authors would like to thank Tom Dolby, Chief Technology Officer of i3 Simulations and Thomas J Matthews (Senior Research Manager of i3 Simulation) for their contribution to the adjustment of the software to our setting and the localization to Italian.
Funding
Open access funding provided by Università degli Studi di Padova within the CRUI-CARE Agreement. The innovative VR-based teaching has been partially supported by a grant from the University of Padova for innovative teaching for undergraduate students—D.R. Rep. N. 1671–2020- Prot. N. 0210040.
Author information
Authors and Affiliations
Contributions
All authors contributed to the study conception and design. Material preparation, data collection and analysis were performed by Sandro Savino, Silvia Bressan, Giulia Mormando, Todd Chang. The first draft of the manuscript was written by Silvia Bressan, Todd Chang and Sandro Savino. All authors reviewed the manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval
The Human Ethics Committee of the University Hospital of Padua assessed this pilot study as a negligible risk study and granted approval via a fast-tracked review process. The authors confirm that this study was performed in accordance with the ethical standards as laid down in the 1964 Declaration of Helsinki and its later amendments.
Consent to participate
Informed consent was obtained from all individual participants included in the study. All data were collected as anonymous. Individual participants were randomly allocated an ID number, which was only known to participants, in order to calculate the perceived level of competence before and after the VR sessions.
Competing interests
The authors declare no competing interests. i3 Simulations did not have access to study data.
Additional information
Communicated by Peter de Winter
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Savino, S., Mormando, G., Saia, G. et al. SIMPEDVR: using VR in teaching pediatric emergencies to undergraduate students—a pilot study. Eur J Pediatr 183, 499–502 (2024). https://doi.org/10.1007/s00431-023-05254-z
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00431-023-05254-z