Skip to main content
SpringerLink
Log in

Enhanced Reality for Healthcare Simulation

  • Chapter
  • First Online:
Recent Advances in Technologies for Inclusive Well-Being

Part of the book series: Intelligent Systems Reference Library ((ISRL,volume 196))

Abstract

Enhanced reality for immersive simulation (e-REAL®) is the merging of real and virtual worlds: a mixed reality environment for hybrid simulation where physical and digital objects co-exist and interact in real time, in a real place and not within a headset. The first part of this chapter discusses e-REAL: an advanced simulation within a multisensory scenario, based on challenging situations developed by visual storytelling techniques. The e-REAL immersive setting is fully interactive with both 2D and 3D visualizations, avatars, electronically writable surfaces and more: people can take notes, cluster key-concepts or fill questionnaires directly on the projected surfaces. The second part of this chapter summarizes an experiential coursework focused on learning and improving teamwork and event management during simulated obstetrical cases. Effective team management during a crisis is a core element of expert practice: for this purpose, e-REAL reproduces a variety of different emergent situations, enabling learners to interact with multimedia scenarios and practice using a mnemonic called Name-Claim-Aim. Learners rapidly cycle between deliberate practice and direct feedback within a simulation scenario until mastery is achieved. Early findings show that interactive immersive visualization allows for better neural processes related to learning and behavior change.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Arnheim, R.: Visual Thinking. University of California Press, Berkeley and Los Angeles, CA (1969)

    Google Scholar 

  2. Arnsten, A.F.: Catecholamine modulation of prefrontal cortical cognitive function. Trends Cogn. Sci. 2(11), 436–447 (1998)

    Article  Google Scholar 

  3. Auer, M., Guralnick, D., Uhomoibhi, J. (eds.): Interactive collaborative learning. In: Proceedings of the 19th ICL Conference, vol. 1. Springer, Cham, CH (2017)

    Google Scholar 

  4. Aukstakalnis, S.: Practical Augmented Reality. A Guide to the Technologies, Applications, and Human Factors for AR and VR. Addison-Wesley, Boston (2017)

    Google Scholar 

  5. Bailenson, J.N., Blascovich, J., Beall, A.C., Noveck, B.: Courtroom applications of virtual environments, immersive virtual environments, and collaborative virtual environments. Law Policy 28(2), 249–270 (2006)

    Article  Google Scholar 

  6. Batini, F., Fontana, A.: Storytelling kit. 99 esercizi per il pronto intervento narrative. Rizzoli, Milano (2010)

    Google Scholar 

  7. Bauman, Z.: Liquid Modernity. Polity Press, Cambridge, UK (2008)

    Google Scholar 

  8. Bergmann, J., Sams, A.: Flip Your Classroom. Reach Every Student in Every Class Every Day (2012)

    Google Scholar 

  9. Bergstrom, B.: Essentials of Visual Communication. King Publishing, London, UK (2008)

    Google Scholar 

  10. Bertagni, B., La Rosa, M., Salvetti, F. (eds.): Learn How to Learn! Knowledge Society, Education and Training. Franco Angeli, Milan (2010)

    Google Scholar 

  11. Blascovich, J., Loomis, J., Beall, A., Swinth, K., Hoyt, C., Bailenson, J.N.: Immersive virtual environment technology as a methodological tool for social psychology. Psychol. Inq. 13, 103–124 (2002)

    Article  Google Scholar 

  12. Blazer, L.: Animated Storytelling. Simple Steps for Creating Animation and Motion Graphics. Pearson, London, UK (2016)

    Google Scholar 

  13. Bremond, C.: Logique du récit. Éditions du Seuil, Paris (1973)

    Google Scholar 

  14. Buttimer, M.: Name/Claim/Aim Around the World. https://harvardmedsim.org/blog/name-claim-aim-around-the-world/ (2020)

  15. Calabi, D., Bisson, M., Venica, C.: Design and medical training experimental hypotheses for training in immersive environments. In: 3rd International Conference on Environmental Design, pp. 527–532. Polytechnic of Milan, Italy (2019)

    Google Scholar 

  16. Castells, M.: The Rise of the Networked Society. Wiley-Blackwell, Hoboken, NJ (2009)

    Book  Google Scholar 

  17. Ciuccarelli, P., Valsecchi, R.: Ethnographic approach to design knowledge. Dialogue and participation as discovery tools within complex knowledge contexts. In: IASDR 2009—Rigor and Relevance in Design (2009)

    Google Scholar 

  18. Collins, S.: Neuroscience for Learning and Development. How to Apply Neuroscience & Psychology for Improved Learning & Training. Kogan Page, London (2015)

    Google Scholar 

  19. Coro, G.: Valutazione del software e-REAL Speech Analysis. ISTI-CNR, Pisa (2019)

    Google Scholar 

  20. Cruz-Neira, C., Sandin, D.J., De Fanti, T.A., Kenyon, R.V., Hart, J.C.: The CAVE: audio visual experience automatic virtual environment. Commun. ACM 35, 64–72 (1992)

    Article  Google Scholar 

  21. De Leeuw, K.E., Mayer, R.E.: A comparison of three measures of cognitive load: evidence for separable measures of intrinsic, extraneous, and germane load. J. Educ. Psychol. 100(1), 223–234 (2008)

    Article  Google Scholar 

  22. De Rossi, M., Petrucco, C.: Le narrazioni digitali per l’educazione e la formazione. Carocci, Roma (2013)

    Google Scholar 

  23. De Souza e Silva, A., Sutko, D.M.: Digital Cityscapes: Merging Digital and Urban Playspaces. Peter Lang Publishing, Inc., New York, NY (2009)

    Google Scholar 

  24. Eppler, M., Burkhard, R.: Knowledge Visualization. Towards a New Discipline and Its Field of Application. Research Paper 07-02. University of the Italian Switzerland, Lugano (2004)

    Google Scholar 

  25. Ericcson, A., Krampe, R., Tesch-Romer, C.: The role of deliberate practice in the acquisition of expert performance. Psychol. Rev. 100(3), 363–340 (1993)

    Google Scholar 

  26. Fields, H.L., Hjelmstad, G.O., Margolis, E.B., Nicola, S.M.: Ventral tegmental area neurons in learned appetitive behavior and positive reinforcement. Annu. Rev. Neurosci. 30, 289–316 (2007)

    Article  Google Scholar 

  27. Friedlander, M.J., Andrews, L., Armstrong, E.G., Aschenbrenner, C., Kass, J.S., Ogden, P., Schwartzstein, G., Viggiano, T.R.: What can medical education learn from the neurobiology of learning? Acad. Med. 86(04), 415–420 (2011)

    Article  Google Scholar 

  28. Gaba, D.M., Fish, K.J., Howard, S.K.: Crisis Management in Anesthesiology. Churchill Livinstone, Philadelphia, PA (1994); Walker, J.D., Spencer, P.J., Walzer, T.B., Cooper, J.B.: Simulation in cardiac surgery. In: Cohn, L.H., Adams, D.H. (eds.) Cardiac Surgery in Adult. McGraw Hill, Columbus, OH (2018)

    Google Scholar 

  29. Gardner, R.: Medical Simulation Week 2018. Center for Medical Simulation. https://e-real.net/wp-content/uploads/videos/e-REAL@www.harvardmedsim.org.mp4 (2018) (ver. 15.04.2019)

    Google Scholar 

  30. Gardner, R., Salvetti, F.: Improving Teamwork and Crisis Resource Management for Labor and Delivery Clinicians: Educational Strategies Based on Dynamic Visualization to Enhance Situational Awareness, Contextual Intelligence and Cognitive Retention, Research Abstract. IMSH 2019, San Antonio, TX (2019)

    Google Scholar 

  31. Gazzaniga, M.S. (ed.): The Cognitive Neurosciences. MIT Press, Boston, MA (2009)

    Google Scholar 

  32. Genette, G.: Figures III. Éditions du Seuil, Paris (1972)

    Google Scholar 

  33. Guralnick, D.: Re-envisioning online learning. In: Salvetti, F., Bertagni, B. (eds.) Learning 4.0. Advanced Simulation, Immersive Experiences and Artificial Intelligence, Flipped Classrooms, Mentoring and Coaching. Franco Angeli, Milan (2018)

    Google Scholar 

  34. Kandel, E.R., Schwartz, J.H., Jessell, T.M., Siegelbaum, S.A., Hudspeth, A.J.: Principles of Neural Sciences. McGraw Hill, New York, NY (2013)

    Google Scholar 

  35. Kernbach, S., Eppler, M., Bresciani, S.: The use of visualization in the communication of business strategy: an experimental evaluation. Int. J. Bus. Commun. I-24 (2014)

    Google Scholar 

  36. Khanna, T.: Contextual intelligence. Harv. Bus. Rev. 9 (2014)

    Google Scholar 

  37. Knight, C., Glaser, J.: Diagrams. Innovative Solutions for Graphic Designers. Tables. Graphs. Charts. Forms. Maps. Signs. Instructions. RotoVision, Mies (2009)

    Google Scholar 

  38. Lamberti, F., Pratticò, G.: E-REAL Speech Analysis. User Manual V1.0.4. Polytechnic School of Turin, Turin (2018)

    Google Scholar 

  39. Lester, P.M.: Visual Communication: Images with Messages. Thomson Wadsworth, Belmont, CA (2006)

    Google Scholar 

  40. Lévy, P.: Qu’est-ce que le virtuel? La Découverte, Paris (1998)

    Google Scholar 

  41. Licci, G.: Immagini di conoscenza giuridica. Cedam, Padova (2011)

    Google Scholar 

  42. Lira, M., Gardner, S.M.: Leveraging multiple analytic frameworks to assess the stability of students’ knowledge in physiology. In: CBE Life Science Education, 1 Mar 2020, 19 (2020)

    Google Scholar 

  43. Lowe, R., Ploetzner, R. (eds.): Learning from Dynamic Visualization. Innovations in Research and Application. Springer, Berlin (2017)

    Google Scholar 

  44. Lyons, R., Lazzara, E., Benishek, L., Zajac, S., Gregory, M., Sonesh, S., Salas, E.: Enhancing the effectiveness of team debriefings in medical simulation: more best practices. Jt. Comm. J. Qual. Patient Saf. 41(3), 115–123 (2015)

    Google Scholar 

  45. Marchese, A.: L’officina del racconto. Mondadori, Milano (1983)

    Google Scholar 

  46. Markowitz, M., Bailenson, J.: Virtual Reality and Communication, Oxford Bibliographies. https://vhil.stanford.edu/mm/2019/02/markowitz-oxford-vr-communication.pdf (2019) (ver. 15.04.2019)

  47. Mayer, R.E., Moreno, R.: Nine ways to reduce cognitive load in multimedia learning. Educ. Psychol. 38(1), 43–52 (2003)

    Article  Google Scholar 

  48. Mazur, E.: Peer Instruction, A User’s Manual. In: Prentice Hall Series in Educational Innovation. Upper Saddle River (1997)

    Google Scholar 

  49. Milgram, P., Kishino, A.F.: Taxonomy of mixed reality visual displays. IEICE Trans. Inf. Syst. 1321–1329 (1994)

    Google Scholar 

  50. Minehart, R., Pian-Smith, M., Walzer, T., Gardner, R., Rudolph, J., Simon, R., Raemer, D.: Speaking across the drapes. Communication strategies of anesthesiologists and obstetricians during a simulated maternal crisis. Simul. Healthc. 7, 166–170 (2012)

    Article  Google Scholar 

  51. Minehart, R., Rudolph, J., Nadelberg, R., Clinton, E., Gardner, R.: Name/claim/aim for obstetric crises: a new paradigm in crisis resource management. In: Poster Communication: Phoenix, AZ: SOAP 51st Annual Meeting (2019)

    Google Scholar 

  52. Morin, E.: La connaissance de la connaissance. Le Seuil, Paris (1986)

    Google Scholar 

  53. Murray, S.: Interactive Data Visualization for the Web. O’Reilly Media, Sebastopol, CA (2013)

    Google Scholar 

  54. Parisi Presicce, P.: Impalcature. Teorie e pratiche della narratività. Mimesis, Milano (2017)

    Google Scholar 

  55. Popper, K.R.: Objective Knowledge: An Evolutionary Approach. Oxford University Press, Oxford (1972)

    Google Scholar 

  56. Potter, M.C., Wyble, B., Hagmann, C.E., McCourt, E.S.: Detecting meaning in RSVP at 13 ms per picture, in attention. Percept Psychophys. 76, 270–279 (2014)

    Article  Google Scholar 

  57. Raemer, D.B., Kolbe, M., Minehart, R.D., Rudolph, J.W., Pian-Smith, M.C.: Improving anesthesiologists’ ability to speak up in the operating room: a randomized controlled experiment of a simulation-based intervention and a qualitative analysis of hurdles and enablers. Acad. Med. 91(4), 530–539 (2016)

    Google Scholar 

  58. Ridgway, J., Nicholson, J., Campos, P., Teixeira, S.: Dynamic Visualisation Tools: A Review. ProCivicStat Project: https://IASE-web.org/ISLP/PCS (2018)

  59. Rizzolatti, G., Sinigaglia, C.: Mirrors in the Brain: How Our Minds Share Actions and Emotions. Oxford University Press, Oxford and New York, NY (2008)

    Google Scholar 

  60. Robilant, E.: Conoscenza: forme, prospettive e valutazioni. La traduzione della conoscenza nell’operatività. Lessons at the University of Turin 1990–1991, Turin: manuscript (1991)

    Google Scholar 

  61. Rosenberg, L.B.: The Use of Virtual Fixtures as Perceptual Overlays to Enhance Operator Performance in Remote Environments. Technical Report AL-TR-0089. USAF Armstrong Laboratory, Wright-Patterson AFB OH (1992)

    Google Scholar 

  62. Rudolph, J., Simon, R., Raemer, D., Eppich, W.: Debriefing as a formative assessment: closing performance gaps in medical education. Acad. Emerg. Med. 15, 1010–1016 (2008)

    Article  Google Scholar 

  63. Salvetti, F.: Rethinking learning and people development in the 21st century: the enhanced reality lab—e-REAL—as a cornerstone in between employability and self-empowerment. In: Salvetti, F., La Rosa, M., Bertagni, B. (eds.) Employability: Knowledge, Skills and Abilities for the Glocal World. Franco Angeli, Milan (2015)

    Google Scholar 

  64. Salvetti, F., Bertagni, B.: Anthropology and epistemology for “glocal” managers: understanding the worlds in which we live and work. In: Bertagni, B., La Rosa, M., Salvetti, F. (eds.) “Glocal” Working. Living and Working Across the World with Cultural Intelligence. Franco Angeli, Milan (2010)

    Google Scholar 

  65. Salvetti, F., Bertagni, B.: e-REAL: enhanced reality lab. Int. J. Adv. Corp. Learn. 7–3, 41–49 (2014)

    Article  Google Scholar 

  66. Salvetti, F., Bertagni, B.: Interactive tutorials and live holograms in continuing medical education: case studies from the e-REAL experience. In: Proceedings of the ICELW Conference, Columbia University, New York, NY, pp. 1–8 (2016)

    Google Scholar 

  67. Salvetti, F., Bertagni, B. (eds.): Learning 4.0. Advanced Simulation, Immersive Experiences and Artificial Intelligence, Flipped Classrooms, Mentoring and Coaching. Franco Angeli, Milan (2018a)

    Google Scholar 

  68. Salvetti, F., Bertagni, B.: Reimagining STEM education and training with e-REAL: 3D and holographic visualization, immersive and interactive learning for an effective flipped classroom. In: Salvetti, F., Bertagni, B. (eds.) Learning 4.0. Advanced Simulation, Immersive Experiences and Artificial Intelligence, Flipped Classrooms, Mentoring and Coaching. Franco Angeli, Milan (2018b)

    Google Scholar 

  69. Salvetti, F., Gardner, R., Minehart, R., Bertagni, B.: Teamwork and Crisis Resource Management for Labor and Delivery Clinicians: Interactive Visualization to Enhance Teamwork, Situational Awareness, Contextual Intelligence and Cognitive Retention in Medical Simulation. Research Paper. ICELW 2019 at Columbia University, New York, NY (2019a)

    Google Scholar 

  70. Salvetti, F., Bertagni, B.: Virtual worlds and augmented reality: the enhanced reality lab as a best practice for advanced simulation and immersive learning. Form@re 19(1) (2019b)

    Google Scholar 

  71. Shapiro, M., Gardner, R., Godwin, S., Jay, G., Lindquist, D., Salisbury, M., Salas, E.: Defining team performance for simulation-based training: methodology, metrics, and opportunities for emergency medicine. Acad. Emerg. Med. 15, 1088–1097 (2008)

    Article  Google Scholar 

  72. Strayer, J.F.: The effects of the classroom flip on the learning environment: a comparison of learning activity in a traditional classroom and a flip classroom that used an intelligent tutoring system. Dissertation Abstracts International Section A, 68 (2008)

    Google Scholar 

  73. Sweller, J., Ayres, P., Kalyuga, S.: Cognitive Load Theory. Springer, New York, NY (2017)

    Google Scholar 

  74. Szparagowsk, R.: The Effectiveness of the Flipped Classroom (2014). Honors Projects. 127. https://scholarworks.bgsu.edu/honorsprojects/127 (2014)

  75. Taras, J., Everett, T.: Rapid cycle deliberate practice in medical education—a systematic review. Cureus 9(4), 1180 (2017)

    Google Scholar 

  76. Toto, R., Nguyen, H.: Flipping the work design in an industrial engineering course. Paper presented at the ASEE/IEEE Frontiers in Education Conference, San Antonio, TX (2009)

    Google Scholar 

  77. Tucker, B.: The flipped classroom. Educ. Next 12(1) (2012)

    Google Scholar 

  78. Tufte, E.: Visual Explanations: Images and Quantities, Evidence and Narrative. Graphics Press, Cheshire, CT (1997)

    MATH  Google Scholar 

  79. Tufte, E.: The Visual Display of Quantitative Information. Graphics Press, Cheshire, CT (2001)

    Google Scholar 

  80. Vasconcelos, A. (ed.): Global Trends 2030. Citizens in an Interconnected and Polycentric World. European Institute for Security Studies, Brussels (2011)

    Google Scholar 

  81. Vogel, D., Dickson, G., Lehman, J.: Persuasion and the Role of Visual Presentation Support. Research Paper. Management Information Systems Research Center. University of Minnesota: School of Management, Minneapolis, MS (1986)

    Google Scholar 

  82. Wieman, C.: STEM education: active learning or traditional lecturing? In: Salvetti, F., Bertagni, B. (eds.) Learning 4.0. Advanced Simulation, Immersive Experiences and Artificial Intelligence, Flipped Classrooms, Mentoring and Coaching. Franco Angeli, Milan (2018)

    Google Scholar 

  83. Wirth, W., Hartmann, T., Bocking, S., Vorderer, P., Klimmt, C., Holger, S., Saari, T., Laarni, J., Ravaja, N., Gouveia, F., Biocca, F., Sacau, A., Jancke, L., Baumgartner, T., Jancke, P.: A process model for the formation of spatial presence experiences. Media Psychol. 9, 493–525 (2007)

    Article  Google Scholar 

  84. Wissmath, B., Weibel, D., Groner, R.: Dubbing or subtitling? Effects on spatial presence, transportation, flow, and enjoyment. J. Media Psychol. 21(3), 114–125 (2009)

    Article  Google Scholar 

  85. Yeo, J., Gilbert, J.K.: The role of representations in students’ explanations of four phenomena in physics: dynamics, thermal physics, electromagnetic induction and superposition. In: Treagust, D.F., Reinders, D., Fischer, H.E. (eds.) Multiple Representations in Physics Education. Springer, Cham (2017)

    Google Scholar 

Download references

Acknowledgements

The authors wish to thank Ms. Starly Santos, Research Analyst at Logosnet (Switzerland and USA) and Student at the Columbia University in New York (NY–USA): Her cooperation was of the greatest value.

A great thank-you also to Prof. Bill Kapralos, Ontario Tech University (Oshawa, CA) and to Dr. Amy Nakajima, University of Ottawa (CA), who read the first release of this chapter and made a great number of valuable corrections and suggestions.

Author information

Authors and Affiliations

  1. Centro Studi Logos, Turin, Italy

    Fernando Salvetti & Barbara Bertagni

  2. Logosnet, Lugano, Switzerland

    Fernando Salvetti & Barbara Bertagni

  3. Logosnet, Houston, TX, USA

    Fernando Salvetti & Barbara Bertagni

  4. Center for Medical Simulation, Boston, MA, USA

    Roxane Gardner & Rebecca D. Minehart

  5. Brigham and Women’s Hospital, Boston, MA, USA

    Roxane Gardner

  6. Children’s Hospital, Boston, MA, USA

    Roxane Gardner

  7. Massachusetts General Hospital, Boston, MA, USA

    Roxane Gardner & Rebecca D. Minehart

  8. Harvard Medical School, Boston, MA, USA

    Roxane Gardner & Rebecca D. Minehart

Authors
  1. Fernando Salvetti
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Roxane Gardner
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Rebecca D. Minehart
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Barbara Bertagni
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Fernando Salvetti .

Editor information

Editors and Affiliations

  1. Aalborg University, Esbjerg, Denmark

    Anthony Lewis Brooks

  2. Computer Information Systems, Missouri State University, Spring Filed, MO, USA

    Sheryl Brahman

  3. maxSIMhealth, Ontario Tech University, Oshawa, ON, Canada

    Bill Kapralos

  4. SIM Advancement & Innovation, Simulation Canada, Toronto, ON, Canada

    Amy Nakajima

  5. Trent/Fleming School of Nursing, Trent University, Peterborough, ON, Canada

    Jane Tyerman

  6. KES International, Shoreham-by-Sea, UK

    Lakhmi C. Jain

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Salvetti, F., Gardner, R., Minehart, R.D., Bertagni, B. (2021). Enhanced Reality for Healthcare Simulation. In: Brooks, A.L., Brahman, S., Kapralos, B., Nakajima, A., Tyerman, J., Jain, L.C. (eds) Recent Advances in Technologies for Inclusive Well-Being. Intelligent Systems Reference Library, vol 196. Springer, Cham. https://doi.org/10.1007/978-3-030-59608-8_7

Download citation

Publish with us

Policies and ethics

Search

Navigation