Skip to main content

Virtual Reality and Augmented Reality

  • Chapter
  • First Online:
Rheumatology Teaching

Abstract

Medical education is transforming thanks to medical schools adopting innovations to prepare new clinicians, paramedics as well as nurses for emerging models of care. In today’s rapidly changing healthcare system, physicians and care teams require new capabilities to best practice medicine and serve their patients. They must understand value-based payment models, how to operate in a patient-centred system – rather than one centred on the physician – and learn to incorporate new technologies into the practice of medicine. Virtual reality/augmented reality and virtual patients technologies have the potential to make interactive, customizable 3D virtual patients effective for educating healthcare professionals with vast applications. Also, they are valuable for undergraduate basic as well as clinical sciences learning. There are still some challenges of developing intelligent machines that appear to think and behave like humans. This chapter will discuss the science behind virtual reality technology, the virtual reality environments for health professional education and the use of virtual reality/augmented reality to improve the clinicians’ skills. The chapter will expand to discuss designing of realistic virtual patients, advantages and disadvantages of VR and AR for virtual patients as well as virtual reality/augmented reality in medical education. The chapter will conclude with discussion of the use of virtual reality/augmented reality for patient management.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Strangman N, Hall T. Virtual reality/simulations. Wakefield: National Center on Accessing the General Curriculum; 2003.

    Google Scholar 

  2. Mantovani F, Castelnuovo G, Gaggioli A, Riva G. Virtual reality training for health-care professionals. Cyberpsychol Behav. 2003;6(4):389–95.

    Article  PubMed  Google Scholar 

  3. Rasmussen K, Belisario JM, Wark PA, Molina JA, Loong SL, Cotic Z, et al. Offline eLearning for undergraduates in health professions: a systematic review of the impact on knowledge, skills, attitudes and satisfaction. J Global Health. 2014;4(1):010405.

    Article  Google Scholar 

  4. Bowman DA, McMahan RP. Virtual reality: how much immersion is enough? Computer. 2007;40(7):36–43.

    Article  Google Scholar 

  5. De Luca R, Lo Buono V, Leo A, Russo M, Aragona B, Leonardi S, et al. Use of virtual reality in improving post-stroke neglect: promising neuropsychological and neurophysiological findings from a case study. Appl Neuropsychol Adult. 2017;1:1–5. https://doi.org/10.1080/23279095.2017.1363040.

    Article  Google Scholar 

  6. Greenleaf W. Medical Applications of Virtual Reality. http://bme2.aut.ac.ir/~towhidkhah/MI/Discussion86-1/VR%2520Med%2520overview.pdf. Accessed on 27 May 2018.

  7. Pourazar M, Mirakhori F, Hemayattalab R, Bagherzadeh F. Use of virtual reality intervention to improve reaction time in children with cerebral palsy: a randomized controlled trial. Dev Neurorehabil. 2017;1:1–6. https://doi.org/10.1080/17518423.2017.

    Article  Google Scholar 

  8. Van Bennekom MJ, De Koning PP, Denys D. Virtual reality objectifies the diagnosis of psychiatric disorders: a literature review. Front Psychol. 2017;8:163. https://doi.org/10.3389/fpsyt.2017.00163.

    Article  Google Scholar 

  9. Augmented Reality vs. Virtual Reality – what’s the difference? https://learningenglish.voanews.com/a/augmented-reality-versus-virtual-reality/3844772.html.

  10. Layar App. https://www.layar.com/.

  11. Milgram P, Kishino F. A taxonomy of mixed reality visual displays. In: IEICE TRANSACTIONS on information and systems. 1994. p. 1321–9.

    Google Scholar 

  12. Dalgarno B, Lee MJ. What are the learning affordances of 3-D virtual environments? Br J Educ Technol. 2010;41(1):10–32.

    Article  Google Scholar 

  13. Psotka J. Immersive training systems: virtual reality and education and training. Instr Sci. 1995;23(5–6):405–31.

    Article  Google Scholar 

  14. Schultheis MT, Rizzo AA. The application of virtual reality technology in rehabilitation. Rehabil Psychol. 2001;46(3):296.

    Article  Google Scholar 

  15. Hansen MM. Versatile, immersive, creative and dynamic virtual 3-D healthcare learning environments: a review of the literature. J Med Internet Res. 2008;10(3):e26.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Saxena N, Kyaw BM, Vseteckova J, Dev P, Paul P, Lim KTK, Kononowicz A, Masiello I, Tudor Car L, Nikolaou CK, Zary N, Car J. Virtual reality environments for health professional education. Cochrane Database Syst Rev. 2016;(2):CD012090. https://doi.org/10.1002/14651858.CD012090.

  17. Jarmon L, Traphagan T, Mayrath M, Trivedi A. Virtual world teaching, experiential learning, and assessment: an interdisciplinary communication course in second life. Comput Educ. 2009;53(1):169–82.

    Article  Google Scholar 

  18. Kurtz S, Silverman J, Draper J. Teaching and learning communication skills in medicine. Oxford: CRC Press; 1998.

    Google Scholar 

  19. Fertleman C, Aubugeau-Williams P, Sher C, Lim A-N, Lumley S, Delacroix S, Pan X. A discussion of virtual reality as a new tool for training healthcare professionals. Front Public Health. 2018;6:44. https://doi.org/10.3389/fpubh.2018.00044.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Pan X, Slater M, Beacco A, Navarro X, Bellido Rivas AI, Swapp D, et al. The responses of medical general practitioners to unreasonable patient demand for antibiotics––a study of medical ethics using immersive virtual reality. PLoS One. 2016;11(2):e0146837. https://doi.org/10.1371/journal.pone.0146837.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  21. Zielke MA, Zakhidov D, Hardee G, Evans L, Lenox S, Orr N, Fino D, Mathialagan G. Developing virtual patients with VR/AR for a natural user interface in medical teaching. https://doi.org/10.1109/SeGAH.2017.7939285.

  22. Falcao C, Lemos AC, Soares M. Evaluation of natural user interface: a usability study based on the leap motion device. Procedia Manuf. 2015;3:5490–5.

    Article  Google Scholar 

  23. Mavromihelaki E, et al. Cyberball3D+: A 3D serious game for fMRI investigating social exclusion and empathy. In: 2014 6th International Conference on Games and Virtual Worlds for Serious Applications (VS-GAMES), Valletta. 2014. p. 1–8.

    Google Scholar 

  24. Kleinsmith A, Rivera-Gutierrez D, Finney G, Cendan J, Lok B. Understanding empathy training with virtual patients. Comput Hum Behav. 2015;52:151–8. [Online].

    Article  Google Scholar 

  25. Raffii A, Zuccarino T. Method and system enabling natural user interface gestures with user wearable glasses. U.S. Patent 9310891. 2016.

    Google Scholar 

  26. “Natural User Interface”. In: NUI Group. 2011. [Online]. Available: http://wiki.nuigroup.com/Natural_User_Interface. Accessed 28 May 2018.

  27. Turing A. I.—Computing machinery and intelligence. Mind. 1950;(236):433–60.

    Article  Google Scholar 

  28. Talbot T, Sagae K, John B, Rizzo A. Sorting out the virtual patient. Int J Gaming Comput Mediat Simul. 2012;4(3):1–19.

    Article  Google Scholar 

  29. “SimCoach.” 2013. [Online]. Available: http://www.simcoach.org/. Accessed 26 May 2018.

  30. Donald CC, Sokolowski JA, Banks CM, editors. The digital patient: advancing healthcare, research, and education. Hoboken: Wiley; 2015.

    Google Scholar 

  31. De Vault D, et al. “SimSensei kiosk,” International Foundation for Autonomous Agents and Multiagent Systems. 2014. p. 1061–8. [Online]. Available: http://dl.acm.org/citation.cfm?id=2617388.2617415.

  32. Virtual human Toolkit. 2017. [Online]. Available: https://vhtoolkit.ict.usc.edu/. Accessed May 2018.

  33. Miller D. Intelligent assistant landscape shows slow growth but huge potential. VentureBeat. 2016. [Online]. Available:http://venturebeat.com/2016/02/14/intelligent-assistance-theslow-growth-space-that-will-eventually-wow-us/. Accessed 28 May 2018.

  34. What is Cortana? Microsoft support. 2016. [Online]. Available: https://support.microsoft.com/en-us/help/17214/windows-10-what-is. Accessed 28 May 2018.

  35. Manuvinakurike R, Paetzel M, Qu C, Schlangen D, De Vault D. Toward incremental dialogue act segmentation in fast-paced interactive dialogue systems. In: 17th Annual Meeting of the Special Interest Group on Discourse and Dialogue. 2016.

    Google Scholar 

  36. Sanchez-Vives MV, Slater M. From presence to consciousness through virtual reality: abstract: nature reviews neuroscience. Nat Rev Neurosci. 2005;6(4):332–9. [Online]. Available: http://www.nature.com/nrn/journal/v6/n4/abs/nrn1651.html.

    Article  CAS  PubMed  Google Scholar 

  37. Johnson DM. Introduction to and review of simulator sickness research. Defense Technical Information Center; 2005.

    Google Scholar 

  38. Oculus VR. LLC, Simulator sickness. 2016. [Online]. Available: https://developer3.oculus.com/documentation/introvr/latest/concepts/bp_app_simulator_sickness/. Accessed 28 May 2018.

  39. Hendrix C, Barfield W. The sense of presence within auditory virtual environments. Presence Teleop Virt. 1996;5(3):290–301. [Online]. Available: http://dl.acm.org/citation.cfm?id=2871028.2871031.

    Article  Google Scholar 

  40. Pellegrini RS. Quality assessment of auditory virtual environments. Georgia Institute of Technology; 2001. [Online]. Available: https://smartech.gatech.edu/handle/1853/50631.

  41. Oculus VR. LLC, 3D Audio spatialization. 2016. [Online]. Available: https://developer3.oculus.com/documentation/audiosdk/latest/concepts/audio-intro-spatialization/. Accessed 28 May 2018.

  42. Lalwani M. 3D audio is the secret to HoloLens’ convincing holograms. 2016. [Online]. Available: https://www.engadget.com/2016/11/02/microsoft-exclusive-hololensspatial-sound/. Accessed 28 May 2018.

  43. Bright P. Microsoft sheds some light on its mysterious holographic processing unit. Condé Nast. 2016. [Online]. Available: http://arstechnica.com/information-technology/2016/08/microsoftsheds-some-light-on-its-mysterious-holographic-processing-unit/. Accessed 28 May 2018.

  44. Xiao R, Benko H. Augmenting the field-of-view of head-mounted displays with sparse peripheral displays. In: The 2016 CHI Conference. 2016.

    Google Scholar 

  45. Exporting and building a unity visual studio solution. [Online]. Available: https://developer.microsoft.com/enus/windows/holographic/exporting_and_building_a_unity_visual_studio_solution. Accessed 28 May 2018.

  46. Dumay A, Jense G. Endoscopic surgery simulation in a virtual environment. Comput Biol Med (United States). 1995;25(2):139–48.

    Article  CAS  Google Scholar 

  47. Knuth TE, Wilson A, Oswald SG. Military training at civilian trauma centers: the first year’s experience with the regional trauma network. Mil Med (United States). 1998;163(9):608–41.

    Article  CAS  Google Scholar 

  48. Hoffman H, Vu D. Virtual reality: teaching tool of the twenty-first century. Acad Med (United States). 1997;72(12):1076–81.

    Article  CAS  Google Scholar 

  49. Jerant AF, Epperly TD, Marionneaux RD. Medical support for operation cooperative nugget ‘95’: joint readiness training in the post-cold war era. Mil Med (United States). 1997;162(11):702–5.

    Google Scholar 

  50. Pickett R. Joint readiness training center integration of live and constructive forces. I/ITSEC (CD-ROM). 1998.

    Google Scholar 

  51. McCarthy J, Johnston J, Paris C. Toward development of a tactical decision-making under stress integrated trainer. I/ITSEC (CD-ROM). 1998.

    Google Scholar 

  52. Arbor A. An immersive virtual reality platform for medical education: introduction to the medical readiness trainer. In: Proceedings of the 33rd Hawaii International Conference on System Sciences. 2000.

    Google Scholar 

  53. Takabayashi K, Fujikawa K, Suzuki T, Yamazakia S, Honda M, Amaral M, Satomura Y, Yoshida S, Tomioka H. Implementation and evaluation of computerized patient management problems. Medinfo (Canada). 1995;8(PT 2):1218–21.

    Google Scholar 

  54. Kraft S, Honebein P, Prince M, Marrero D. The SOCRATES curriculum: an innovative integration of technology and theory in medical education. J Audivo Media Med (England). 1997;20(4):166–71.

    Article  CAS  Google Scholar 

  55. Kreines M, Udal’tsovlu A, Pogromov A, Ershov V, Active AS. Computer systems for medical education: approach and implementation. Vestn Ross Akad Med Nauk (Russia). 1995;10:68–71.

    Google Scholar 

  56. Kaltenborn KF, Rienhoff O. Virtual reality in medicine. Methods Inf Med (Germany). 1992;32(5):407–17.

    Google Scholar 

  57. Larsson JE, Hayes-Roth B, Gaba DM, Smith BE. Evaluation of a medical diagnosis system using simulator test scenarios. Artif Intell Med (Netherlands). 1997;11(2):119–40.

    Article  CAS  Google Scholar 

  58. Fairén M, Farrés M, Moyés J, Insa E. Virtual reality to teach anatomy. Eurographics. 2017. Bourdin JJ, Shesh A, editors. 2017; https://doi.org/10.2312/eged.20171026.

  59. Dickey M. Brave new (interactive) worlds: a review of the design affordances and constrains of two 3d virtual worlds as interactive learning environments. Interact Learn Environ. 2005;13(1–2):121–37.

    Article  Google Scholar 

  60. Kleinginna PR, Kleinginna AM. A categorized list of emotion definitions, with suggestions for a consensual definition. Motiv Emot. 1981;5(4):345–79.

    Article  Google Scholar 

  61. Boctor L. Active-learning strategies: the use of a game to reinforce learning in nursing education. A case study. Nurse Educ Pract. 2013;13(2):96–100.

    Article  PubMed  Google Scholar 

  62. Huang H-M, Rauch U, Liaw SS. Investigating learners’ attitudes toward virtual reality learning environments: based on a constructivist approach. Comput Educ. 2010;55(3):1171–82.

    Article  Google Scholar 

  63. Nicholson DT, Chalk C, Funnell WRJ, Daniel SJ. Can virtual reality improve anatomy education? A randomised controlled study of a computer-generated three-dimensional anatomical ear model. Med Educ. 2006;40(11):1081–7.

    Article  PubMed  Google Scholar 

  64. Codd A, Choudhury B. Virtual reality anatomy: is it comparable with traditional methods in the teaching of human forearm musculoskeletal anatomy? Anat Sci Educ. 2011;4(3):119–25.

    Article  PubMed  Google Scholar 

  65. Pan Z, Cheok AD, Yang H, Zhu J, Shi J. Virtual reality and mixed reality for virtual learning environments. Comput Graph. 2006;30(1):20–8.

    Article  Google Scholar 

  66. Vaughan N, Dubey VN, Wainwright TW, Middleton RG. A review of virtual reality based training simulators for orthopaedic surgery. Med Eng Phys. 2016;38:59–71.

    Article  PubMed  Google Scholar 

  67. Aziz HA. Virtual reality programs applications in healthcare. J Health Med Informat. 2018;9:305. https://doi.org/10.4172/2157-7420.1000305.

    Article  Google Scholar 

  68. Anderson PL, Price M, Edwards SM, Obasaju MA, Schmertz SK, et al. Virtual reality exposure therapy for social anxiety disorder: a randomized controlled trial. J Consult Clin Psychol. 2013;81:751–60.

    Article  PubMed  Google Scholar 

  69. Parsons TD, Rizzo AA. Affective outcomes of virtual reality exposure therapy for anxiety and specific phobias: a meta-analysis. J Behav Ther Exp Psychiatry. 2008;39:250–61.

    Article  PubMed  Google Scholar 

  70. Weiderhold MD, Weiderhold BK. Virtual reality and interactive simulation for pain distraction. Pain Med. 2007;1:182–8.

    Article  Google Scholar 

  71. http://www.iactor.eu/downloads/WP%20The%20Potential%20for%20VR%20to%20Improve%20Healthcare.pdf.

  72. Aim F, Lonjon G, Hannouche D, Nizard R. Effectiveness of virtual reality training in orthopaedic surgery. Arthroscopy. 2016;32:224–32.

    Article  PubMed  Google Scholar 

  73. Valmaggia LR, Latif L, Kempton MJ, Ruscalafell M. Virtual reality in the psychological treatment for mental health problems: an systematic review of recent evidence. Psychiatry Res. 2016;236:189–95.

    Article  PubMed  Google Scholar 

  74. Wiederhold MD, Gao K, Wiederhold BK. Clinical use of virtual reality distraction system to reduce anxiety and pain in dental procedures. Cyberpsychol Behav Soc Netw. 2014;17:359–65.

    Article  PubMed  PubMed Central  Google Scholar 

  75. Rutter CE, Dahhlquist LM, Weiss KE. Sustained efficacy of virtual reality distraction. J Pain. 2008;10:391–7.

    Article  Google Scholar 

  76. Schneider SM, Hood LE. Virtual reality: a distraction intervention for chemotherapy. Oncol Nurs Forum. 2007;34:39–46.

    Article  PubMed  PubMed Central  Google Scholar 

  77. Broeren J, Bjorkdahl A. Virtual rehabilitation after stroke. Stud Health Technol Inform. 2008;136:77–82.

    PubMed  Google Scholar 

  78. Girard B, Turcotte V. Crushing virtual cigarettes reduces tobacco addiction and treatment discontinuation. Cyberpsychol Behav. 2009;12:477–83.

    Article  PubMed  Google Scholar 

  79. Shin HH, Kim KM. Virtual reality for cognitive rehabilitation after brain injury: a systematic review. J Phys Ther Sci. 2015;27:2999–3002.

    Article  PubMed  PubMed Central  Google Scholar 

  80. Hanna MG, Ahmed I, Nine J, Prajapati S, Pantanowitz L, et al. Virtual reality training for healthcare professionals. Cyberpsychol Behav. 2003;6:389–94.

    Article  Google Scholar 

  81. Li A, Montano Z, Chen VJ, Gold JI. Virtual reality and pain management: current trends and future directions. Pain Manag. 2011;1:147–57.

    Article  PubMed  Google Scholar 

  82. Mejiden OA, Schijven MP. The value of haptic feedback in conventional and robotic assisted minimal invasive surgery and virtual reality training: a current review. Surg Endosc. 2009;23:1180–90.

    Article  Google Scholar 

  83. Ojha U, Mohammed R, Vivekanantham S. Should there be greater exposure to interventional radiology in the undergraduate curriculum? Adv Med Educ Pract. 2017;8:791–5.

    Article  PubMed  PubMed Central  Google Scholar 

  84. Pourmand A, Davis S, Lee D, Barber S, Sikka N. Emerging utility of virtual reality as a multidisciplinary tool in clinical medicine. Games Health J. 2017;6:263–70.

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

El Miedany, Y. (2019). Virtual Reality and Augmented Reality. In: Rheumatology Teaching. Springer, Cham. https://doi.org/10.1007/978-3-319-98213-7_20

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-98213-7_20

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-98212-0

  • Online ISBN: 978-3-319-98213-7

  • eBook Packages: MedicineMedicine (R0)

Publish with us

Policies and ethics