Skip to main content

An Overview of Virtual Simulation and Serious Gaming for Surgical Education and Training

  • Chapter
  • First Online:
Technologies of Inclusive Well-Being

Part of the book series: Studies in Computational Intelligence ((SCI,volume 536))

Abstract

The rising popularity of video games has seen a recent push towards the application of serious games to medical education and training. With their ability to engage players/learners for a specific purpose, serious games provide an opportunity to acquire cognitive and technical surgical skills outside the operating room thereby optimizing operating room exposure with live patients. However, before the application of serious games for surgical education and training becomes more widespread, there are a number of open questions and issues that must be addressed including the relationship between fidelity, multi-modal cue interaction, immersion, and knowledge transfer and retention. In this chapter we begin with a brief overview of alternative medical/surgical educational methods, followed by a discussion of serious games and their application to surgical education, fidelity, multi-modal cue interaction and their role within a virtual simulations/serious games. The chapter ends with a description of the serious games surgical cognitive education and training framework (SCETF) and concluding remarks.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Halsted, W.S.: The training of the surgeon. Johns Hopkins Hosp. Bull. 15(162), 267–275 (1904)

    Google Scholar 

  2. Reznick, R.K.: Teaching and testing technical skills. Am. J. Surg. 165(3), 358–361 (1993)

    Article  Google Scholar 

  3. Lavernia, C.J., Sierra, R.J., Hernandez, R.A.: The cost of teaching total knee arthroplasty surgery to orthopaedic surgery residents. Clin. Orthop. Relat. Res. 380, 99–107 (2000)

    Article  Google Scholar 

  4. Zuckerman, J., Kubiak, E., Immerman, I., DiCesare, P.: The early effects of code 405 work rules on the attitudes of orthopaedic residents and attending surgeons. J. Bone Joint Surg. 87(A(4)), 903–908 (2005)

    Article  Google Scholar 

  5. Weatherby, B.A., Rudd, J.N., Ervin, T.B., Staff, P.R.: The effect of resident work hour regulations on orthopaedic surgical education. J. Surg. Orthop. Adv. 16(1), 19–22 (2007)

    Google Scholar 

  6. Ericsson, K.A., Krampe, R., Tesch-Romer, C.: The role of deliberate practice in the acquisition of expert performance. Psychol. Rev. 100(3), 363–406 (1993)

    Article  Google Scholar 

  7. Halm, E.A., Lee, C., Chassin, M.R.: Is volume related to outcome in healthcare? A systematic review and methodological critique of the literature. Ann. Intern. Med. 137(6), 511–520 (2002)

    Article  Google Scholar 

  8. Gorman, P.J., Meier, A.H., Rawn, C., Krummel, T.M.: The future of medical education is no longer blood and guts, it is bits and bytes. Am. J. Surg. 180(5), 353–356 (2000)

    Article  Google Scholar 

  9. Murphy, J.G., Torsherand, L.C., Dunn, W.F.: Simulation medicine in intensive care and coronary care education. J. Crit. Care 22(1), 51–55 (2007)

    Article  Google Scholar 

  10. Sonnadara, R.R., Garbedian, S., Safir, O., Nousiainen, M., Alman, B., Ferguson, P., Kraemer, W., Reznick, R.: Orthopaedic boot camp ii: examining the retention rates of an intensive surgical skills course. Surgery 151(6), 803–807 (2012)

    Article  Google Scholar 

  11. Heng, P.A., Cheng, C.Y., Wong, T.T., Xu, Y., Chui, Y.P., Tso, S.K.: A virtual reality training system for knee arthroscopic surgery. IEEE Trans. Inf. Technol. Biomed. 8(2), 217–227 (2004)

    Article  Google Scholar 

  12. Riener, R., Harders, M.: Psychology Applied to Work. Springer, London (2012)

    Google Scholar 

  13. Meyerson, S.L., LoCascio, F., Baldersonand, S.S., D’Amico, T.A.: An inexpensive, reproducible tissue simulator for teaching thoracoscopic lobectomy. Ann. Thorac. Surg. 89(2), 594–597 (2010)

    Article  Google Scholar 

  14. Bridges, M., Diamond, D.L.: The financial impact of teaching surgical residents in the operating room. Am. J. Surg. 177(1), 28–32 (1999)

    Article  Google Scholar 

  15. Smith, R.: Game Technology in Medical Education: An Inquiry into the Effectiveness of New Tools. Modelbenders LLC, USA (2009)

    Google Scholar 

  16. Ziv, A., Ben-David, S., Ziv, M.: Simulation based medical education: an opportunity to learn from errors. Med. Teach. 27(3), 193–199 (2005)

    Article  Google Scholar 

  17. Susi, T., Johannesson, M., Backlund, P.: Serious games—an overview. Technical Report HS-IKI-TR-07-001, School of Humanities and Informatics, University of Skovde, Sweden, Feb 2007

    Google Scholar 

  18. Stapleton, A.J.: Serious games: serious opportunities. In: Proceedings of the 2004 Australian Game Developers’ Conference, pp. 1–6. Melbourne (2004)

    Google Scholar 

  19. Becker, K., Parker, J.: The Guide to Computer Simulations and Games. Wiley, Indianapolis (2012)

    Google Scholar 

  20. Thiagarajan, S., Stolovitch, H.D.: Instructional Simulation Games. Educational Technology Publications, Englewood Cliffs (1978)

    Google Scholar 

  21. Tashiro, J., Dunlap, D.: The impact of realism on learning engagement in educational games. In: Proceedings of ACM Future Play 2007, pp. 113–120. Toronto (2007)

    Google Scholar 

  22. Farmer, E., von Rooij, J., Riemersma, J., Joma, P., Morall, J.: Handbook of Simulator Based Training. Ashgate Publishing Limited, Surrey, UK (1999)

    Google Scholar 

  23. Hays, R.T., Singer, M.: Simulation Fidelity in Training System Design. Springer, New York (1989)

    Book  Google Scholar 

  24. Ker, J., Bradley, P.: Simulation in medical education. In: Swanwick, T. (ed.) Understanding Medical Education: Evidence, Theory and Practice, pp. 164–180. Wiley, New York (2010)

    Chapter  Google Scholar 

  25. Rehmannand, A.J., Mitman, R.D., Reynolds, M.C.: A handbook of flight simulation fidelity requirements of human factors research. Technical report, Crew System Ergonomics Information Analysis Center, Wright-Patterson Air Force Base, Dayton, 1995

    Google Scholar 

  26. Muchinsky, P.M.: Psychology Applied, to Work. Wadsworth (1999)

    Google Scholar 

  27. Brown, J.S., Collins, A., Duguid, S.: Situated cognition and the culture of learning. Educ. Researcher 18(1), 32–42 (1989)

    Article  Google Scholar 

  28. Dalgarno, B., Lee, M.J.W.: What are the learning affordances of 3-D virtual environments? Br. J. Educ. Technol. 41(1), 10–32 (2010)

    Article  Google Scholar 

  29. Hulusic, V., Aranh, M., Chalmers, A.: The influence of cross-modal interaction on perceived rendering quality thresholds. In: Proceedings of the 16th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision, pp. 41–48. Plzen–Bory, Czech Republic, 4–7 Feb 2008

    Google Scholar 

  30. Blascovich, J., Bailenson, J.: Infinite Reality. Harper Collins, New York (2011)

    Google Scholar 

  31. Cook, D.A., Hamstra, S.J., Brydges, R., Zendejas, B., Szostek, J.H., Wang, A.T., Erwin, P.J., Hatala, R.: Comparative effectiveness of instructional design features in simulation-based education: systematic review and meta-analysis. Med. Teach. 35(1), e867–e898 (2013)

    Article  Google Scholar 

  32. Kneebone, R.L.: Practice, rehearsal, and performance: an approach for simulation-based surgical and procedure training. J. Am. Med. Assoc. 302(12), 1336–1338 (2009)

    Google Scholar 

  33. Ziv, A., Wolpe, P.R., Small, S.D., Glick, S.: Simulation-based medical education: an ethical imperative. Acad. Med. 78(8), 19–22 (2003)

    Article  Google Scholar 

  34. Raths, D.: Virtual reality in the OR. Training Dev. Mag. 6(8), 36–40 (2006)

    Google Scholar 

  35. Gallagher, A., Ritter, M., Champion, H., Higgins, G., Fried, M., Moses, G., Smith, D., Satava, R.: Virtual reality simulation for the operating room, proficiency-based training as a paradigm shift in surgical skills training. Ann. Surg. 241(2), 364–372 (2005)

    Article  Google Scholar 

  36. Kohls-Gatzoulis, J.A., Regehr, G., Hutchison, C.: Teaching cognitive skills improves learning in surgical skills courses: a blinded, prospective, randomized study. Can. J. Surg. 47(4), 277–283 (2004)

    Google Scholar 

  37. Hull, L., Arora, S., Aggarwal, R., Darzi, A., Vincent, C., Sevdalis, N.: The impact of nontechnical skills on technical performance in surgery: a systematic review. J. Am. Coll. Surg. 214(4), 214–230 (2012)

    Article  Google Scholar 

  38. Fitts, P.M., Posner, M.I.: Human Performance. Brooks and Cole, Oxford, England (1967)

    Google Scholar 

  39. Rosser Jr, J.C., Lynch, P.J., Haskamp, L.A., Gentile, D.A., Yalif, A.: The impact of video games in surgical training. Arch. Surg. 142(2), 181–186 (2007)

    Article  Google Scholar 

  40. CBS News. Video gamers make good surgeons. http://www.cbsnews.com/2100-204_162-610601.htm/. 9 Feb 2009

  41. Seitz, A.R., van Wassenhove, V., Shams, L.: Simultaneous and independent acquisition of multisensory and unisensory associations. Perception 36(10), 1445–1453 (2007)

    Article  Google Scholar 

  42. Carlile, S.: Virtual Auditory Space: Generation and Application. R.G. Landes, Austin TX, USA (1996)

    Book  Google Scholar 

  43. Mastoropoulou, G., Debattista, K., Chalmers, A., Troscianco, T.: The influence of sound effects on the perceived smoothness of rendered animations. In: Proceedings of the Symposium on Applied Perception in Graphics and Visualization 2005, pp. 9–15. La Coruna, Spain, 26–28 Aug 2005

    Google Scholar 

  44. Bonneel, N., Suied, C., Viaud-Delmon, I., Drettakis, G.: Bimodal perception of audio-visual material properties for virtual environments. ACM Trans. Appl. Percept. 7(1), 1–16 (2010)

    Article  Google Scholar 

  45. Angel, E.: Interactive Computer Graphics: A Top-Down Approach Using OpenGL. TPearson Education Inc., Boston (2008)

    Google Scholar 

  46. Hulusic, V., Debattista, K., Aggarwal, V., Chalmers, A.: Maintaining frame rate perception in interactive environments by exploiting audio-visual cross-modal interaction. Vis. Comput. 27(1), 57–66 (2011)

    Article  Google Scholar 

  47. Hulusic, V., Harvey, C., Debattista, K., Tsingos, N., Walker, S., Howard, D., Chalmers, A.: Acoustic rendering and auditory-visual cross-modal perception and interaction. Comput. Graph. Forum 31(1), 102–131 (2012)

    Article  Google Scholar 

  48. Shams, L., Kim, R.: Crossmodal influences on visual perception. Phys. Life Rev. 7(3), 295–298 (2010)

    Article  Google Scholar 

  49. Sabri, H., Cowan, B., Kapralos, B., Moussa, F., Cristancho, S., Dubrowski, A.: Off- pump coronary artery bypass surgery procedure training meets serious games. In: Proceedings of the International Symposium on Haptic Audio-Visual Environments and Games, pp. 123–127. Phoenix, 16–17 Oct 2010

    Google Scholar 

  50. Fann, J.I., Caffarelli, A.D., Georgette, G., Howard, S.K., Gaba, D.M., Young-blood, P., Mitchell, R.S., Burdon, T.A.: Improvement in coronary anastomosis with cardiac surgery simulation. J. Thorac. Cardiovasc. Surg. 136(6), 1486–1491 (2008)

    Article  Google Scholar 

  51. Hogue, A., Kapralosand, B., Zerebeckiand, C., Tawadrous, M., Stanfield, B., Hogue, U.: Stereoscopic 3d video games and their effects on engagement. In: Proceedings of the Stereoscopic Displays and Applications XXIII, pp. 828816–828816-7. Burlingame, CA, 23–25 Jan 2012

    Google Scholar 

  52. UCSF.: Medical education: Potential contributions of stereoscopic 3D. School of Medicine, Office of Educational Technology, University of California San Francisco (2013)

    Google Scholar 

  53. Hollander, A., Roseand, H., Kollin, J., Moss, W.: Attack of the s. Mutans!: a stereoscopic-3d multiplayer direct-manipulation behavior-modification serious game for improving oral health in pre-teens. In: Proceedings of the Stereoscopic Displays and Applications XXIII, pp. 828816–828816-7. Burlingame, CA, 23–25 Jan 2012

    Google Scholar 

  54. Kapralos, B., Jenkin, M., Milio, E.: Virtual audio systems. Presence: Teleoperators Virtual Env. 17(6), 527–549 (2008)

    Article  Google Scholar 

  55. Bonneel, N., Suied, C., Viaud-Delmon, I., Drettakis, G.: Inter-active sound propagation using compact acoustic transfer operators. ACM Trans. Graph. 31, 7 (2012)

    Google Scholar 

  56. Nordahl, R., Turchet, L., Serafin, S.: Sound synthesis and evaluation of interactive footsteps and environmental sounds rendering for virtual reality applications. IEEE Trans. Visualizations Comput. Graph. 17(1), 1234–1244 (2011)

    Article  Google Scholar 

  57. Zhou, Z.Y., Cheok, A.D., Qiu, Y., Yang, X.: The role of 3-d sound in human reaction and performance in augmented reality environments. IEEE Trans. Syst. Man Cybern.—Part A: Syst. Hum. 37, 262–272 (2007)

    Article  Google Scholar 

  58. Makino, H., Ishii, I., Nakashizuka, M.: Development of navigation system for the blind using GPS and mobile phone communication. In: 18th Annual Meeting of the IEEE Engineering in Medicine and Biology Society, pp. 506–507. Amsterdam, the Netherlands, 31 Oct–3 Nov 2005

    Google Scholar 

  59. Kramer, G., Walker, B., Bonebright, T., Cook, P., Flowers, J.H., Miner, N., Neuhoff, J.: Sonification Report: Status of the Field and Research Agenda. Technical report, Department of Psychology, University of Nebraska—Lincoln, Lincoln (2010)

    Google Scholar 

  60. Cowan, B., Kapralos, B.: A gpu-based method to approximate acoustical reflectivity. J. Graph. GPU Game Tools 15(4), 210–215 (2011)

    Article  Google Scholar 

  61. Cowan, B., Kapralos, B.: Gpu-based real-time acoustical occlusion modeling. Virtual Reality 14(3), 183–196 (2010)

    Article  Google Scholar 

  62. Cowan, B., Kapralos, B.: Gpu-based one-dimensional convolution for real-time spatial sound generation. Loading Feature Issue: FuturePlay 2008 Ed. 3(9) (2009)

    Google Scholar 

  63. Iuppa, N., Borst, T.: End-to-End Game Development: Creating Independent Serious Games and Simulations from Start to Finish. Focal Proess, Oxford (2010)

    Google Scholar 

Download references

Acknowledgments

The financial support of the Social Sciences and Humanities Research Council of Canada (SSHRC), in support of the iMMERSE project, and the Canadian Network of Centres of Excellence (NCE) in support of the Graphics, Animation, and New Media (GRAND) initiative is gratefully acknowledged.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Bill Kapralos .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Kapralos, B., Moussa, F., Dubrowski, A. (2014). An Overview of Virtual Simulation and Serious Gaming for Surgical Education and Training. In: Brooks, A., Brahnam, S., Jain, L. (eds) Technologies of Inclusive Well-Being. Studies in Computational Intelligence, vol 536. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-45432-5_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-45432-5_14

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-45431-8

  • Online ISBN: 978-3-642-45432-5

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics