Discriminative validity of the Minimally Invasive Surgical Trainer in Virtual Reality (MIST-VR) using criteria levels based on expert performance

  • A. G. Gallagher
  • A. B. Lederman
  • K. McGlade
  • R. M. Satava
  • C. D. Smith
Original article

Abstract

Background: Increasing constraints on the time and resources needed to train surgeons have led to a new emphasis on finding innovative ways to teach surgical skills outside the operating room. Virtual reality training has been proposed as a method to both instruct surgical students and evaluate the psychomotor components of minimally invasive surgery ex vivo. Methods: The performance of 100 laparoscopic novices was compared to that of 12 experienced (>50 minimally invasive procedures) and 12 inexperienced (<10 minimally invasive procedures) laparoscopic surgeons. The values of the experienced surgeons’ performance were used as benchmark comparators (or criterion measures). Each subject completed six tasks on the Minimally Invasive Surgical Trainer—Virtual Reality (MIST-VR) three times. The outcome measures were time to complete the task, number of errors, economy of instrument movement, and economy of diathermy. Results: After three trials, the mean performance of the medical students approached that of the experienced surgeons. However, 7–27% of the scores of the students fell more than two SD below the mean scores of the experienced surgeons (the criterion level). Conclusions: The MIST-VR system is capable of evaluating the psychomotor skills necessary in laparoscopic surgery and discriminating between experts and novices. Furthermore, although some novices improved their skills quickly, a subset had difficulty acquiring the psychomotor skills. The MIST-VR may be useful in identifying that subset of novices.

Keywords

Minimal access surgery Task performance Psychomotor skills Surgical simulator Minimally Invasive Surgical Trainer—Virtual Reality (MIST-VR) 

References

  1. 1.
    Chaudhry, A, Sutton, C, Wood, J, Stone, R, McCloy, R 1999Learning rate for laparoscopic surgical skills on MIST-VR, a virtual reality simulator: quality of human–computer interface.Ann R Coll Surg Engl81281286Google Scholar
  2. 2.
    Chiasson, PM, Pace, DE, Schlacta, CM, Mamazza, J, Poulin, EC 2002MIS training in Canada: a survey of general surgery residents.Surg Endosc16S202CrossRefGoogle Scholar
  3. 3.
    Crothers, IR, Gallagher, AG, McClure, N, James, DT, McGuigan, J 1999Experienced laparoscopic surgeons are automated to the “fulcrum effect”: an ergonomic demonstration.Endoscopy31365369CrossRefPubMedGoogle Scholar
  4. 4.
    Cuschieri, A 1995Whither minimal access surgery: tribulations and expectations.Am J Surg169919CrossRefPubMedGoogle Scholar
  5. 5.
    Gallagher, AG, Satava, RM 2002Virtual reality as a metric for the assessment of laparoscopic psychomotor skills: learning curves and reliability measures.Surg Endosc1617461752PubMedGoogle Scholar
  6. 6.
    Gallagher, AG, McClure, N, McGuigan, J, Ritchie, K, Sheehy, NP 1998An ergonomic analysis of the fulcrum effect in the acquisition of endoscopic skills.Endoscopy30617620PubMedGoogle Scholar
  7. 7.
    Gallagher, AG, McClure, N, McGuigan, J, Crothers, I, Browning, J 1999Virtual reality training in laparoscopic surgery: a preliminary assessment of minimally invasive surgical trainer virtual reality (MIST-VR).Endoscopy31310313CrossRefPubMedGoogle Scholar
  8. 8.
    Gallagher, AG, Richie, K, McClure, N, McGuigan, J 2001Objective psychomotor skills assessment of experienced, junior, and novice laparoscopists with virtual reality.World J Surg2514781483PubMedGoogle Scholar
  9. 9.
    Hunter, JG 2002The case for fellowship in gastrointestinal and laparoendoscopic surgery.Surgery132523525PubMedGoogle Scholar
  10. 10.
    Jordan, JA, Gallagher, AG, McGuigan, J, McClure, N 2000Randomly alternating image presentation during laparoscopic training leads to faster automation to the “fulcrum effect.Endoscopy32317321CrossRefPubMedGoogle Scholar
  11. 11.
    Jordan, JA, Gallagher, AG, McGuigan, J, McGlade, K, McClure, N 2000A comparison between randomly alternating imaging, normal laparoscopic imaging, and virtual reality training in laparoscopic psychomotor skill acquisition.Am J Surg180208211PubMedGoogle Scholar
  12. 12.
    Jordan, JA, Gallagher, AG, McGuigan, J, McClure, N 2001Virtual reality training leads to faster adaptation to the novel psychomotor restrictions encountered by laparoscopic surgeons.Surg Endosc1510801084PubMedGoogle Scholar
  13. 13.
    McNatt, SS, Smith, CD 2001A computer-based laparoscopic skills assessment device differentiates experienced from novice laparoscopic surgeons.Surg Endos1510851089Google Scholar
  14. 14.
    Ota, D, Loftin, B, Saito, T, Lea, R, Keller, J 1995Virtual reality in surgical education.Comput Biol Med25127137Google Scholar
  15. 15.
    Satava, RM 1993Virtual reality surgical simulator: the first steps.Surg Endos7203205PubMedGoogle Scholar
  16. 16.
    Seymour, NE, Gallagher, AG, Roman, SA, O’Brien, MK, Bansal, VK, Andersen, DK, Satava, RM 2002Virtual reality training improves operating room performance: results of a randomized, double-blinded study.Ann Surg236458463discussion 463–464CrossRefPubMedGoogle Scholar
  17. 17.
    Smith, CD, Farrell, TM, McNatt, SS, Metreveli, RE 2001Assessing laparoscopi manipulative skills.Am J Surg181547550CrossRefPubMedGoogle Scholar
  18. 18.
    Surgery Residency Review Committee (2001–2) Surgery resident statistics summary. American Council on Graduate Medical Education, Chicago , ILGoogle Scholar
  19. 19.
    Torkington, J, Smith, SG, Rees, BI, Darzi, A 2001Skill transfer from virtual reality to a real laparoscopic task.Surg Endosc1510761079PubMedGoogle Scholar

Copyright information

© Springer-Verlag 2004

Authors and Affiliations

  • A. G. Gallagher
    • 1
  • A. B. Lederman
    • 1
  • K. McGlade
    • 2
  • R. M. Satava
    • 3
  • C. D. Smith
    • 1
  1. 1.Emory Endosurgery UnitEmory University School of Medicine, 1364 Clifton Road, NE, Atlanta, GA 30322USA
  2. 2.Department of General Practice, Queen’s University, Dunluce Health Centre, 1 Dunluce Avenue, Belfast BT9 7HRIreland
  3. 3.Department of Surgery, University of Washington Medical Center, BB430, Box 356410, 1959 NE Pacific Street, Seattle, WA 98195-6410USA

Personalised recommendations