Objective psychomotor skills assessment of experienced and novice flexible endoscopists with a virtual reality simulator
The objective of this study was to determine whether the GI Mentor II virtual reality simulator can distinguish the psychomotor skills of intermediately experienced endoscopists from those of novices, and do so with a high level of consistency and reliability. A total of five intermediate and nine novice endoscopists were evaluated using the EndoBubble abstract psychomotor task. Each subject performed three repetitions of the task. Performance and error data were recorded for each trial. The intermediate group performed better than the novice group in each trial. The differences were significant in trial 1 for balloons popped (P = .001), completion time (P = .04), and errors (P = .03). Trial 2 showed significance only for balloons popped (P = .002). Trial 3 showed significance for balloons popped (P = .004) and errors (P = .008). The novice group showed significant improvement between trials 1 and 3 (P < 0.05). No improvement was noted in the intermediate group. Measures of consistency and reliability were greater than 0.8 in both groups with the exception of novice completion time where test-retest reliability was 0.74. The GI Mentor II simulator can distinguish between novice and intermediate endoscopists. The simulator assesses skills with levels of consistency and reliability required for high-stakes assessment.
Key wordsEndoscopy computer simulation educational measurement validation studies
Unable to display preview. Download preview PDF.
- 1.Schirmer B. Flexible Endoscopy: It’s a Big Part of Practice. SAGES Scope, vol 3, 2003, p 16.Google Scholar
- 2.Booklet of Information. American Board of Surgery. Philadelphia, July 2002-June 2003, pp 10–11.Google Scholar
- 3.Resident Statistics Summary, Report C. Residency Review Committee for Surgery 2001–2002.Google Scholar
- 5.Principles of Training in Gastrointestinal Endoscopy. Manchester, MA American Society for Gastrointestinal Endoscopy, 1999, pp 1–12.Google Scholar
- 11.Kohn L, Corrigan J, Donaldson M. To Err Is Human: Building a Safer Health System. Committee on Quality of Health Care in America, Institute of Medicine. Washington, DC: The National Academy Press, 2000.Google Scholar