Skip to main content
SpringerLink
Log in

Validity and reliability of a virtual reality upper gastrointestinal simulator and cross validation using structured assessment of individual performance with video playback

  • Original article
  • Published:
Surgical Endoscopy And Other Interventional Techniques Aims and scope Submit manuscript

Abstract

Background: This study aims to evaluate the ability of an upper gastrointestinal virtual reality simulator to assess skills in endoscopy, and to validate its metrics using a video-endoscopic (VES) technique. Methods: The 32 participants in this study were requested to undertake two cases on the simulator (Simbionix, Israel). Each module was repeated twice. The simulator’s metrics of performance were used for analysis. Two blinded observers rated performance watching the simulator’s playback feature. Results: There were 11 novices (group 1), 11 trainees with intermediate experience (10–50 procedures, group 2), and 10 experienced endoscopists (>200 procedures, group 3). There was a significant difference in the total time required to perform the procedure (p < 0.001), percentage of mucosa visualized (p < 0.001), percentage of pathologies visualized (p < 0.001), and number of inappropriate retroflexions (p = 0.015) across the three groups. The reliability of assessment on the simulator was greater than 0.80 for all parameters. The VES assessment also was able to discriminate performance across the groups (p < 0.001). There was a significant correlation between the VES score and the percentage of mucosa visualized (rho = 0.60; p < 0.001). Conclusions: The upper gastrointestinal simulator may be a useful tool for determining whether a trainee has achieved a desired level of competence in endoscopy. The next step will be to validate the VES score in real procedures.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Figure 1
Figure 2
Figure 3
Figure 4

Similar content being viewed by others

References

  1. HG Colt SW Crawford O Galbraith (2001) ArticleTitleVirtual reality bronchoscope simulation: a revolution in procedural training. Chest 120 1333–1339 Occurrence Handle1:STN:280:DC%2BD3MrksVeqtQ%3D%3D Occurrence Handle11591579

    CAS  PubMed  Google Scholar 

  2. A Cuschieri N Francis J Crosby GB Hanna (2001) ArticleTitleWhat do master surgeons think of surgical competence and revalidation. Am J Surg 182 110–116 Occurrence Handle10.1016/S0002-9610(01)00667-5 Occurrence Handle1:STN:280:DC%2BD3Mrisl2jug%3D%3D Occurrence Handle11574079

    Article  CAS  PubMed  Google Scholar 

  3. V Datta S Mackay M Mandalia A Darzi (2001) ArticleTitleThe use of electromagnetic motion tracking analysis to objectively measure open surgical skill in the laboratory-based model. J Am Coll Surg 193 479–485 Occurrence Handle10.1016/S1072-7515(01)01041-9 Occurrence Handle1:STN:280:DC%2BD3Mnmtlanug%3D%3D Occurrence Handle11708503

    Article  CAS  PubMed  Google Scholar 

  4. V Datta M Mandalia S Mackay A Darzi (2002) ArticleTitleThe Pre-Op flexible sigmoidoscopy trainer: validation and early evaluation of a virtual reality based system. Surg Endosc 16 1459–1463 Occurrence Handle10.1007/s00464-002-9014-4 Occurrence Handle1:STN:280:DC%2BD38nktlWmtA%3D%3D Occurrence Handle12042913

    Article  CAS  PubMed  Google Scholar 

  5. PJ Driscoll AM Paisley S Paterson-Brown (2001) ArticleTitleSleep deprivation and simulation: realistic and valid? Rapid response. BMJ.com Dec 3 2001 .

    Google Scholar 

  6. A Ferlitsch P Glauninger A Gupper et al. (2002) ArticleTitleEvaluation of a virtual reality endoscopy simulator for training in gastrointestinal endoscopy. Endoscopy 34 698–702 Occurrence Handle10.1055/s-2002-33456 Occurrence Handle1:STN:280:DC%2BD38vjslaqtw%3D%3D Occurrence Handle12195326

    Article  CAS  PubMed  Google Scholar 

  7. PS Jowell J Baillie MS Branch J Affronti CL Browning BP Bute (1996) ArticleTitleQuantitative assessment of procedural competence: a prospective study of training in endoscopic retrograde cholangiopancreatography. Ann Intern Med 125 983–998 Occurrence Handle1:STN:280:ByiD1MzltlM%3D Occurrence Handle8967710

    CAS  PubMed  Google Scholar 

  8. K Moorthy S Smith T Brown S Bann A Darzi (.) ArticleTitleThe evaluation of a virtual reality bronchoscopy as a learning and assessment tool. . . .

    Google Scholar 

  9. M Neumann S Firedl A Meining et al. (2002) ArticleTitleA score card for upper GI endoscopy: evaluation of interobserver variability in examiners with various levels of experience. Z Gastroenterol 40 857–862 Occurrence Handle10.1055/s-2002-35258 Occurrence Handle1:STN:280:DC%2BD38nnsF2jtg%3D%3D Occurrence Handle12436351

    Article  CAS  PubMed  Google Scholar 

  10. D Ost A DeRosiers JE Britt AM Fein ML Lesser AC Mehta (2001) ArticleTitleAssessment of a bronchoscopy simulator. Am J Respir Crit Care Med 164 2248–2255 Occurrence Handle1:STN:280:DC%2BD38%2FlvFehtg%3D%3D Occurrence Handle11751195

    CAS  PubMed  Google Scholar 

  11. R Reznick G Regehr H MacRae J Martin W McCulloch (1996) ArticleTitleTesting technical skills via an innovative “bench station” examination. Am J Surg 172 226–230

    Google Scholar 

  12. RE Sedlack JC Kolars (2002) ArticleTitleColonoscopy curriculum development and performance-based assessment criteria on a computer-based endoscopy simulator. Acad Med 77 750–751

    Google Scholar 

  13. PS Tassios SD Ladas I Grammenos K Demertzis SA Raptis (1999) ArticleTitleAcquisition of competence in colonoscopy: the learning curve of trainees. Endoscopy 31 702–706 Occurrence Handle10.1055/s-1999-146 Occurrence Handle1:STN:280:DC%2BD3c%2FmvVWisg%3D%3D Occurrence Handle10604610

    Article  CAS  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Surgical Oncology and Technology, Imperial College of Science, Technology and Medicine, 10th Floor, QEQM Building, St. Mary’s Hospital, Praed Street, London, W2 1NY, United Kingdom

    K. Moorthy, Y. Munz, M. Jiwanji, S. Bann, A. Chang & A. Darzi

Authors
  1. K. Moorthy
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Y. Munz
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. M. Jiwanji
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. S. Bann
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. A. Chang
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. A. Darzi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to K. Moorthy.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Moorthy, K., Munz, Y., Jiwanji, M. et al. Validity and reliability of a virtual reality upper gastrointestinal simulator and cross validation using structured assessment of individual performance with video playback . Surg Endosc 18, 328–333 (2004). https://doi.org/10.1007/s00464-003-8513-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00464-003-8513-2

keywords

Search

Navigation