Surgical Endoscopy

, Volume 26, Issue 9, pp 2587–2593

The virtual reality simulator dV-Trainer® is a valid assessment tool for robotic surgical skills

  • Cyril Perrenot
  • Manuela Perez
  • Nguyen Tran
  • Jean-Philippe Jehl
  • Jacques Felblinger
  • Laurent Bresler
  • Jacques Hubert
Article

Abstract

Background

Exponential development of minimally invasive techniques, such as robotic-assisted devices, raises the question of how to assess robotic surgery skills. Early development of virtual simulators has provided efficient tools for laparoscopic skills certification based on objective scoring, high availability, and lower cost. However, similar evaluation is lacking for robotic training. The purpose of this study was to assess several criteria, such as reliability, face, content, construct, and concurrent validity of a new virtual robotic surgery simulator.

Methods

This prospective study was conducted from December 2009 to April 2010 using three simulators dV-Trainers® (MIMIC Technologies®) and one Da Vinci S® (Intuitive Surgical®). Seventy-five subjects, divided into five groups according to their initial surgical training, were evaluated based on five representative exercises of robotic specific skills: 3D perception, clutching, visual force feedback, EndoWrist® manipulation, and camera control. Analysis was extracted from (1) questionnaires (realism and interest), (2) automatically generated data from simulators, and (3) subjective scoring by two experts of depersonalized videos of similar exercises with robot.

Results

Face and content validity were generally considered high (77 %). Five levels of ability were clearly identified by the simulator (ANOVA; p = 0.0024). There was a strong correlation between automatic data from dV-Trainer and subjective evaluation with robot (r = 0.822). Reliability of scoring was high (r = 0.851). The most relevant criteria were time and economy of motion. The most relevant exercises were Pick and Place and Ring and Rail.

Conclusions

The dV-Trainer® simulator proves to be a valid tool to assess basic skills of robotic surgery.

Keywords

dV-Trainer Surgical education Da Vinci robot Reliability and validity Robotic surgery Simulation 

References

  1. 1.
    Amodeo A, Linares Quevedo A, Joseph JV, Belgrano E, Patel HRH (2009) Robotic laparoscopic surgery: cost and training. Minerva Urol Nefrol 61(2):121–128PubMedGoogle Scholar
  2. 2.
    Callery MP, Strasberg SM, Soper NJ (1996) Complications of laparoscopic general surgery. Gastrointest Endosc Clin N Am 6(2):423–444PubMedGoogle Scholar
  3. 3.
    Bruynzeel H, de Bruin AF, Bonjer HJ, Lange JF, Hop WC, Ayodeji ID, Kazemier G (2007) Desktop simulator: key to universal training? Surg Endosc 21(9):1637–1640PubMedCrossRefGoogle Scholar
  4. 4.
    Van Dongen KW, Tournoij E, van der Zee DC, Schijven MP, Broeders IA (2007) Construct validity of the LapSim: can the LapSim virtual reality simulator distinguish between novices and experts? Surg Endosc 21(8):1413–1417PubMedCrossRefGoogle Scholar
  5. 5.
    Kroeze SGC, Mayer EK, Chopra S, Aggarwal R, Darzi A, Patel A (2009) Assessment of laparoscopic suturing skills of urology residents: a pan-European study. Eur Urol 56(5):865–873PubMedCrossRefGoogle Scholar
  6. 6.
    Fried GM (2008) FLS assessment of competency using simulated laparoscopic tasks. J Gastrointest Surg 12(2):210–212PubMedCrossRefGoogle Scholar
  7. 7.
    Xeroulis G, Dubrowski A, Leslie K (2009) Simulation in laparoscopic surgery: a concurrent validity study for FLS. Surg Endosc 23(1):161–165PubMedCrossRefGoogle Scholar
  8. 8.
    Sroka G, Feldman LS, Vassiliou MC, Kaneva PA, Fayez R, Fried GM (2010) Fundamentals of laparoscopic surgery simulator training to proficiency improves laparoscopic performance in the operating room-a randomized controlled trial. Am J Surg 199(1):115–120PubMedCrossRefGoogle Scholar
  9. 9.
    Feldman LS, Sherman V, Fried GM (2004) Using simulators to assess laparoscopic competence: ready for widespread use? Surgery 135(1):28–42PubMedCrossRefGoogle Scholar
  10. 10.
    Sweet RM, Hananel D, Lawrenz F (2010) A unified approach to validation, reliability, and education study design for surgical technical skills training. Arch Surg 145(2):197–201PubMedCrossRefGoogle Scholar
  11. 11.
    Van Nortwick SS, Lendvay TS, Jensen AR, Wright AS, Horvath KD, Kim S (2010) Methodologies for establishing validity in surgical simulation studies. Surgery 147(5):622–630PubMedCrossRefGoogle Scholar
  12. 12.
    Chipman JG, Schmitz CC (2009) Using objective structured assessment of technical skills to evaluate a basic skills simulation curriculum for first-year surgical residents. J Am Coll Surg 209(3):364–370PubMedCrossRefGoogle Scholar
  13. 13.
    Hogle NJ, Briggs WM, Fowler DL (2007) Documenting a learning curve and test-retest reliability of two tasks on a virtual reality training simulator in laparoscopic surgery. J Surg Educ 64(6):424–430PubMedCrossRefGoogle Scholar
  14. 14.
    Gallagher AG, Ritter EM, Satava RM (2003) Fundamental principles of validation, and reliability: rigorous science for the assessment of surgical education and training. Surg Endosc 17(10):1525–1529PubMedCrossRefGoogle Scholar
  15. 15.
    Kenney PA, Wszolek MF, Gould JJ, Libertino JA, Moinzadeh A (2009) Face, content, and construct validity of dV-Trainer: a novel virtual reality simulator for robotic surgery. Urology 73(6):1288–1292PubMedCrossRefGoogle Scholar
  16. 16.
    Sethi AS, Peine WJ, Mohammadi Y, Sundaram CP (2009) Validation of a novel virtual reality robotic simulator. J Endourol 23(3):503–508PubMedCrossRefGoogle Scholar
  17. 17.
    Lendvay TS, Casale P, Sweet R, Peters C (2008) VR robotic surgery: randomized blinded study of the dV-Trainer robotic simulator. Stud Health Technol Inform 132:242–244PubMedGoogle Scholar
  18. 18.
    Lerner MA, Ayalew M, Peine WJ, Sundaram CP (2010) Does training on a virtual reality robotic simulator improve performance on the da Vinci surgical system? J Endourol 24(3):467–472PubMedCrossRefGoogle Scholar
  19. 19.
    Hogle NJ, Chang L, Strong VEM, Welcome AOU, Sinaan M, Bailey R, Fowler DL (2009) Validation of laparoscopic surgical skills training outside the operating room: a long road. Surg Endosc 23(7):1476–1482PubMedCrossRefGoogle Scholar
  20. 20.
    Grover S, Tan GY, Srivastava A, Leung RA, Tewari AK (2010) Residency training program paradigms for teaching robotic surgical skills to urology residents. Curr Urol Rep 1(2):87–92CrossRefGoogle Scholar
  21. 21.
    Seixas-Mikelus SA, Stegemann AP, Kesavadas T, Srimathveeravalli G, Sathyaseelan G, Chandrasekhar R, Wilding GE, Peabody JO, Guru KA (2011) Content validation of a novel robotic robotic surgical simulator. BJU Int 107(7):1130–1135PubMedCrossRefGoogle Scholar
  22. 22.
    Seixas-Mikelus SA, Kesavadas T, Srimathveeravalli G, Chandrasekhar R, Wilding GE, Guru KA (2010) Face Validation of a novel surgical simulator. Urology 76(2):357–360PubMedCrossRefGoogle Scholar
  23. 23.
    Hung AJ, Zehnder P, Patil MB, Cai J, Ng CK, Aron M, Gill IS, Desai MM (2011) Face, content and construct validity of a novel robotic surgery simulator. J Urol 186(3):1019–1025PubMedCrossRefGoogle Scholar
  24. 24.
    Gallagher AG, Ritter EM, Satava RM (2003) Fundamental principles of validation, and reliability: rigorous science for the assessment of surgical education and training. Surg Endosc 17(10):1525–1529PubMedCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2012

Authors and Affiliations

  • Cyril Perrenot
    • 1
    • 2
    • 3
  • Manuela Perez
    • 3
    • 4
  • Nguyen Tran
    • 1
  • Jean-Philippe Jehl
    • 5
  • Jacques Felblinger
    • 3
  • Laurent Bresler
    • 1
    • 2
  • Jacques Hubert
    • 1
    • 3
    • 6
  1. 1.School of SurgeryFaculty of Medicine-UHP- Nancy UniversityVandoeuvre-les-NancyFrance
  2. 2.Department of Endocrine, Digestive and General Surgery, Brabois HospitalUniversity Hospital of NancyVandoeuvre-les-NancyFrance
  3. 3.IADI Laboratory, INSERM-U947, Nancy-UniversityVandoeuvre-les-NancyFrance
  4. 4.Department of Emergency and General Surgery, Central HospitalUniversity Hospital of NancyNancyFrance
  5. 5.Continuing Education DepartmentNancy-UniversityNancy cedexFrance
  6. 6.Department of UrologyBrabois Hospital, University Hospital of NancyVandoeuvre-les-NancyFrance

Personalised recommendations