Face, content, and construct validity of the EndoViS training system for objective assessment of psychomotor skills of laparoscopic surgeons
- First Online:
- 334 Downloads
The aim of this study is to present face, content, and constructs validity of the endoscopic orthogonal video system (EndoViS) training system and determines its efficiency as a training and objective assessment tool of the surgeons’ psychomotor skills.
Thirty-five surgeons and medical students participated in this study: 11 medical students, 19 residents, and 5 experts. All participants performed four basic skill tasks using conventional laparoscopic instruments and EndoViS training system. Subsequently, participants filled out a questionnaire regarding the design, realism, overall functionality, and its capabilities to train hand–eye coordination and depth perception, rated on a 5-point Likert scale. Motion data of the instruments were obtained by means of two webcams built into a laparoscopic physical trainer. To identify the surgical instruments in the images, colored markers were placed in each instrument. Thirteen motion-related metrics were used to assess laparoscopic performance of the participants. Statistical analysis of performance was made between novice, intermediate, and expert groups. Internal consistency of all metrics was analyzed with Cronbach’s α test.
Overall scores about features of the EndoViS system were positives. Participants agreed with the usefulness of tasks and the training capacities of EndoViS system (score >4). Results presented significant differences in the execution of three skill tasks performed by participants. Seven metrics showed construct validity for assessment of performance with high consistency levels.
EndoViS training system has been successfully validated. Results showed that EndoViS was able to differentiate between participants of varying laparoscopic experience. This simulator is a useful and effective tool to objectively assess laparoscopic psychomotor skills of the surgeons.
KeywordsLaparoscopic surgery Surgical training Objective assessment Motion metrics Validation Endoscopic orthogonal video system (EndoViS)
- 3.Klarenbeek BR, Bergamaschi R, Veenhof AA, van der Peet DL, van den Broek WT, de Lange ES, Bemelman WA, Heres P, Lacy AM, Cuesta MA (2011) Laparoscopic versus open sigmoid resection for diverticular disease: follow-up assessment of the randomized control Sigma trial. Surg Endosc 25(4):1121–1126. doi:10.1007/s00464-010-1327-0 CrossRefPubMedGoogle Scholar
- 12.Laski D, Stefaniak TJ, Makarewicz W, Proczko M, Gruca Z, Sledziński Z (2011) Structuralized box-trainer laparoscopic training significantly improves performance in complex virtual reality laparoscopic tasks. Wideochir Inne Tech Malo Inwazyjne 7(1):27–32. doi:10.5114/wiitm.2011.25666 PubMedCentralPubMedGoogle Scholar
- 25.Oropesa I, Sánchez-González P, Chmarra MK, Lamata P, Fernández A, Sánchez-Margallo JA, Jansen FW, Dankelman J, Sánchez-Margallo FM, Gómez EJ (2013) EVA: laparoscopic instrument tracking based on endoscopic video analysis for psychomotor skills assessment. Surg Endosc 27(3):1029–1039. doi:10.1007/s00464-012-2513-z CrossRefPubMedGoogle Scholar
- 30.Pérez F, Sossa H, Martínez R, Lorias D, Minor A (2013) Video-based tracking of laparoscopic instruments using an orthogonal webcams system. World Acad Sci Eng Technol Int J Med Health Pharm Biomed Eng 7(8):184–187Google Scholar
- 31.Cotin S, Stylopoulos N, Ottensmeyer MP, Neumann P, Rattner DW, Dawson SL (2002) Metrics for laparoscopic skills trainers: the weakest link! In: MICCAI 2002. LNCS, 2488, pp. 35–43. Springer, HeidelbergGoogle Scholar