Abstract
Background
Many training curricula were introduced to deal with the challenges that minimally invasive surgery (MIS) presents to the surgeon. Situational awareness (SA) is the ability to process information effectively. It depends on general cognitive abilities and can be divided into three steps: perceiving cues, linking cues to knowledge and understanding their relevance, and predicting possible outcomes. Good SA is crucial to predict and avoid complications and respond efficiently. This study aimed to introduce the concept of SA into laparoscopic training.
Methods
This is a prospective, randomized, controlled study conducted at the MIS Training Center of Heidelberg University Hospital. Video sessions showing the steps of the laparoscopic cholecystectomy (LC) were used for cognitive training. The intervention group trained SA with interposed questions inserted into the video clips. The identical video clips, without questions, were presented to the control group. Performance was assessed with validated scores such as the Objective Structured Assessment of Technical Skills (OSATS) during LC.
Results
72 participants were enrolled of which 61 were included in the statistical analysis. The SA-group performed LC significantly better (OSATS-Score SA: 67.0 ± 11.5 versus control: 59.1 ± 14.0, p value = 0.034) and with less errors (error score SA: 3.5 ± 1.9 versus control: 4.7 ± 2.0, p value = 0.027). No difference in the time taken to complete the procedure was found. The benefit assessment analysis showed no difference between the groups in terms of perceived learning effect, concentration, or expediency. However, most of the control group indicated retrospectively that they believed they would have benefitted from the intervention.
Conclusion
This study suggests that video-based SA training for laparoscopic novices has a positive impact on performance and error rate. SA training should thus be included as one aspect besides simulation and real cases in a multimodal curriculum to improve the efficiency of laparoscopic surgical skills training.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Minimally invasive surgery (MIS) has replaced open procedures as the gold standard in many areas of surgery. This includes simple procedures, such as laparoscopic appendectomy or cholecystectomy [1], but also more complex procedures, like extensive oncological or bariatric surgery. Benefits of MIS include less trauma and postoperative pain, a shorter hospitalization and convalescence time, as well as better cosmetic results [2,3,4]. These benefits contrast a limited field of vision and mostly two-dimensional imaging, resulting in limited depth perception. Other complicating factors include handling of the laparoscopic instruments due to reduced haptics and limited degrees of freedom [5, 6]. These aspects reciprocate a high demand for psychomotor skills, leading to a prolonged learning curve in MIS [7]. Hands-on experience is essential for surgical education and opportunities can be scarce [8].
The paradigm shift in training methodology toward a competency-based approach is a consequence of increased demands for patient safety. Errors can typically occur more often during surgical training, especially during complex procedures [9]. These errors, along with the prolonged operating time during the learning process, are decisive arguments that learning surgical techniques on patients is outdated. Therefore, several training approaches have been developed to implement MIS training outside the OR [10,11,12,13,14], and structured multi-modality training is beneficial for laparoscopic novices [15].
Currently, resident surgeons usually spend a considerable amount of time assisting and watching experienced surgeons during residency. However, the assisting residents react to the surgeon’s commands and do not necessarily make individual decisions or get involved in planning the next steps, despite being active members of the operating team. Nonetheless, these hours of assisting are of utmost importance. Actively paying attention is crucial to maximizing training effects. This skill of being aware of the current surgical step and anatomical structures at risk will be referred to as “situational awareness” (SA) in this manuscript. In its original definition, SA describes the ability to process information effectively. It depends on general cognitive skills, such as attention, (working) memory and multitasking. SA can be divided into three levels. (1) Perception of key elements in the environment. (2) Recognition of the importance of the key elements and involvement in the current situation. (3) A look into the future and the prediction of a possible outcome for the current situation. Transferred to the OR for a basic procedure, such as laparoscopic cholecystectomy (LC), those three steps could be (1) perception of the preparation status of the cystic duct, (2) recognition that the visualization of the Calot triangle is crucial before clipping and cutting and being aware that anatomical variations of vessels can be present, and (3) if the criteria of the critical view of safety are not met, severe damage of the biliary tree and hepatic blood vessels is at risk. Just as with other mental skills, SA warrants dedicated training to be effective. In addition, it has been shown that SA training for surgeons can reduce errors [16] and could lead to improved performance for residents performing surgery [17]. Therefore, the present study aimed to develop and evaluate a SA training curriculum and to demonstrate that SA may contribute to better surgical performance.
Materials and methods
Setting and participants
This study was conducted as a voluntary elective course for medical students in their clinical (3rd to 6th) years at the Medical Faculty of the University of Heidelberg, Germany. The course took place at the MIS Training Center of the Department of General, Visceral and Transplant Surgery. Only laparoscopy-naïve students were included. Students with more than 2 h of prior laparoscopic training were excluded. All participants were informed about the type, extent, and purpose of the study, as well as the possibility to withdraw their consent at any time without disadvantages. SA training was implemented via video clips of recorded LC. Active participation, a fundamental element of SA training, was achieved with interceptive questions (see below). These questions demanded from the participants to distinguish different tissues in the current situation and predict possible outcomes of actions. This type of video-based SA training with interceptive questions was developed following the SA training already described in the literature [18, 19]. To control the impact of the video material itself, the control group viewed the identical video clips without interceptive questions, thus without an active part. Ethical approval was obtained from the Ethics Committee of the Medical Faculty at Heidelberg University (Code S-436/2018).
Study design
This was a prospective, single-center, two-arm, blinded, parallel-group randomized trial. Randomization was performed by a computer-based program and kept safe in sealed opaque and numbered envelopes. There was structured training for the tutors rating the same video clips to ensure inter-rater quality. In order to avoid bias through the tutors by heterogeneity, only two tutors conducted the majority of the trial.
SA training
The intention of the intervention was to train SA. According to Endsley [20], active participation is essential in SA training, which was achieved via the integration of interposed questions into the video clips. Therefore, the video was stopped without warning and a question specific to the current situation appeared (see Fig. 1 and supplementary videos). This method has been described in aviation [21] and in the medical field of anesthesiology [19]. The cognitive training of the control group included video-based training with the identical video clips presented to the intervention group, but without interceptive questions. For the creation of the self-edited video clips, footage from previous studies at the training center was utilized.
The SA training within the curriculum comprised three parts of video sessions. Each video session consisted of two parts:
-
1.
Distinction between the cystic artery, bile duct, and connective tissue during dissection of the Calot triangle.
-
2.
Perception of whether the gallbladder will perforate during its removal from the liver bed.
Baseline
Prior to training, all participants completed a questionnaire about relevant previous experiences. Questions involved prior experience in the OR, especially in general laparoscopic procedures and open cholecystectomy along with personal characteristics that may be associated with higher performance in (laparoscopic) surgery. Enquired characteristics comprised sports, playing a musical instrument, and playing video games, as done previously[22]. Attention was measured with validated psychological tests (Trail Marking Test (TMT), Frankfurt Attention Inventory 2 (Frankfurter Aufmerksamkeits-inventar-2: FAIR2), and Number link test (Zahlen-Verbindungs-test: ZVT). Moreover, self-assessment of attention and ability to learn from videos on a scale from 1 to 100 was recorded. In addition, all participants received basic training on a box trainer and the “LAP mentor™.” The baseline of laparoscopic performance was measured with the Heidelberg VR Score [23].
Pre-test
After an introduction to LC via touch surgery, a validated serious game [24] as well as video- and virtual reality (VR)-based learning, the participants performed their pre-test LC on a porcine cadaver liver model in a box trainer as described earlier [22]. A previous study has shown that it is beneficial to combine serious gaming and VR training to learn the cognitive aspects of LC [24]. The participants were supervised 1:1 but no instructions were given during the procedure. The LC ended either with the completion or after a maximum allowed time of 90 min. Afterward, the participants received feedback. Performance was measured with the Global Operative Assessment of Laparoscopic Skills (GOALS) and the Objective Structured Assessment of Technical Skills (OSATS) as well as an error score. A modified version of the specific technical skill (STS) of the OSATS-Score was used [25]. The difficulty of the procedure was quantified with a visual analog scale (VAS) [26], which included various parameters of the liver and gallbladder, such as the tenderness of the connective tissue, which either facilitated or complicated the dissection of the gallbladder. Next, participants were randomized to receive either SA training or standard video training (see flow chart—Fig. 2).
Post-test
The post-test was performed under the same conditions as the pre-test. At the end of the training, all participants completed another questionnaire evaluating the training, focusing on cognitive training.
Study hypothesis
The difference in the OSATS score was defined as the primary outcome.
-
H0: The OSATS score of the SA-group is equal to or lower than the OSATS score of the control group.
-
H1: The OSATS score of the SA-group is higher than the OSATS score of the control group.
Sample size calculation
The sample size determination was calculated with a t test, assumptions from experiences of previous studies and the results of the pilot study. The assumptions made were a significance level of 5%, a standard deviation of 13 and a group difference of 10 points on the OSATS score. Accounting for a drop-out rate of 25%, a sample size of 68 was calculated. Analysis was planned to achieve a power of 80%.
Statistical analysis
Statistical analysis was performed using R [27]. A p value ≤ 0.05 was considered statistically significant.
Primary outcome
Confirmative testing was performed looking for superiority in the OSATS score at the post-test.
As predefined in the protocol, a stepwise linear regression was used to test the hypothesis. Possible influencing variables were selected beforehand. These were ranked by relevance and significance and gradually removed during model establishment. This was carried out using stepwise regression, identifying the smallest statistically significant model.
Secondary outcomes
Exploratory analysis was performed by looking for group differences in the post-test of the GOALS Score, the error score, and the total procedure time in minutes. These analyses were performed using the unpaired t tests with equal variances. The individual sub-items of the error score were analyzed with Chi-Square test. Since the study was conducted as a clinical elective course, it was evaluated in detail at the end. General factors, such as supervision, and the different training mediums were evaluated. Furthermore, the cognitive training was evaluated on the perceived expedience of cognitive training, the extent of subjective learning effect, and the level of concentration during training. A digital graphic scale ranging from 1 to 100 was provided for answering. The responses were evaluated via Pearson correlation analysis. Group differences were calculated using the Mann–Whitney U test. Subgroup analysis was performed via interaction analysis as described by Brankovic et al. 2019 [28]. Results were visualized using a rainforest plot showing the coefficient and the Standard Error (SE) of each interaction analysis as well as the p value for the interaction.
Results
Data from 61 students were available for analysis. A detailed overview of baseline characteristics is provided in Table 1.
Primary outcome
The SA intervention resulted in a significant improvement in performance measured with the OSATS score (SA: 67.0 ± 11.5 versus control: 59.1 ± 14.0, p value = 0.034) as the primary outcome (Table 2). The optimized regression model shown in Table 2 included group, sex, age, dominant hand, ‘Heidelberg VR Score,’ OSATS-Baseline, VAS of the Post-Test gallbladder, video games, the self-assessed ability of learning from videos, the results of the attention tests (TMT-A and FAIR-q), as well as the number of already assisted LC.
Secondary outcomes
The SA-group had significantly higher performance compared to the control group measured by the goals score (SA: 20.7 ± 4.3 versus Control: 18.0 ± 5.2, p value = 0.035, see Fig. 3a). The SA-group made significantly fewer errors than the control group measured with the error score (SA: 3.5 ± 1.9 versus Control: 4.7 ± 2.0, p value = 0.027, see Fig. 3b). The time in minutes to complete LC was the same in both groups. (SA: 68.7 ± 13.9 versus control: 64.2 ± 15.8, p value = 0.25, see Fig. 3c). Difficulties in the identification of important structures often led to their accidental severing. In the SA-group injuries of the artery or duct as well as clip misplacement occurred significantly less frequently than in the control group. There were no significant differences among both groups in preparation of the liver bed, liver injury, or in perforation of the gallbladder. These parameters were assessed with the error score (injuries of the artery or duct: SA: 44.1% no mistake, 38.2% minor mistakes, 17.6% major mistakes versus Control: 33.3% no mistake, 22.2% minor mistakes, 44.4% major mistakes; p value of the group difference = 0.069; clip misplacement: SA: 55.9% no mistake, 32.4% minor mistakes, 11.8% major mistakes versus Control: 25.9% no mistakes, 40.7% minor mistakes, 33.3% major mistakes; p value of the group difference = 0.034).
Evaluation of the perceived usefulness of the SA intervention
Significant Pearson correlations appeared between the perceived learning effect and the perception of the perceived expedience of cognitive training (R coefficient = 0.87; p value < 0.001, see Fig. 4a). The stated expedience of the cognitive training and the stated ability to concentrate correlated significantly (R coefficient = 0.36; p value = 0.008, see Fig. 4b). The ability to concentrate and the stated learning effect also correlated significantly (R coefficient = 0.28; p value = 0.042, see Fig. 4c).
Looking at the evaluation questions of each individual group separately, no statistically significant differences were found (data not shown). However, 18 participants in the control group stated that they might benefit from the intervention; only two indicated that they might not.
Subgroup analysis
Subgroup analysis did not reveal any unexpected adverse effects attributed to the intervention. Furthermore, no interaction between intervention and subgroup was detected (see supplementary file, Fig. 5).
Discussion
The present randomized study shows that SA training as part of a multimodal training concept can lead to a significant improvement in laparoscopic performance during the early learning curve. The results were consistent in exploratory analyses for additional performance metrics and error rates. Significant group differences appear in favor of the SA-group for the OSATS score, the GOALS score, as well as the error score. These results imply that SA training helps to improve performance. Thus, the primary endpoint of this study was met. Due to the prospective randomized design and rigorous implementation, it can be assumed that the SA training is causal for the difference.
The finding that SA training as part of non-technical skills (NTS) training has a positive impact not only on cognitive but also on psychomotor skills is consistent with previous research [29, 30]. For example, McCulloch et al. stated that NTS training leads to improvements in team performance, error rates, and attitudes toward safety in LC. The ability of SA and its successful application is a contributor for surgeons to successfully perform a complex procedure. The surgeon must be able to recognize and react to intraoperative deviations such as anomalies of anatomy and physiology (e.g., altered coagulation parameters) and constantly question her/his own surgical performance to ensure patient safety. For example, by changing the surgical approach, communicating of abnormal coagulation to the anesthesiologist, or correcting a potentially problematic anastomosis. This is especially important for laparoscopic surgery. Most misinterpretations and thus errors occur under immense mental workload [16]. It becomes increasingly difficult to filter out relevant cues, while the actual focus is on the surgical procedure itself [31]. Cognitive training is well established in other fields, such as professional athletics and aviation. Also, medical studies revealed the benefits of cognitive training, especially in surgery. Mental training is associated with improved attention [32] and leads to better performance under stressful conditions. Anton et al. compared the outcome of suturing skills under induced stress between mentally trained and untrained residents and showed the superiority of the mentally trained group [33].
The intervention in the present study trained SA and thus an important cognitive function. It led to a reduction in errors in laparoscopic novices. The relationship between lack of SA and the occurrence of errors has been reported in the literature previously [34]. A systematic review by Graafland et al. showed the potential for error reduction in the OR through SA training. [16]. Looking more closely at the error score, the SA-group made significantly fewer errors in stump preparation, yet not in liver bed preparation. This indicates that the video clips targeting differentiation of artery, duct, and connective tissue had a positive impact. Difficulty in identifying the anatomical structures—artery, duct, or connective tissue—might lead to accidental dissection of the former two. Differentiation appears to have been easier for the SA-group than for the control group, as they made significantly fewer errors in dissecting the duct and artery. These results are analog to observations from other studies, suggesting that novices are likely to exhibit the greatest learning success in stump dissection [35]. The difference between stump and liver bed preparation has been investigated in another study using the GOALS score. The complexity of stump preparation in contrast to liver bed preparation was described as a possible reason [36].
However, despite displaying a superior performance, the SA-group took the same time as the control group to complete the LC. Graafland et al. showed a better response to equipment failure in the SA-trained group, but also found no difference in time required. McCulloch et al. observed an increase in NTS and attitude toward safety during LC, but no change in operating time after the surgeons participated for several months in aviation-style resource management training [17, 30]. Perhaps SA training led the SA-group to work more carefully and thus not improving in time despite better performance. This implies that SA training might shift the surgeon’s focus toward correctness and accuracy, i.e., the avoidance of errors and complications. Whether further experience in SA-trained surgeons leads to reduced procedure time while maintaining a low error rate remains to be elucidated in further studies. Also, the SA-group might have been less stressed than the control group. Pavlidis et al. hypothesized that a high stress level would be instrumental in working quickly in surgery; however, while hazarding an increase in likelihood of errors [37]. Both interpretations taken together conclude that SA training reduces the probability of errors without causing longer procedural time.
The evaluation questionnaire demonstrated that the video clips with SA training were rated more useful and led to higher concentration and learning effects than video clips without SA training. The correlations between the perceived subjective learning effect, level of concentration during training, and the expedience of cognitive training offer the conclusion that only those, who were able to concentrate on the video clips, stated a learning effect. These findings are in line with previous research stating that concentration and attention are crucial to learning effects [38].
The results of the subgroup analysis should be investigated in further studies as they only have explorative character. Various factors and traits influence the acquisition of laparoscopic skills, and this study indicates not all groups benefitted equally from SA training. Male and right-handed participants seem to have benefited from the SA training, but female and left-handed trainees did not benefit equally. Since the participants did not receive any instructions and female participants might perform worse than their male colleagues without instructions [39], it is reasonable to assume that the female participants were not able to realize their full potential. Not surprisingly, left-handers performed significantly worse in training designed for right-handers [40]. Therefore, both females and left-handers needed extra attention and extra working memory to compensate for their handicap. However, SA is highly dependent on attention and working memory [41].
In summary, SA training appears to be a useful complimentary tool to hands-on training in the multimodal training curriculum for novice laparoscopists. At this point, it has yet to be investigated whether SA training for LC can be applied to other, more difficult operations, and to what extent more difficult SA training sessions can provide more experienced surgeons with useful training. It is reasonable to assume that multimedia-based vicarious learning will be adopted by surgeons. A study shows the growing importance of collegial exchange via multimedia posts on social platforms, with a focus on learning through the mistakes and experiences of others [42]. Generally speaking, SA training is a promising opportunity to enhance the surgical skills and performance during early residency, possibly leading to more autonomy and motivation and thus positively affect the whole surgical team in addition to the patient’s safety.
Implementation of SA in the OR might be achieved through interceptive auto-suggestive questions the resident asks herself/himself while assisting and watching. Questions like “What’s going on at the moment?”, “What might happen next?”, and “Do I run into any risks soon?” help train SA. However, whether SA skills learned in a training center are applicable to the OR as well as the feasibility of its implementation and to what extent better SA means better outcomes in terms of mortality and morbidity for patients, needs to be verified in further studies. The feasibility of implementing this multimodal training concept can be difficult in smaller hospitals with limited resources. One way to overcome this problem is to have training centers at larger hospitals offer multimodal training for residents from smaller hospitals.
The integration of this study into the elective course came with limitations. Due to administrative reasons, the elective course was supervised by a total of two tutors and three assistants. Also, the MIS training center of the Surgical University Hospital Heidelberg is accessible and in use for various learning and exercise groups and it could not be guaranteed that only a single tutoring session took place at a given time. Despite previous arrangements, inter-rater validity and a generally valid schedule, individual differences in tutoring and distraction cannot be ruled out entirely. Another limitation of this study was that the participants were students. Medical students do not decidedly represent novice surgeons. However, all participants were novices and therefore comparable with each other. Equally limiting was the porcine cadaver liver model, from which no conclusions can be drawn as to whether the recorded increase in surgical performance is also associated with a benefit for alive human patients. On the other hand, the pig cadaver model is a well-established model for LC because of the similar anatomy, and it has already been shown that the technical skills learned can be transferred to humans in the operating room [43]. However, the ethical justifiability of porcine cadaver models is higher than that of living patients.
In conclusion, video-based SA training with a focus on potential errors during the critical steps of LC is beneficial in the early phase of laparoscopy training. Efficient training of novice laparoscopic surgeons is becoming increasingly important and SA training offers a valuable opportunity to add to multimodal training curricula. Video-based SA training could also be integrated into the concept of vicarious learning via social platforms and would thus be easily accessible. Further studies should focus on transferability to the OR and improved patient safety. Additionally, this is one aspect of a comprehensive training curriculum in addition to simulation and guided real cases.
Abbreviations
- GOALS:
-
Global operative assessment of laparoscopic skills
- IQR:
-
Interquartile range
- LC:
-
Laparoscopic cholecystectomy
- MIS:
-
Minimally invasive surgery
- NTS:
-
Non-technical skills
- OR:
-
Operation room
- OSATS:
-
Objective structured assessment of technical skills
- SA:
-
Situation awareness
- SE:
-
Standard error
- SD:
-
Standard deviation
- VAS:
-
Visual analog scale
- VR:
-
Virtual reality
References
Soper NJ, Stockmann PT, Dunnegan DL, Ashley SWJAos (1992) Laparoscopic cholecystectomy the New’Gold standard’? Arch Surg 127(8):917–923
Grande M, Tucci GF, Adorisio O, Barini A, Rulli F, Neri A, Franchi F, Farinon AM (2002) Systemic acute-phase response after laparoscopic and open cholecystectomy. Surg Endosc 16(2):313–316. https://doi.org/10.1007/s00464-001-9042-5
Karayiannakis AJ, Makri GG, Mantzioka A, Karousos D, Karatzas G (1997) Systemic stress response after laparoscopic or open cholecystectomy: a randomized trial. Br J Surg 84(4):467–471
Keus F, de Jong JA, Gooszen HG, van Laarhoven CJ (2006) Laparoscopic versus open cholecystectomy for patients with symptomatic cholecystolithiasis. Cochrane Database Syst Rev. https://doi.org/10.1002/14651858.CD006231
Zhou M, Tse S, Derevianko A, Jones DB, Schwaitzberg SD, Cao CG (2012) Effect of haptic feedback in laparoscopic surgery skill acquisition. Surg Endosc 26(4):1128–1134. https://doi.org/10.1007/s00464-011-2011-8
Hanna GB, Shimi SM, Cuschieri A (1998) Randomised study of influence of two-dimensional versus three-dimensional imaging on performance of laparoscopic cholecystectomy. Lancet 351(9098):248–251. https://doi.org/10.1016/s0140-6736(97)08005-7
Miskovic D, Ni M, Wyles SM, Tekkis P, Hanna GB (2012) Learning curve and case selection in laparoscopic colorectal surgery: systematic review and international multicenter analysis of 4852 cases. Dis Colon Rectum 55(12):1300–1310. https://doi.org/10.1097/DCR.0b013e31826ab4dd
Mattar SG, Alseidi AA, Jones DB, Jeyarajah DR, Swanstrom LL, Aye RW, Wexner SD, Martinez JM, Ross SB, Awad MM, Franklin ME, Arregui ME, Schirmer BD, Minter RM (2013) General surgery residency inadequately prepares trainees for fellowship: results of a survey of fellowship program directors. Ann Surg 258(3):440–449. https://doi.org/10.1097/SLA.0b013e3182a191ca
Gallagher AG, Ritter EM, Champion H, Higgins G, Fried MP, Moses G, Smith CD, Satava RM (2005) Virtual reality simulation for the operating room. Ann Surg 241(2):364–372. https://doi.org/10.1097/01.sla.0000151982.85062.80
Romero P, Brands O, Nickel F, Müller B, Günther P, Holland-Cunz S (2014) Intracorporal suturing—driving license necessary? J Pediatr Surg 49(7):1138–1141. https://doi.org/10.1016/j.jpedsurg.2013.12.018
Nickel F, Jede F, Minassian A, Gondan M, Hendrie JD, Gehrig T, Linke GR, Kadmon M, Fischer L, Müller-Stich BP (2014) One or two trainees per workplace in a structured multimodality training curriculum for laparoscopic surgery? Study protocol for a randomized controlled trial—DRKS00004675. Trials 15(1):137. https://doi.org/10.1186/1745-6215-15-137
Nickel F, Hendrie JD, Kowalewski KF, Bruckner T, Garrow CR, Mantel M, Kenngott HG, Romero P, Fischer L, Muller-Stich BP (2016) Sequential learning of psychomotor and visuospatial skills for laparoscopic suturing and knot tying-a randomized controlled trial “The Shoebox Study” DRKS00008668. Langenbecks Arch Surg 401(6):893–901. https://doi.org/10.1007/s00423-016-1421-4
Nickel F, Bintintan VV, Gehrig T, Kenngott HG, Fischer L, Gutt CN, Müller-Stich BP (2013) Virtual reality does not meet expectations in a pilot study on multimodal laparoscopic surgery training. World J Surg 37(5):965–973. https://doi.org/10.1007/s00268-013-1963-3
Haubruck P, Nickel F, Ober J, Walker T, Bergdolt C, Friedrich M, Müller-Stich BP, Forchheim F, Fischer C, Schmidmaier G, Tanner MC (2018) Evaluation of app-based serious gaming as a training method in teaching chest tube insertion to medical students: randomized controlled trial. J Med Internet Res 20(5):e195–e195. https://doi.org/10.2196/jmir.9956
Kowalewski KF, Garrow CR, Proctor T, Preukschas AA, Friedrich M, Muller PC, Kenngott HG, Fischer L, Muller-Stich BP, Nickel F (2018) LapTrain: multi-modality training curriculum for laparoscopic cholecystectomy-results of a randomized controlled trial. Surg Endosc 32(9):3830–3838. https://doi.org/10.1007/s00464-018-6110-7
Graafland M, Schraagen JM, Boermeester M, Bemelman W, Schijven M (2015) Training situational awareness to reduce surgical errors in the operating room. Br J Surg. https://doi.org/10.1002/bjs.9643
Graafland M, Bemelman WA, Schijven MP (2017) Game-based training improves the surgeon’s situational awareness in the operation room: a randomized controlled trial. Surg Endosc 31(10):4093–4101. https://doi.org/10.1007/s00464-017-5456-6
Strater LD, Reynolds JP, Faulkner LA, Birch DK, Hyatt J, Swetnam S, Endsley MR (2004) PC-Based tools to improve infantry situation awareness. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol 48, issue 3. SAGE Publications, Los Angeles, CA, pp 668–672
Schulz CM, Endsley MR, Kochs EF, Gelb AW, Wagner KJ (2013) Situation awareness in anesthesia: concept and research. J Am Soc Anesthesiol 118(3):729–42
Endsley MR, Robertson MM (2000) Training for situation awareness. In: Endsley MR, Garland DJ (eds) Situation Awareness Analysis and Measurement. CRC Press, Boca Raton, FL, pp 349–365
Chiappe D, Morgan CA, Kraut J, Ziccardi J, Sturre L, Strybel TZ, Vu KL (2016) Evaluating probe techniques and a situated theory of situation awareness. J Exp Psychol Appl 22(4):436–454. https://doi.org/10.1037/xap0000097
Kowalewski KF (2019) Analyse laparoskopischer Fähigkeiten und Bewegungsmuster auf Basis von Expertenmodellen und metrischen Parametern. Ruprecht Karls Universität, Heidelberg
Schmidt MW, Kowalewski KF, Schmidt ML, Wennberg E, Garrow CR, Paik S, Benner L, Schijven MP, Muller-Stich BP, Nickel F (2019) The Heidelberg VR Score: development and validation of a composite score for laparoscopic virtual reality training. Surg Endosc 33(7):2093–2103. https://doi.org/10.1007/s00464-018-6480-x
Kowalewski KF, Hendrie JD, Schmidt MW, Proctor T, Paul S, Garrow CR, Kenngott HG, Muller-Stich BP, Nickel F (2017) Validation of the mobile serious game application touch surgery for cognitive training and assessment of laparoscopic cholecystectomy. Surg Endosc 31(10):4058–4066. https://doi.org/10.1007/s00464-017-5452-x
Nickel F, Brzoska JA, Gondan M, Rangnick HM, Chu J, Kenngott HG, Linke GR, Kadmon M, Fischer L, Muller-Stich BP (2015) Virtual reality training versus blended learning of laparoscopic cholecystectomy: a randomized controlled trial with laparoscopic novices. Medicine (Baltimore) 94(20):e764. https://doi.org/10.1097/MD.0000000000000764
Willuth E, Hardon SF, Lang F, Haney CM, Felinska EA, Kowalewski KF, Müller-Stich BP, Horeman T, Nickel F (2021) Robotic-assisted cholecystectomy is superior to laparoscopic cholecystectomy in the initial training for surgical novices in an ex vivo porcine model: a randomized crossover study. Surg Endosc. https://doi.org/10.1007/s00464-021-08373-6
Team RC (2020) R: a language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. www.r-project.org. Accessed 23 Sept 2022
Brankovic M, Kardys I, Steyerberg EW, Lemeshow S, Markovic M, Rizopoulos D, Boersma E (2019) Understanding of interaction (subgroup) analysis in clinical trials. Eur J Clin Investig. https://doi.org/10.1111/eci.13145
Arora S, Aggarwal R, Sirimanna P, Moran A, Grantcharov T, Kneebone R, Sevdalis N, Darzi A (2011) Mental practice enhances surgical technical skills: a randomized controlled study. Ann Surg 253(2):265–270. https://doi.org/10.1097/SLA.0b013e318207a789
McCulloch P, Mishra A, Handa A, Dale T, Hirst G, Catchpole K (2009) The effects of aviation-style non-technical skills training on technical performance and outcome in the operating theatre. Qual Saf Health Care 18(2):109–115. https://doi.org/10.1136/qshc.2008.032045
Dreyfus SE (2004) The five-stage model of adult skill acquisition. Bull Sci Technol Soc 24(3):177–81
Anton NE, Mulji N, Howley LD, Yurco AM, Tobben D, Bean E, Stefanidis D (2017) Effects of a novel mental skills curriculum on surgical novices’ attention. J Surg Res 219:86–91. https://doi.org/10.1016/j.jss.2017.05.112
Anton NE, Beane J, Yurco AM, Howley LD, Bean E, Myers EM, Stefanidis D (2018) Mental skills training effectively minimizes operative performance deterioration under stressful conditions: results of a randomized controlled study. Am J Surg 215(2):214–221. https://doi.org/10.1016/j.amjsurg.2017.09.039
Mishra A, Catchpole K, Dale T, McCulloch P (2008) The influence of non-technical performance on technical outcome in laparoscopic cholecystectomy. Surg Endosc 22(1):68–73. https://doi.org/10.1007/s00464-007-9346-1
Aggarwal R, Grantcharov T, Moorthy K, Milland T, Papasavas P, Dosis A, Bello F, Darzi A (2007) An evaluation of the feasibility, validity, and reliability of laparoscopic skills assessment in the operating room. Ann Surg 245(6):992
Kramp KH, van Det MJ, Hoff C, Lamme B, Veeger NJ, Pierie JP (2015) Validity and reliability of global operative assessment of laparoscopic skills (GOALS) in novice trainees performing a laparoscopic cholecystectomy. J Surg Educ 72(2):351–358. https://doi.org/10.1016/j.jsurg.2014.08.006
Pavlidis I, Tsiamyrtzis P, Shastri D, Wesley A, Zhou Y, Lindner P, Buddharaju P, Joseph R, Mandapati A, Dunkin B, Bass B (2012) Fast by nature—how stress patterns define human experience and performance in dexterous tasks. Sci Rep 2(1):305. https://doi.org/10.1038/srep00305
Mandl HFH (2006) Handbuch Lernstrategien. 1st edn. Hogrefe Verlag
Ali A, Subhi Y, Ringsted C, Konge L (2015) Gender differences in the acquisition of surgical skills: a systematic review. Surg Endosc 29(11):3065–3073. https://doi.org/10.1007/s00464-015-4092-2
Lee JY, Mucksavage P, McDougall EM (2013) Surgical skills acquisition among left-handed trainees-true inferiority or unfair assessment: a preliminary study. J Surg Educ 70(2):237–242. https://doi.org/10.1016/j.jsurg.2012.09.007
Endsley MR (1995) Toward a theory of situation awareness in dynamic systems. Hum Factors 37:32–64. https://doi.org/10.1518/001872095779049543
Myers CG, Kudsi OY, Ghaferi AAJAos, (2018) Social media as a platform for surgical learning: use and engagement patterns among robotic surgeons. Ann Surg 267(2):233–235
Kirwan W, Kaar T, Waldron R (1991) Starting laparoscopic cholecystectomy—the pig as a training model. Irish J Med Sci 160(8):243–246
Acknowledgements
The present study is part of Ms. Laura Seifert’s doctoral thesis at Heidelberg University.
Funding
Open Access funding enabled and organized by Projekt DEAL.
Author information
Authors and Affiliations
Contributions
Study conception and design: NF, KKF, and SMW. Acquisition of data: SL, KKF, AS, and FC. Statistical analysis: SL, BL, and KKF. Analysis and interpretation of data: SL, KKF, and NF. Drafting of manuscript: SL and KKF. Critical revision: MSBP and NF.
Corresponding author
Ethics declarations
Disclosures
Karl-Friedrich Kowalewski, Laura Seifert, Laura Kohlhas, Mona Wanda Schmidt, Seher Ali, Carolyn Fan, Karl Felix Köppinger, Beat Müller-Stich, and Felix Nickel have no conflicts of interest or financial ties to disclose.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Supplementary file1 (MP4 11248 KB)
Supplementary file2 (MP4 5251 KB)
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Kowalewski, KF., Seifert, L., Kohlhas, L. et al. Video-based training of situation awareness enhances minimally invasive surgical performance: a randomized controlled trial. Surg Endosc 37, 4962–4973 (2023). https://doi.org/10.1007/s00464-023-10006-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00464-023-10006-z