Abstract
Purpose
Endovascular simulation is an established and validated training method, but there is still no proof of direct patient’s benefit, defined as lower complication rate. In this study, the impact of such a training was investigated for rehearsal of patient-specific cases as well as for a structured simulation curriculum to teach angiographer novices.
Materials and Methods
A total of 40 patients undergoing a diagnostic neuroangiography were randomized in a training and control group. In all training group patients, the angiographer received a patient-anatomy-specific rehearsal on a high-fidelity simulator prior to the real angiography. Radiation exposure, total duration, fluoroscopy time and amount of contrast agent of the real angiography were recorded. Silent cerebral ischemia was counted by magnetic resonance diffusion-weighted imaging (DWI). Additionally, the first 30 diagnostic neuroangiographies of six novices were compared (ntotal = 180). Three novices had undergone a structured simulation curriculum; three had acquired angiographic skills without simulation.
Results
No differences were found in the number of DWI lesions or in other quality measures of the angiographies performed with and without patient-specific rehearsal. A structured simulation curriculum for angiographer novices reduced fluoroscopy time significantly and radiation exposure. The curriculum had no influence on the total duration of the examination, the amount of contrast medium or the number of catheters used.
Conclusion
There was no measurable benefit of patient-anatomy-specific rehearsal for an unselected patient cohort. A structured simulation-based curriculum to teach angiographic skills resulted in a reduction of fluoroscopy time and radiation dose in the first real angiographies of novice angiographers.
Level of Evidence
Level 4, part 1: randomized trial, part 2: historically controlled study.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Introduction
The need for neurointerventionalists performing thrombectomies has continued to increase in recent years. As at the same time quality and informative value of non-invasive imaging are improving, the decreasing number of diagnostic angiographies reduces the possibility of physicians to acquire angiographic skills. As an alternative training method, high-fidelity simulators have been successfully tested for validity in various fields in recent years [1,2,3]. Further studies demonstrated the ability of simulators to teach how to perform a real angiography and to improve a physician’s performance by repeated training [4, 5], but the proof of a direct benefit for an individual patient is still pending [5,6,7]. This would be, first, that the rate of direct complications is minimized. Those are mostly microemboli, producing (silent) cerebral ischemia. Second, radiation dose should be as low as possible. Third, the duration of the procedure should be short, as it correlates both with complications and radiation dose [8, 9].
To test the benefit of simulation training for a patient undergoing a diagnostic neuroangiography, we first analyzed the effect of a patient-anatomy-specific rehearsal on complication rate and compared the rate of silent cerebral ischemia in patients after diagnostic angiography with versus without prior patient-specific rehearsal. Second, we assessed the effect of a dedicated simulation curriculum for novice angiographers by comparing radiation exposure, duration, fluoroscopy time and amount of contrast agent of real angiographies of novice angiographers trained before the era of simulation versus novice angiographers trained with a dedicated simulation curriculum.
Materials and Methods
Patient-Specific Rehearsal
Patients who required a diagnostic angiography of all intracranial vessels in an elective setting were prospectively included from 21.06.2015 to 12.04.2017. They were randomized to the rehearsal and the control group. All patients underwent additional Magnetic Resonance Imaging (MRI) before {1–30 days} and the day after the angiography. The protocol always included an axial diffusion-weighted sequence (b = 1000 s/mm, TR 7637 ms, TE 55 ms, consecutive slices with an isotropic resolution of 2 mm; 3T, Achieva, Philips, NL). If there was no computed tomography angiography (CTA) or magnetic resonance angiography (MRA) including the aortic arch up to the skull base available, an MRA data set was acquired prior to the diagnostic angiography (coronal 3D gradient echo acquisition before and after intravenous injection of Gadolinium chelate, TR 5.9 ms, TE 1.92 ms). The number of DWI lesions was counted, and the difference between both scans was calculated. Since no DWI lesions were visible in the pre-scan, the difference matches with the number DWI lesions in the post-scan in every single case.
The vascular intervention system trainer VIST® C (Mentice AB, SW) was used for this study. The stationary model VIST® LAB consists of a control screen, two monitors for live biplane viewing, a monitor for displaying the series captured, a foot switch and a panel, e.g., for controlling the virtual C-arms. Pushing, pulling and rotating movements of the inserted wires and catheters are detected by three sensors able to provide haptic feedback. Air is injected instead of contrast medium. 3D CTA or MRA data were segmented semi-automatically (Fig. 1A) using IntelliSpace Portal (Philips, NL). The resulting 3D-Model was imported as an STL file to the software integrated in the simulator (Case-it, Mentice, SW). The model of the aortic arch with the supraaortic branches was connected to a template of the body’s trunk arteries (Fig. 1A), to be used for patient-specific rehearsal by the angiographer who later performed the real diagnostic angiography. An example of a roadmap in simulation and in a corresponding real angiography is shown in Fig. 1C, D. The physician who performed the real angiography simulated the case one day in advance.
During the real angiographies of all patients, the internal carotid artery and the vertebral artery were selectively probed on both sides and imaged in four planes. In some patients, one or both external carotid arteries were probed and imaged in two planes. 3D rotational series and target projections were supplemented if required. All catheters were continuously flushed with heparinized saline (2000 IU/1000 ml). All procedures were performed via transfemoral catheterization with a 5F sheath, standard guidewire (0.035″ Glidewire, Terumo, US) and 5F diagnostic catheters (Vertebral/Sidewinder I/Sidewinder II, Cordis, US). A non-ionic contrast medium (Imeron 300, Bracco, DE) was used for all procedures, manually injected.
For each patient, fluoroscopy time (FT), number of series, dose area product (DAP), numbers and shape of catheters and wires used were documented.
Dedicated Simulation Curriculum
Retrospectively, the first 30 neuroangiographies of six novice angiographers were evaluated (ntotal = 180). Three novices were taught conventionally by watching and gradually taking over supervised activities, until the novice was finally able to carry out a complete neuroangiography independently. The other three novices were trained by means of a structured simulation curriculum, before the conventional training started: After instruction in the operation of the simulator, the basic steps of a diagnostic neuroangiography were explained and demonstrated by an experienced angiographer. The first three simulations were performed accompanied by an experienced angiographer, and every fifth procedure was also supervised. In total, the novice angiographer must have completed at least 20 diagnostic panangiographies, before he was allowed to act on a real patient [1].
FT, amount of contrast, material used, DAP, number of series, number of images, number of vessels probed, and number of different catheters were retrospectively assessed in all 180 angiographies investigated.
Statistics: Due to the limited sample sizes, statistics are reported as median (interquartile range, IQR) using the mediantest. A p value ≤ 0.05 was considered significant. We performed all analyses using IBM SPSS Statistics, Version 23.0 (IBM, US).
Ethics: The local ethics committee approved the study (172/14) and all involved physicians and each patient in the patient-specific rehearsal study part provided informed consent before participating. The need for patient consent in the structured simulation curriculum study part was waived due to the retrospective nature of the study.
Results
Patient-Specific Rehearsal
We included 40 patients (median age 65.5, IQR 18, 14 males, 26 females, Table 1). Twenty patients without rehearsal of specific data prior to angiography (control group, median age 69.5, IQR 22, 8 male, 12 female) were compared to 20 patients with rehearsal (rehearsal group, median age 64, IQR 16, 6 male, 14 female). DWI lesions were found in 16 patients (40%), equally distributed to simulated and non-simulated patients. For details see Table 1. Overall, 32 DWI lesions occurred in the control group and 24 DWI lesions in the rehearsal group. In 10 cases, probing of one or more of the supraaortic branches did not succeed with the vertebral catheter and it was replaced by a sidewinder catheter. This happened in both groups (n = 4 in the non-simulated group, n = 6 in the simulated group) and was not associated with the occurrence of DWI lesions (mediantest p = 0.264). Due to various indications, cases differed in the number of vessels probed and imaged. Therefore, the calculation of total duration, FT, rounded amount of contrast and DAP, was additionally put into relation to the number of vessels displayed and to the number of series produced. None of the results showed a statistical difference (Table 2). Another factor influencing the data could be the expertise of the physician performing the angiography. Twenty-five angiographies were performed by a resident, 12 by a senior physician. In 3 angiographies, a senior physician took over because the resident had difficulty probing the vessels. Among those 3 there was one non-simulated case, which was the one with 19 DWI lesions, two simulated cases with none and 1 DWI lesion, respectively. Neither the comparison between non-simulated and simulated cases within a level of experience showed any difference, nor the comparison of residents with senior physicians (rehearsal group: 13 cases were performed by residents alone, 5 cases by senior physicians, and in 2 cases the catheters were handed over from the residents to a senior physician; control group: 12 cases were performed by residents alone, 7 cases by senior physicians, and in 1 case the catheters were handed over from the resident to a senior physician).
Dedicated Simulation Curriculum
The group of 3 residents who underwent a structured simulation training before the first real procedure showed significantly shorter median FT than 3 residents who had not received training (FT median 7.25 min/IQR 12 vs. 11 min/IQR 10, Fig. 2) [1]. DAP was almost 20% lower in the simulation trained group (45,540 mGycm2/IQR 53916 vs. 55488 mGycm2/IQR 60697) [1], but this difference did not reach statistical significance. Alike, differences both in the total number of images (171.5/IQR210 vs. 207/IQR 248) and in the number of images per series (24/IQR 16.25 vs. 27/IQR 20) did not reach statistical significance. Other parameters like the amount of contrast, number of series, number of vessels probed, and number of catheters showed no difference (Table 3).
Discussion
In this study, we were not able to show an effect of patient-specific rehearsal of diagnostic neuroangiographies on direct complications or quality measures of the subsequent angiography. In contrast, we were able to show that a structured simulation curriculum increased the performance of novice angiographers in real angiographies.
Clinically relevant complications occur rarely in neuroangiographies, especially in diagnostics. The rate of major complications is reported as about 2% and only a few are associated with permanent neurological deficits [10]. However, it is known that a considerable number of diagnostic angiographies lead to silent cerebral ischemia which are not noticed by the patient. Various authors report about 9 to 29% [8, 9, 11, 12]. Whether a small cerebral ischemia is asymptomatic or not cannot be influenced. Even a very small lesion can cause serious deficits if it occurs in an eloquent area. Hence, it can be assumed that a reduction in the rate of these lesions would also lead to a reduction in the rate of real complications. In our cohort, however, there was no difference between the non-simulated and the simulated cases.
It is suspected that these lesions are caused by microembolization of air, thrombi or the scraping off of atherosclerotic plaques. By means of Doppler sonography, it has been shown that 90% of microemboli occur during injections and only 10% are conditioned by catheter and wire manipulation [13]. It is therefore not surprising that the number of patients with DWI lesions was similar in both groups. The amount of contrast agent was in fact lower in simulated patients. However, the total amount of injected contrast agent can never be recorded precisely, when manual injections are performed with unrecorded amounts of contrast remaining in the syringe after the injection. Therefore, a difference of 10 ml should not be overvalued.
The third aspect, the scraping off of atherosclerotic plaques, is said to be associated with vascular risk diseases. Although some patients in our cohort suffered from hypertension, diabetes mellitus or coronary heart disease, this rate was not higher among those with post-angiographic DWI lesions.
Assumedly, a careful analysis of the specific anatomy, which inevitably accompanies each patient-specific rehearsal, could lead to fewer atherosclerotic plaques being scraped off in reality. However, this would only be possible if these plaques could be perceived during the rehearsal and consciously avoided in reality. In the segmented data used for simulation, only the lumina of the vessels are represented, plaques are not recognizable. It is presumed that the use of several catheters leads to an increase of DWI lesions [11, 12]. In our cohort, an additional catheter was needed in 25% of cases, but did not affect the rate of DWI lesions.
It was noteworthy that an overall rate of 40% patients with DWI lesions was almost twice as high as reported in the literature. Although the average age was also lower (42.9–58.25 years) than in our cohort (66.25), it is more likely to be due to the technical progress in MR imaging. In all former studies, DWI was acquired in 5-mm-thick slices at 1.5T, while in our study, 2-mm-thin slices were performed at 3T.
It has rarely been tested whether the effect of simulation training is reflected in improved performance in reality, i.e., faster completion, lower radiation dose or less amount of contrast agent. Among interventional cardiologists, a two-day course with 6 h of practical simulation had no effect on the real performance [14]. Later, the same group could prove that a 10-hour training for senior residents led to a significantly shorter fluoroscopy time and shorter treatment times—shown in only two subsequent angiographies [15]. Furthermore, the transfer into reality was successful for iliac interventions in a pig model [16] and in cardiac transseptal punctures [17]. Our evaluation of 3 residents without versus 3 residents with completed simulation curriculum compared a somewhat larger number of 30 neuroangiographies. Here, a significant reduction in fluoroscopy time and a reduction in DAP of 20% was shown. The total duration of procedures was not reduced, a parameter that turned out to be an indirect predictor for a lower complication rate in previous studies [8, 18,19,20].
Overall, it remains difficult to prove the direct benefit of simulation training for an individual patient. One reason might be that human factors may have a greater impact on patient`s benefits than the potential of acquiring manual skills during simulation [21]. Our preliminary perception reveals that novices can behave much more professionally after completing the simulation curriculum. They have to focus less on the operation of the angiosuite or the basic handling of catheters. In return, they are more capable to react to the individual patient anatomy or to detect pathology already during the image acquisition. Thus, simulation training should play a more important role in training, especially for beginners. Before the first contact with a real patient, many manipulations can be practiced, and methodical considerations can and should be made. Additionally, there is the possibility to repeat numerous details of a real angiography in a safe environment during the first basic training in reality. Considering the results of this study, currently available simulators may not play a role for advanced angiographers or interventionalists. If the quality of interventional simulations, such as in aneurysm therapy, is further improved, even an advanced neurointerventionalist could benefit from simulation (training). Whether a simulation immediately preceding a treatment can prove itself—e.g., in thrombectomy—will also depend on the speed of data segmentation and the realistic implementation of state of the art devices in the simulator [1].
Limitations
In patient-specific rehearsals, many different physicians were involved (9 residents and 5 senior physicians), due to the organizational structures of everyday clinical practice. Thus, on the one hand, numerous influencing factors have to be taken into account (e.g., individual talent), but on the other hand, the normal clinical situation is depicted quite realistically. In contrast, the second study part only involved 3 residents per training group. Due to the modernization of the angiosuite, the subsequent examination data, with regard to radiation dose, fluoroscopy time and total duration, would no longer have been comparable with earlier examinations in more novice angiographers, limiting these numbers. Moreover, it may not have been documented in every case, if, when and how a senior physician intervened in an angiography, which was assigned to a resident. As an example, a two-second correction of the catheter movement in the right moment by the supervising senior physician might have been not be documented but changed the procedure times considerably.
Both parts of the study were carried out in a high-volume center with sufficient staff, allowing for high-quality angiographic training even before using simulators. In a low-volume center with staffing shortage, one could expect even greater differences between the conventional training path and training with simulation. A high level of expertise might also have influenced the negative results of the patient-specific rehearsal.
Conclusion
For an unselected patient cohort, patient-specific rehearsal had no measurable benefit.
Further studies are needed to prove whether patients with particularly difficult anatomies could still benefit and if this benefit is similar in all experience levels of angiographers.
A structured simulation-based curriculum for teaching angiographic skills results in a reduction of fluoroscopy time and radiation dose and thus should be included in the initial teaching curriculum for all novice angiographers.
References
Kreiser K, Gehling K, Zimmer C. Simulation in angiography—experiences from 5 years teaching, training, and research. RoFo. 2019;191(6):547–52.
Glaiberman CB, Jacobs B, Street M, Duncan JR, Scerbo MW, Pilgrim TK. Simulation in training: one-year experience using an efficiency index to assess interventional radiology fellow training status. J Vasc Interv Radiol. 2008;19(9):1366e71.
Coates PJ, Zealley IA, Chakraverty S. Endovascular simulator is of benefit in the acquisition of basic skills by novice operators. J Vasc Interv Radiol. 2010;21(1):130e4.
Jensen UJ, Jensen J, Olivecrona GK, Ahlberg G, Tornvall P. Technical skills assessment in a coronary angiography simulator for construct validation. Simul Healthc. 2013;8(5):324–8.
Schimmel DR, Sweis R, Cohen ER, Davidson C, Wayne DB. Targeting clinical outcomes: endovascular simulation improves diagnostic coronary angiography skills. Catheter Cardiovasc Interv. 2016;87:383–8.
Patel R, Dennick R. Simulation based teaching in interventional radiology training: is it effective? Clin Radiol. 2017;72(3):266.e7–14.
See KWM, Chui KH, Chan WH, Wong KC, Chan YC. Evidence for endovascular simulation training: a systematic review. Eur J Vasc Endovasc Surg. 2016;51(3):441e45.
Chuah KC, Stuckey SL, Berman IG. Silent embolism in diagnostic cerebral angiography: detection with diffusion-weighted imaging. Australas Radiol. 2004;48(2):133–8.
Bendszus M, Koltzenburg M, Burger R, Warmuth-Metz M, Hofmann E, Solymosi L. Silent embolism in diagnostic cerebral angiography and neurointerventional procedures: a prospective study. Lancet. 1999;354:1594–7.
Wojak JC, Abruzzo TA, Bello JA, Blackham KA, Hirsch JA, Jayaraman MV, Dariushnia SR, Meyers PM, Midia M, Russell EJ, Walker TG, Nikolic B. Quality improvement guidelines for adult diagnostic cervicocerebral angiography: update cooperative study between the Society of Interventional Radiology (SIR), American Society of Neuroradiology (ASNR), and Society of NeuroInterventional Surgery (SNIS). J Vasc Interv Radiol. 2015;26(11):1596–608.
Britt PM, Heiserman JE, Snider RM, Shill HA, Bird CR, Wallace RC. Incidence of postangiographic abnormalities revealed by diffusion-weighted MR imaging. AJNR Am J Neuroradiol. 2000;21(1):55–9.
Sato M, Nakai Y, Tsurushima H, Shiigai M, Masumoto T, Matsumura A. Risk factors of ischemic lesions related to cerebral angiography and neuro-interventional procedures. Neurol Med Chir. 2013;53:381–7.
Dagirmanjian A, Davis DA, Rothfus WE, Deeb ZL, Goldberg AL. Silent cerebral microemboli occurring during carotid angiography: frequency as determined with Doppler sonography. AJR. 1993;161:1037–40.
Jensen UJ, Jensen J, Olivecrona G, Ahlberg G, Lagerquist B, Tornvall P. The role of a simulator-based course in coronary angiography on performance in real life cath lab. BMC Med Educ. 2014;14:49.
Jensen UJ, Jensen J, Ahlberg G, Tornvall P. Virtual reality in coronary angiography and its transfer effect to real-life catheterisation lab. EuroIntervention. 2016;11(13):1503–10.
Berry M, Lystig T, Beard J, Klingestierna H, Reznick R, Lonn L. Porcine transfer study: virtual reality simulator training compared with porcine training in endovascular novices. Cardiovasc Intervent Radiol. 2007;30(3):455–61.
De Ponti R, Marazzi R, Ghiringhelli S, Salerno-Uriarte JA, Calkins H, Cheng A. Superiority of simulator-based training compared with conventional training methodologies in the performance of transseptal catheterization. J Am Coll Cardiol. 2011;58(4):359–63.
Willinsky RA, Taylor SM, terBrugge K, Farb RI, Montanera W. Neurologic complications of cerebral angiography: prospective analysis of 2899 procedures and review of the literature. Radiol. 2003;227:522–8.
Quality improvement guidelines for adult diagnostic neuroangiography. Cooperative study between ASITN, ASNR and SCVIR. American Society of Interventional and Therapeutic Neuroradiology. American Society of Neuroradiology. Society of Cardiovascular and Interventional Radiology. J Vasc Interv Radiol. 2000; 11(1):129–34.
Dion JE, Gates PC, Fox AJ, Barnett HJM, Blom RJ. Clinical events following neuroangiography: a prospective study. Stroke. 1987;18(6):997–1004.
Barakat K. The role of simulation-based education in cardiology. Heart. 2019;105(9):728–32.
Acknowledgements
Open Access funding provided by Projekt DEAL. Kornelia Kreiser conducts research in areas of interest similar to the business interests of Mentice (Gothenburg, Sweden). She receives minor travel grants, but no personal fees. She consults for phenox and has received speaker honoraria from Philips, Penumbra and Stryker. Jan S. Kirschke received speaker honoraria from Philips. Claus Zimmer disclosed no relevant relationships regarding activities related to the present article. He has served on scientific advisory boards for Philips and Bayer Schering; serves as co-editor on the Advisory Board of Clinical Neuroradiology; has received speaker honoraria from Bayer-Schering and Philips. The Department of Neuroradiology has received research support and investigator fees for clinical studies from Biogen Idec, Quintiles, MSD Sharp & Dome, Boehringer Ingelheim, Inventive Health Clinical UK Ltd., Advance Cor, Brainsgate, Pfizer, Bayer-Schering, Novartis, Roche, Servier, Penumbra, WCT GmbH, Syngis, SSS International Clinical Research, PPD Germany GmbH, Worldwide Clinical Trials Ltd., Phenox, Covidien, Actelion, Medivation, Medtronic, Harrison Clinical Research, Concentric, Pharmtrace, Reverse Medical Corp., Premier Research Germany Ltd., Surpass Medical Ltd., GlaxoSmithKline, AXON Neuroscience, Bristol-Myers Squibb, Genentech, Acandis, EISAI, NeuroRx, Italfarmaco, Bioclinica, MIAC and IXICO. No patents issued and pending.
Funding
This study was not supported by any funding.
Author information
Authors and Affiliations
Contributions
All authors contributed to the study conception and design. Material preparation, data collection and analysis were performed by KG, LS, JK and KK. The first draft of the manuscript was written by KK, and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Conflict of interest
On behalf of all other authors, the corresponding author states that there is no conflict of interest.
Ethical Standards
All procedures performed in this study were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards. This study was approved by the Institutional Review Board (172/14), and an informed consent was obtained from each individual participants included in the study. Consent for publication was obtained for every individual person’s data included in the study.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Kreiser, K., Gehling, K.G., Ströber, L. et al. Simulation Training in Neuroangiography: Transfer to Reality. Cardiovasc Intervent Radiol 43, 1184–1191 (2020). https://doi.org/10.1007/s00270-020-02479-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00270-020-02479-5