Abstract
Introduction
Indocyanine green fluorescence angiography (ICGFA) is commonly used in colorectal anastomotic practice with limited pre-training. Recent work has shown that there is considerable inconsistency in signal interpretation between surgeons with minimal or no experience versus those consciously invested in mastery of the technique. Here, we deconstruct the fluorescence signal patterns of expert-annotated surgical ICGFA videos to understand better their correlation and combine this with structured interviews to ascertain whether such interpretative capability is conscious or unconscious.
Methods
For fluorescence signal analysis, expert-annotated ICGFA videos (n = 24) were quantitatively interrogated using a boutique intensity tracker (IBM Research) to generate signal time plots. Such fluorescence intensity data were examined for inter-observer correlation (Intraclass Correlation Coefficients, ICC) at specific curve milestones: the maximum fluorescence signal (Fmax), the times to both achieve this maximum (Tmax), as well as half this maximum (T1/2max) and the ratio between these (T1/2/Tmax). Formal tele-interview with contributing experts (n = 6) was conducted with the narrative transcripts being thematically mapped, plotted, and qualitatively analyzed.
Results
Correlation by mathematical measures was excellent (ICC0.9–1.0) for Fmax, Tmax, and T1/2max (0.95, 0.938, and 0.925, respectively) and moderate (0.5–0.75) for T1/2/Tmax (0.729). While all experts narrated a deliberate viewing strategy, their specific dynamic signal appreciation differed in the manner of description.
Conclusion
Expert ICGFA users demonstrate high correlation in mathematical measures of their signal interpretation although do so tacitly. Computational quantification of expert behavior can help develop the necessary lexicon and training sets as well as computer vision methodology to better exploit ICGFA technology.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Indocyanine green fluorescence angiography (ICGFA) has been rapidly adopted across many surgical disciplines [1]. It has become especially established in colorectal anastomosis assessment protocols during laparoscopic- and robotic-assisted surgeries due to its potential benefits in diminishing anastomotic leakage and its clinical [2], oncologic [3], and economic [4] impacts. Despite such momentum, including ongoing multinational randomized trials [5], variability in its clinical deployment and study outcomes exists [6, 7]. Previous work by this research collaborative demonstrated considerable inter-user variability in ICGFA interpretation, especially among inexperienced users [8]. In contrast, experienced users displayed better correlation in their decisions regarding geographical determination of colonic proximal transection levels. Better understanding of these observations could facilitate improved utilization of this technology allowing its true value to be extracted by all users.
Therefore, here we follow on the initial observer variability discovery work with a focused investigation of the interpretation and cognitive processes occurring at expert user level in that study via semi-structured interviews as well as detailed quantitative analysis of observed video signal interpretation. The purpose of our study was to evaluate factors underlying the better correlation seen between experts and to establish whether this occurs due to conscious act in order to inform how best to advance ICGFA interpretation among others.
Methodology
Prior study
This research [8] (performed with institutional ethics approval Mater Misericordiae University Hospital, Dublin, Ireland—1/378/2092) involved the presentation of an archived set of edited ICGFA video sequences (n = 14, 9 showing perfusion signals at the time of proximal colonic transection, five showing anastomotic/small bowel perfusion) obtained during routine laparoscopic colorectal surgery to both experienced (i.e., those who are highly active clinically and academically in the field of ICGFA, n = 6) and inexperienced (i.e., those with minimal or no ICG exposure whether clinically experienced or inexperienced, n = 34) observers via an innovative video display and annotation platform (Mindstamp: The Interactive Video Platform www.mindstamp.io). All ICGFA transection perfusion videos demonstrated the white-light tissue appearances as well as the near-infrared (NIR) appearances and an overlay, false-colored view of the NIR signal on the white-light image simultaneously using the Pinpoint Endolaparoscopic Near-infrared system (Stryker©). Using Mindstamp, observers were able to record their interpretations of the fluorescence signal of the proximal colonic segment directly onto the video segment, indicating their choice of stapler positioning across the colon based on their interpretation of the fluorescence signal. This allowed comparison of interpretations between experienced and inexperienced users and showed significant differences in interpretation between the two groups with experienced users showing higher levels of agreement in signal interpretation.
For this study, the specific sites of transection level selection in four expert-annotated videos from the first study were analyzed to both generate and correlate fluorescence dynamic signal patterns as a time series of intensity to understand better the patterns of recognition of the experienced observers. The four videos chosen were those selected as most optimal for computational assessment regarding minimal camera movement and instrument intrusion. In addition, the same expert participants were interviewed to understand their conscious thought processes in interpreting dynamic fluorescence signals.
For fluorescence signal analysis, videos (30 frames per second) of four intraoperative ICG angiograms used in the prior study were analyzed using a boutique intensity tracker (IBM Research Ireland [9]) to generate quantitative plots over time of the fluorescence signal at the transection points selected by expert users (n = 6) (see Fig. 1) (camera movement and instrument intrusion compromised continuous transection point machine-based tracking in the remaining five videos from the prior study and so these were not useable in this work). User-selected regions of interest (ROI) in the white-light view were digitally tracked via surface features and concurrent fluorescence intensity was simultaneously quantified in the corresponding regions of the raw near-infrared feed.
The generated fluorescence intensity data were recorded on Microsoft Excel v2012 (NM, USA). Specific curve milestones identified previously as those most clinically meaningful indicators of appropriate ICGFA perfusion signal [10, 11] were identified and tabulated as metadata. These milestones were the maximum fluorescence signal (Fmax), the time required for it to rise to fifty percent of the maximum fluorescence intensity (T1/2max), and the time to achieve the full peak (Tmax), as well as the ratio of the two (T1/2/Tmax) (see Fig. 2). Correlation of these parameters among experts was determined by Intraclass Correlation Coefficients (ICC: two-way mixed model, absolute agreement, single measures) [12] calculated using SPSS v26 (IBM, NY, US). To illustrate expert correlation in comparison to inexperienced user data dispersion, this exercise was also carried out for inexperienced users (n = 34) for one video and charted as scatter plots, with Chi-squared confidence ellipses charted to visually demonstrate expert/inexpert clustering of curve features.
Experienced user interviews
To understand any conscious viewing strategy applied by each experienced user in the study, each underwent formal interview conducted by teleconference using a template of open and closed questions relating to specific and general uses of ICG fluorescence with particular reference to signal interpretation (see supplementary information). Responses were recorded, transcribed, and qualitatively assessed via thematic analysis [13] (in short, ideas, concepts, opinions, statements, and descriptions were identified, coded, and grouped by emergent themes and mapped graphically with overarching categories as the stem and individual terms as the roots). In addition, a word cloud was plotted to give a visual summary of the main terminology used following the removal of definite and indefinite articles, determiners, pronouns, names, conjunctions, interjections, adjective pre-modifiers, collective nouns, and pre-prepositions, and prepositions using dedicated software www.wordclouds.com (Zygmomatic, Vianen, The Netherlands). Although not academically quantitative, this method of graphical representation groups commonest words used by size with increasing font size indicating more frequently used terms as a simple visual means of summarizing common words and terms.
Results
Six thousand forty data points per expert (n = 6) were synthesized from the ICGFA videos (n = 4).
Fluorescence signal analysis
Once plotted, the quantitative fluorescence curves were analyzed regarding Fmax, Tmax, T1/2max, and T1/2max/Tmax (see Table 1 and Fig. 1). Application of inter-observer comparative statistics revealed excellent (0.9–1.0) levels of correlation among these experienced users regarding peak intensity (Fmax 0.925) and chronological flags (Tmax 0.938 and T1/2max 0.925) and moderate (0.5–0.75) correlation for the T1/2max/Tmax ratio (0.729).
Expert interview data
Structured discussion with each experienced observer demonstrated that each use ICGFA as a confirmatory rather than directive measure with respect to sufficiency of bowel perfusion (i.e., a specific area is being visually evaluated for a reasonable perfusion signal) with a focus on inflow alone and each employs a deliberate interrogative viewing strategy to do so. Furthermore, all advocated a conscious systematic approach to learning including preclinical simulation as opposed to operative experiential learning although none had done so themselves or has such a facility in their departments. The experts however described their exact methodology in a variety of ways without common precise terminology (see Figs. 3, 4). Furthermore, more frequent comments were made on methods of ICG set-up rather than its interpretation. While intraoperative redosing and replaying the video were not recommended, a common theme of an ICG ‘time out’ (where the whole theater staff pause to appreciate the ICG signal) was prevalent. There were mixed opinions on the use of composite screen viewing (four utilizing this view) versus viewing the near-infrared signal appearances alone (n = 2) with the former espousing the benefit of simultaneous interpretation of white-light image appearances. Minimalist systems with fewer options for signal output manipulation were favored. Among considerations other than on-screen fluorescence signal, advocacy for standardization to fixed dosing and administrative method protocols was common with less regard for exact dosing, titration to weight, or ideal signal performance. With respect to inflow signal interpretation, homogeneity of distribution and maximal brightness were prioritized criteria although there was otherwise divergence in opinions re the other proposed criteria. A single expert admitted to using the chronology of the fluorescence as a discrete transection modifying criteria, while two others actively expressed that they did not feel this to be important.
Discussion
Intraoperative decision-making is an empirically learned skill which involves interpretation of visual appearances through judgment based on knowledge and experience. As a dynamic signal, interpretation of ICGFA also requires qualitative interpretation which appears to improve with experience although at present this lacks overt standardization [14] with consensus groups yet to define ideal parameters [15]. This heterogeneity in practice and techniques is also reflected in research studies with some either disregarding [16] or variably appreciating [6, 7] the chronology of the fluorescence intensity. Technical considerations such as ICG-tissue interaction and NIR system performance (including brand specific on-screen display) [17,18,19,20] may further impair correct ICGFA perfusion signal interpretation. All of this means that correct interpretation of ICGFA signals may require some experience. Furthermore, the limitation of purely visual analysis drives confirmatory-focused signal appreciation as opposed to full-field exploratory interrogation (i.e., people can only easily look at one region at a time). This work follows on from an initial study [8] that examined if there are differences between experts and inexperienced users regarding ICGFA interpretation using a curated archive of actual surgical cases [8] and uses the same dataset. This prior work showed better levels of ICC among experts (0.753 good) vs inexperts even if clinically experienced (0.613 moderate) and indeed further additional work has shown similar discrepancy exists with regard to ICGFA signal interpretation in upper gastrointestinal surgery [21]. This present work focused on examining how consistent same experts were with each other in reaching their interpretations and whether any such consistency was more explainable either their verbalized descriptions or via mathematical deconstruction of the dynamic fluorescence signal being viewed.
Main findings
Our experienced users showed excellent tacit agreement in their selections of bowel locations for proximal transections and their selection points were found to have highly similar curve profiles suggesting a common acquired ability to similarly dissect the dynamic signal being observed and flag the most relevant clinical location in a highly concordant fashion. Specifically, the peak intensity (Fmax), the time to achieve this zenith (Tmax), and the threshold period at which half this incline has been achieved (T1/2max) demonstrated excellent correlation. Interestingly, compound metrics identified experimentally as prognostically sensitive for anastomotic leakage (T1/2max/Tmax) [10] resulted in only moderate correlation. However, despite expert signal interpretation showing great consistency, this was neither consciously appreciated nor reflected in agreement in the recorded interviews. This perhaps should not be too surprising as mastery can often struggle to explain itself in the absence of objective deconstruction and standardized terminology.
Implications for practice
This study’s findings do suggest a method for explaining to others how best to extract the most useful information from ICGFA through its observation, perhaps in training libraries that users can study as they accrue their own clinical experience showing patterns of ICGFA signaling at different areas across a screen with indication of where an expert surgeon would choose to affect a clinical decision. Furthermore, the digital deconstruction of ICGFA methodology it uses could also be used for post hoc reflection on trials and experiences most especially those with equivocal or negative results [16]. This study’s observations also of course suggest a role for real-time quantitative data synthesis, analysis (including statistical correlation), and display to supplement an observer’s own interpretation especially early in their learning curves. While mathematical flagging of the flow patterns post hoc on operative video recordings could be useful for training curriculums, “on-the-fly” compound computation of fluorescent signals is needed for intraoperative decision support [22]. However the accuracy of such signal plot may be confounded by interpatient [23], variations in ICG pharmacokinetics and pharmacodynamics, as well as subject to influence by current NIR system inconsistencies across the field of interest (such systems have been primarily designed for image display for surgeon interpretation rather than being precision quantification tools). Relative, signal representation e.g., identifying the most distal bowel region displaying at least 80% of the maximum fluorescence intensity observed on-screen could be a clinically valuable near-term achievement. However, progressing onto computational assessment requires careful videography, avoiding instrument intrusion and excessive movement which hampered analysis of certain videos from our previous series. Digitalizing surgical decision-making processes is interlinked too with ethical, medico-legal, moral, and privacy issues that must also be taken into consideration [24].
Implications for research
This work so prompts further study and informs any future investigators regarding potentially useful parameters to investigate in future collaborative, multicentered work to cultivate greater datasets and a body of evidence to guide best practice and aid in surgical simulation, training, and research.
Other considerations
This work is of course limited by the relatively small numbers involved but it does enable larger studies now to be performed to test and tease out these findings more robustly and indeed determine the usefulness of interpretation training for surgeons beginning their ICGFA use. It is possible too that actual intraoperative interpretations (which include many other experiential prompts to decision-making and likely greater focus in concentration) differ from those made when watching isolated video alone and this also needs greater understanding (likely best through studies of inter- and intra-observer interpretations in theater versus out of theater).
In conclusion, ICGFA interpretation appears to standardize with experience although at present such expertise is tacitly acquired. Computational charting of the fluorescence signal into quantitative ICGFA plots over time seems able to provide a mathematical way to understand clinical mastery in interpretation potentially allowing introduction of a standard lexicon to verbally articulate the peaks and troughs of these visible intensity fluctuations. More complete understanding of expert interpretation may also inform machine-based analysis methods to automatically provide ICGFA interpretation in the future although further work is necessary to achieve this goal.
References
Boni L, David G, Mangano A, Dionigi G, Rausei S, Spampatti S, Cassinotti E, Fingerhut A (2015) Clinical applications of indocyanine green (ICG) enhanced fluorescence in laparoscopic surgery. Surg Endosc 29:2046–2055
Vallance A, Wexner S, Berho M, Cahill R, Coleman M, Haboubi N, Heald RJ, Kennedy RH, Moran B, Mortensen N, Motson RW, Novell R, O’Connell PR, Ris F, Rockall T, Senapati A, Windsor A, Jayne DG (2017) A collaborative review of the current concepts and challenges of anastomotic leaks in colorectal surgery. Colorectal Dis 19:O1-o12
Noh GT, Ann YS, Cheong C, Han J, Cho MS, Hur H, Min BS, Lee KY, Kim NK (2016) Impact of anastomotic leakage on long-term oncologic outcome and its related factors in rectal cancer. Medicine 95:e4367–e4367
La Regina D, Di Giuseppe M, Lucchelli M, Saporito A, Boni L, Efthymiou C, Cafarotti S, Marengo M, Mongelli F (2019) Financial impact of anastomotic leakage in colorectal surgery. J Gastrointest Surg 23:580–586
Armstrong G, Croft J, Corrigan N, Brown JM, Goh V, Quirke P, Hulme C, Tolan D, Kirby A, Cahill R, O’Connell PR, Miskovic D, Coleman M, Jayne D (2018) IntAct: intra-operative fluorescence angiography to prevent anastomotic leak in rectal cancer surgery: a randomized controlled trial. Colorectal Dis 20:O226–O234
Alekseev M, Rybakov E, Shelygin Y, Chernyshov S, Zarodnyuk I (2020) A study investigating the perfusion of colorectal anastomoses using fluorescence angiography: results of the FLAG randomized trial. Colorectal Dis 22:1147–1153
De Nardi P, Elmore U, Maggi G, Maggiore R, Boni L, Cassinotti E, Fumagalli U, Gardani M, De Pascale S, Parise P, Vignali A, Rosati R (2020) Intraoperative angiography with indocyanine green to assess anastomosis perfusion in patients undergoing laparoscopic colorectal resection: results of a multicenter randomized controlled trial. Surg Endosc 34:53–60
Hardy NP, Dalli J, Khan MF, Andrejevic P, Neary PM, Cahill RA (2021) Inter-user variation in the interpretation of near infrared perfusion imaging using indocyanine green in colorectal surgery. Surg Endosc 35:7074–7081
Zhuk S, Epperlein JP, Nair R, Tirupathi S, Mac Aonghusa P, O’Shea DF, Cahill R (2020) Perfusion quantification from endoscopic videos: learning to read tumor signatures. In: Martel AL, Abolmaesumi P, Stoyanov D, Mateus D, Zuluaga MA, Zhou SK, Racoceanu D, Joskowicz L (eds) Medical Image Computing and Computer Assisted Intervention – MICCAI 2020. Springer International Publishing, Cham, pp 711–721
Son GM, Kwon MS, Kim Y, Kim J, Kim SH, Lee JW (2019) Quantitative analysis of colon perfusion pattern using indocyanine green (ICG) angiography in laparoscopic colorectal surgery. Surg Endosc 33:1640–1649
Wada T, Kawada K, Takahashi R, Yoshitomi M, Hida K, Hasegawa S, Sakai Y (2017) ICG fluorescence imaging for quantitative evaluation of colonic perfusion in laparoscopic colorectal surgery. Surg Endosc 31:4184–4193
Koo TK, Li MY (2016) A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med 15:155–163
Braun V, Clarke V (2006) Using thematic analysis in psychology. Qual Res Psychol 3:77–101
Pampiglione T, Chand M (2021) Enhancing colorectal anastomotic safety with indocyanine green fluorescence angiography: an update. Surg Oncol. https://doi.org/10.1016/j.suronc.2021.101545
Dip F, Boni L, Bouvet M, Carus T, Diana M, Falco J, Gurtner GC, Ishizawa T, Kokudo N, Lo Menzo E, Low PS, Masia J, Muehrcke D, Papay FA, Pulitano C, Schneider-Koraith S, Sherwinter D, Spinoglio G, Stassen L, Urano Y, Vahrmeijer A, Vibert E, Warram J, Wexner SD, White K, Rosenthal RJ (2020) Consensus conference statement on the general use of near-infrared fluorescence imaging and indocyanine green guided surgery: results of a modified delphi study. Annals Surg 275:685–691
Jafari MD, Pigazzi A, McLemore EC, Mutch MG, Haas E, Rasheid SH, Wait AD, Paquette IM, Bardakcioglu O, Safar B, Landmann RG, Varma MG, Maron DJ, Martz J, Bauer JJ, George VV, Fleshman JWJ, Steele SR, Stamos MJ (2021) Perfusion assessment in left-sided/low anterior resection (pillar iii): a randomized, controlled, parallel, multicenter study assessing perfusion outcomes with pinpoint near-infrared fluorescence imaging in low anterior resection. Dis Colon Rectum 64:995–1002
Ahn HM, Son GM, Lee IY, Park SH, Kim NS, Baek KR (2021) Optimization of indocyanine green angiography for colon perfusion during laparoscopic colorectal surgery. Colorectal Dis 23:1848–1859
Dalli J, Hardy N, Mac Aonghusa PG, Epperlein JP, Cantillon Murphy P, Cahill RA (2021) Challenges in the interpretation of colorectal indocyanine green fluorescence angiography - a video vignette. Colorectal Dis. https://doi.org/10.1111/codi.15592
Kono Y, Ishizawa T, Tani K, Harada N, Kaneko J, Saiura A, Bandai Y, Kokudo N (2015) Techniques of fluorescence cholangiography during laparoscopic cholecystectomy for better delineation of the bile duct anatomy. Medicine 94:e1005–e1005
Van den Bos J, Wieringa FP, Bouvy ND, Stassen LPS (2018) Optimizing the image of fluorescence cholangiography using ICG: a systematic review and ex vivo experiments. Surg Endosc 32:4820–4832
Hardy N, Joosten J, Dalli J, Hompes R, Cahill R, Van Berge HM (2022) Evaluation of inter-user variability in indocyanine green fluorescence angiography to assess gastric conduit perfusion in oesophageal cancer surgery. Dis Esophagus. https://doi.org/10.1093/dote/doac016
Khan MF, Cahill RA (2021) Peroperative personalised decision support and analytics for colon cancer surgery- short report. Eur J Surg Oncol 47:477–479
Kim GY, Bae KS, Noh GJ, Min WK (2009) Estimation of indocyanine green elimination rate constant k and retention rate at 15 min using patient age, weight, bilirubin, and albumin. J Hepatobiliary Pancreat Surg 16:521
Nally DM, Kearns EC, Cahill RA (2021) Public patient involvement and engagement via ‘think-in’ for digital cancer surgery. Br J Surg. https://doi.org/10.1093/bjs/znab402
Acknowledgements
The authors gratefully acknowledge the input of Mr Jonathan Epperlein, Dr Sergiu Zhuk, and Dr Pol McAonghusa in IBM Research, Dublin, Ireland for their work in developing the tracker technology used in this study.
Funding
Open Access funding provided by the IReL Consortium.
Author information
Authors and Affiliations
Contributions
Jeffrey Dalli and Sarah Shanahan contributed equally and should be correctly named as joint first authors. Jeffrey Dalli, Sarah Shanahan, Niall P Hardy, and Ronan Cahill contributed to the study conception, design, data collection, analysis, and manuscript writing. Manish Chand, Roel Hompes, David Jayne, Frederic Ris, Antonino Spinelli, and Steven Wexner were involved in data collection, analysis, and manuscript writing.
Corresponding author
Ethics declarations
Disclosures
Prof. Ronan A Cahill is named on a patent filed in relation to processes for visual determination of tissue biology, receives speaker fees from Stryker Corp, Ethicon/J&J, and Olympus, research funding from Intuitive Corp, consultancy fees from Medtronic and Distalmotion, and holds research funding from the Irish Government (DTIF) in collaboration with IBM Research in Ireland and from EU Horizon 2020 in collaboration with Palliare and Steripak. Drs. Jeffrey Dalli and Niall P Hardy are employed as researchers in the DTIF and Dr. Jeffrey Dalli is recipient of the TESS scholarship (Malta). Dr. Manish Chand receives speaker fees from Ethicon/JnJ and Meril and is clinical advisor to Livsmed. Dr. Roel Hompes has an unrestricted research grant and materials from Stryker European Operations B.V. and receives speaker fees from Stryker Corp, Medtronic, and Applied Medical. Prof. David Jayne has received consulting honoraria from Stryker Corp. Prof Ris receives speaker fees from Stryker Corp, Arthrex, Hollister, and Ethicon/J&J and research funding from Ethicon/J&J and Quantgene. Prof. Antonino Spinelli acted as consultant and speaker for Takeda, Pfizer and Janssen, Sofar, and Oasis. Prof Steven Wexner receives royalties for intellectual property license from Medtronic, Intuitive, and Karl Storz and consulting fees for consulting from Stryker, Intuitive, and Olympus. Dr. Sarah Shanahan has no disclosures.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Dalli, J., Shanahan, S., Hardy, N.P. et al. Deconstructing mastery in colorectal fluorescence angiography interpretation. Surg Endosc 36, 8764–8773 (2022). https://doi.org/10.1007/s00464-022-09299-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00464-022-09299-3