Abstract
Purpose
For some surgical conditionns and scientific questions, the “real world” effectiveness of surgical patient care may be better explored using a multi-institutional time-bound observational cohort assessment approach (termed a “snapshot audit”) than by retrospective review of administrative datasets or by prospective randomized control trials. We discuss when this might be the case, and present the key features of developing, deploying, and assessing snapshot audit outcomes data.
Methods
A narrative review of snapshot audit methodology was generated using the Scale for the Assessment of Narrative Review Articles (SANRA) guideline. Manuscripts were selected from domains including: audit design and deployment, statistical analysis, surgical therapy and technique, surgical outcomes, diagnostic testing, critical care management, concomitant non-surgical disease, implementation science, and guideline compliance.
Results
Snapshot audits all conform to a similar structure: being time-bound, non-interventional, and multi-institutional. A successful diverse steering committee will leverage expertise that includes clinical care and data science, coupled with librarian services. Pre-published protocols (with specified aims and analyses) greatly helps site recruitment. Mentored trainee involvement at collaborating sites should be encouraged through manuscript contributorship. Current funding principally flows from medical professional organizations.
Conclusion
The snapshot audit approach to assessing current care provides insights into care delivery, outcomes, and guideline compliance while generating testable hypotheses.
Similar content being viewed by others
References
Mason SE, Scott AJ, Markar SR, Clarke JM, Martin G, Beatty JW, et al. Insights from a global snapshot of the change in elective colorectal practice due to the COVID-19 pandemic. PLoS ONE. 2020;15: e0240397.
Khatri C, Ward AE, Nepogodiev D, Ahmed I, Chaudhry D, Dhaif F, et al. Outcomes after perioperative SARS-CoV-2 infection in patients with proximal femoral fractures: an international cohort study. BMJ Open. 2021;11: e050830.
Glasbey JC, Nepogodiev D, Omar O, Simoes JFF, Ademuyiwa A, Fiore M, et al. Delaying surgery for patients with a previous SARS-CoV-2 infection. Br J Surg. 2020;107:e601–2.
Bass GA, Gillis A, Cao Y, Mohseni S, Shamiyeh A, Rosetti L, et al. Patterns of prevalence and contemporary clinical management strategies in complicated acute biliary calculous disease: an ESTES ‘snapshot audit’ of practice. Eur J Trauma Emerg S. 2022;48:23–35.
Group 2015 European Society of Coloproctology collaborating. Risk factors for unfavourable postoperative outcome in patients with Crohn’s disease undergoing right hemicolectomy or ileocaecal resection. An international audit by ESCP and S-ECCO. Colorectal Dis. 2018;20:219–27.
Baethge C, Goldbeck-Wood S, Mertens S. SANRA—a scale for the quality assessment of narrative review articles. Res Integr Peer Rev. 2019;4:5.
Bothwell LE, Greene JA, Podolsky SH, Jones DS. Assessing the gold standard — lessons from the history of RCTs. New Engl J Med. 2016;374:2175–81.
Bhatt A. Evolution of clinical research: a history before and beyond james lind. Perspect Clin Res. 2010;1:6–10.
Aitken R, Nixon S, Ruckley C. Lothian surgical audit: a 15-year experience of improvement in surgical practice through regional computerised audit. Lancet. 1997;350:800–4.
Smyth LG, Martin Z, Hall B, Collins D, Mealy K. Time to audit. Irish J Med Sci. 2012;181:297–300.
Dikki PE, Crofts TJ, Nixon SJ, Aitken RJ. Consultant supervision of surgical trainees: an objective assessment of how much actually occurs. Ann Roy Coll Surg. 1999;81:73–5.
Sedgwick DM, Barton JR, Hamer-Hodges DW, Nixon SJ, Ferguson A. Population-based study of surgery in juvenile onset ulcerative colitis. Brit J Surg. 1991;78:176–8.
Bass G, Fleming C, Conneely J, Martin Z, Mealy K. Emergency first presentation of colorectal cancer predicts significantly poorer outcomes. Dis Colon Rectum. 2009;52:678–84.
Herb J, Wolff R, McDaniel P, Holmes M, Lund J, Stitzenberg K. Rural representation of the surveillance, epidemiology, and end results database. Cancer Cause Control. 2021;32:211–20.
Mettlin CJ, Menck HR, Winchester DP, Murphy GP. A comparison of breast, colorectal, lung, and prostate cancers reported to the National cancer data base and the surveillance, epidemiology, and end results program. Cancer. 1997;79:2052–61.
Duggan EM, Gates DW, Slayton JM, Blakely ML. Is NSQIP Pediatric review representative of total institutional experience for children undergoing appendectomy? J Pediatr Surg. 2014;49:1292–4.
Ellison J, Chakravorty D, Conly J, Kim J, Litvinchuk S, Pokhrel A, et al. Comparison of matched patient data for ssis following total hip and total knee arthoplasty: IPC versus NSQIP surveillance. Infect Control Hosp Epidemiol. 2020;41:s177–8.
Shorthouse AJ, Nicholls RJ. A history of the European society of coloproctology. Colorectal Dis. 2020;22:1035–75.
Group T 2017 ES of C (ESCP) C. The. European society of coloproctology (ESCP) international snapshot audit of left colon, sigmoid and rectal resections - executive summary. Colorectal Dis. 2017;2018(20):13–4.
Committee ECS, The A. European society of coloproctology (ESCP) international snapshot audit of left colon, sigmoid and rectal resections – study protocol. Colorectal Dis. 2017;2018(20):5–12.
Group T 2017 ES of C (ESCP) collaborating. An international multicentre prospective audit of elective rectal cancer surgery; operative approach versus outcome, including transanal total mesorectal excision (TaTME). Colorectal Dis. 2018;20:33–46.
Bass GA, Gillis AE, Cao Y, Mohseni S, Group ES for T and ES (ESTES) CS, Shamiyeh A, et al. Self-reported and actual adherence to the Tokyo guidelines in the European snapshot audit of complicated calculous biliary disease. BJS Open. 2020;4:622–9.
Bass GA, Gillis AE, Cao Y, Mohseni S, Shamiyeh A, Rosetti L, et al. Patients over 65 years with acute complicated calculous biliary disease are treated differently—results and insights from the ESTES snapshot audit. World J Surg. 2021;45:2046–55.
Nepogodiev D, Omar OM, Glasbey JC, Li E, Simoes JFF, Abbott TEF, et al. Elective surgery cancellations due to the COVID-19 pandemic: global predictive modelling to inform surgical recovery plans. Br J Surg. 2020;107:1440–9.
Glasbey JC, Omar O, Nepogodiev D, Minaya-Bravo A, Bankhead-Kendall BK, Fiore M, et al. Preoperative nasopharyngeal swab testing and postoperative pulmonary complications in patients undergoing elective surgery during the SARS-CoV-2 pandemic. Br J Surg. 2020;108:88–96.
Collaborative Covids, Bhangu A, Lawani I, Ng-Kamstra JS, Wang Y, Chan A, et al. Global guidance for surgical care during the COVID-19 pandemic. Br J Surg. 2020;107:1097–103.
Collaborative Covids, Dajti I, Valenzuela JI, Boccalatte LA, Gemelli NA, Smith DE, et al. Machine learning risk prediction of mortality for patients undergoing surgery with perioperative SARS-CoV-2: the COVIDSurg mortality score. Br J Surg. 2021;108:1274–92.
Collaborative StarsC and Covids, McLean KA, Kamarajah SK, Chaudhry D, Gujjuri RR, Raubenheimer K, et al. Death following pulmonary complications of surgery before and during the SARS-CoV-2 pandemic. Brit J Surg. 2021;108:1448–64.
Esteban A, Anzueto A, Frutos F, Alía I, Brochard L, Stewart TE, et al. Characteristics and outcomes in adult patients receiving mechanical ventilation: a 28-day international study. JAMA. 2002;287:345–55.
Esteban A, Frutos-Vivar F, Muriel A, Ferguson ND, Peñuelas O, Abraira V, et al. Evolution of mortality over time in patients receiving mechanical ventilation. Am J Resp Crit Care. 2013;188:220–30.
Ruiz-Tovar J, Boermeester MA, Bordeianou L, Chang GJ, Gorgun E, Justinger C, et al. Delphi consensus on intraoperative technical/surgical aspects to prevent surgical site infection after colorectal surgery. J Am Coll Surg. 2022;234:1–11.
Jünger S, Payne SA, Brine J, Radbruch L, Brearley SG. Guidance on conducting and REporting DElphi studies (CREDES) in palliative care: recommendations based on a methodological systematic review. Palliat Med. 2017;31:684–706.
Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O’Neal L, et al. The REDCap consortium: building an international community of software platform partners. J Biomed Inform. 2019;95: 103208.
Group T 2017 ES of C (ESCP) collaborating. Safety of primary anastomosis following emergency left sided colorectal resection: an international, multi-centre prospective audit. Colorectal Dis. 2018;20:47–57.
Thoral PJ, Peppink JM, Driessen RH, Sijbrands EJG, Kompanje EJO, Kaplan L, et al. Sharing ICU patient data responsibly under the society of critical care medicine/European society of intensive care medicine joint data science collaboration: the Amsterdam university medical centers database (AmsterdamUMCdb) example*. Crit Care Med. 2021;49:e563–77.
Ademuyiwa AO, Arnaud AP, Drake TM, Fitzgerald JEF, Poenaru D, Bhangu A, et al. Determinants of morbidity and mortality following emergency abdominal surgery in children in low-income and middle-income countries. BMJ Global Heal. 2016;1: e000091.
Smart NJ, Nilsson PJESCP. Snapshot audit - editorial. Colorectal Dis. 2017;2018(20):3–3.
Florio G, Ferrari M, Bittner EA, Santiago RDS, Pirrone M, Fumagalli J, et al. A lung rescue team improves survival in obesity with acute respiratory distress syndrome. Crit Care. 2020;24:4.
Evans L, Rhodes A, Alhazzani W, Antonelli M, Coopersmith CM, French C, et al. Surviving sepsis campaign: international guidelines for management of sepsis and septic shock 2021. Crit Care Med. 2021;49:e1063–143.
(ICJME) IC of MJE. Defining the Role of Authors and Contributors [Internet]. [cited 2022 Mar 10]. Available from: http://www.icmje.org/recommendations/browse/roles-and-responsibilities/defining-the-role-of-authors-and-contributors.html
Group CrI. Contributor Roles Taxonomy (CReDIT) [Internet]. [cited 2022 Feb 22]. Available from: https://credit.niso.org/
O’Connor AM. Interpretation of odds and risk ratios. J Vet Intern Med. 2013;27:600–3.
Ning J, Hong C, Li L, Huang X, Shen Y. Estimating treatment effects in observational studies with both prevalent and incident cohorts. Can J Statistics. 2017;45:202–19.
Leisman DE. Ten pearls and pitfalls of propensity scores in critical care research. Crit Care Med. 2019;47:176–85.
Lederer DJ, Bell SC, Branson RD, Chalmers JD, Marshall R, Maslove DM, et al. Control of confounding and reporting of results in causal inference studies. Guidance for authors from editors of respiratory, sleep, and critical care journals. Ann Am Thorac Soc. 2018;16:22–8.
Nepogodiev D, Bhangu A, Glasbey JC, Li E, Omar OM, Simoes JF, et al. Mortality and pulmonary complications in patients undergoing surgery with perioperative SARS-CoV-2 infection: an international cohort study. Lancet Lond Engl. 2020;396:27–38.
Glasbey JC, Nepogodiev D, Simoes JFF, Omar O, Li E, Venn ML, et al. Elective cancer surgery in COVID-19–free surgical pathways during the SARS-CoV-2 pandemic: an international, multicenter, comparative cohort study. J Clin Oncol. 2021;39:66–78.
Nepogodiev D, Abbott TE, Ademuyiwa AO, AlAmeer E, Bankhead-Kendall BK, Biccard BM, et al. Projecting COVID-19 disruption to elective surgery. Lancet Lond Engl. 2022;399:233–4.
Collaborative Covid, Collaborative G, Nepogodiev D, Simoes JF, Li E, Picciochi M, et al. Timing of surgery following SARS-CoV-2 infection: an international prospective cohort study. Anaesthesia. 2021;76:748–58.
Harai S, Mochizuki H, Kojima Y, Nakagomi K, Yoshimura D, Takaoka S, et al. Validation of Tokyo guideline 2013 as treatment of acute cholecystitis by real world data. Digest Dis. 2019;37:303–8.
Lee S, Yang S, Chang C, Yeh H. Impact of the Tokyo guidelines on the management of patients with acute calculous cholecystitis. J Gastroen Hepatol. 2009;24:1857–61.
Giles AE, Godzisz S, Nenshi R, Forbes S, Farrokhyar F, Lee J, et al. Diagnosis and management of acute cholecystitis: a single-centre audit of guideline adherence and patient outcomes. Can J Surg. 2020;63:E241–9.
Murphy PB, Paskar D, Hilsden R, Koichopolos J, Mele TS, Surgery WORC on AC. Acute care surgery: a means for providing cost-effective, quality care for gallstone pancreatitis. World J Emerg Surg WJES. 2017;12:20.
Han J, Spigelman AD. Adherence to guidelines for the referral of patients with colorectal cancer and abnormal tumour tissue testing for assessment of Lynch syndrome. Anz J Surg. 2019;89:1281–5.
Murphy PB, Paskar D, Parry NG, Racz J, Vogt KN, Symonette C, et al. Implementation of an acute care surgery service facilitates modern clinical practice guidelines for gallstone pancreatitis. J Am Coll Surg. 2015;221:975–81.
Tarasconi A, Perrone G, Davies J, Coimbra R, Moore E, Azzaroli F, et al. Anorectal emergencies: WSES-AAST guidelines. World J Emerg Surg Wjes. 2021;16:48.
Chirica M, Kelly MD, Siboni S, Aiolfi A, Riva CG, Asti E, et al. Esophageal emergencies: WSES guidelines. World J Emerg Surg WJES. 2019;14:26.
Tarasconi A, Coccolini F, Biffl WL, Tomasoni M, Ansaloni L, Picetti E, et al. Perforated and bleeding peptic ulcer: WSES guidelines. World J Emerg Surg WJES. 2020;15:3.
Mayumi T, Okamoto K, Takada T, Strasberg SM, Solomkin JS, Schlossberg D, et al. Tokyo guidelines 2018: management bundles for acute cholangitis and cholecystitis. J Hepato-bil-pan Sci. 2018;25:96–100.
Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud P-AC, et al. Why don’t physicians follow clinical practice guidelines? A framework for improvement. Jama. 1999;282:1458–65.
Adams A, Soumerai S, Lomas J, Ross-Degnan D. Evidence of self-report bias in assessing adherence to guidelines. Int J Qual Health C. 1999;11:187–92.
Lugtenberg M, Schaick JMZ, Westert GP, Burgers JS. Why don’t physicians adhere to guideline recommendations in practice? An analysis of barriers among Dutch general practitioners. Implement Sci. 2009;4:54–54.
Casey DE. Why don’t physicians (and patients) consistently follow clinical practice guidelines? comment on “worsening trends in the management and treatment of back pain.” Jama Intern Med. 2013;173:1581–3.
Lane-Fall MB, Fleisher LA. Quality improvement and implementation science: different fields with aligned goals. Anesthesiol Clin. 2018. https://doi.org/10.1016/j.anclin.2017.12.001.
Townsend SR, Rivers EP, Duseja R. Centers for medicare and medicaid services measure stewards’ assessment of the infectious diseases society of america’s position paper on SEP-1. Clin Infect Dis. 2020;72:553–5.
Barbash IJ, Davis B, Kahn JM. National performance on the medicare SEP-1 sepsis quality measure. Crit Care Med. 2018. https://doi.org/10.1097/CCM.0000000000003613.
Kane-Gill SL, Winkle J, Kaplan LJ, Nadkarni V, Sorce LR, Harmon L, et al. SCCM/ACCM guideline and toolkit development pathways. Crit Care Med. 2021;49:1851–4.
Lewis CC, Mettert KD, Dorsey CN, Martinez RG, Weiner BJ, Nolen E, et al. An updated protocol for a systematic review of implementation-related measures. Syst Rev. 2018;7:66.
van Bodegom-Vos L, Davidoff F, de Mheen PJM. Implementation and de-implementation: two sides of the same coin? Bmj Qual Saf. 2017;26:495.
Glasgow RE, Estabrooks PA, Ory MG. Characterizing evolving frameworks: issues from Esmail, et al. (2020) review. Implement Sci. 2020;15:53.
Glasgow RE, Phillips SM, Sanchez MA. Implementation science approaches for integrating eHealth research into practice and policy. Int J Med Inform. 2014;83:e1-11.
McNeal DM, Glasgow RE, Brownson RC, Matlock DD, Peterson PN, Daugherty SL, et al. Perspectives of scientists on disseminating research findings to non-research audiences. J Clin Transl Sci. 2020;5: e61.
Brooke BS, Finlayson SRG. What surgeons can learn from the emerging science of implementation. Jama Surg. 2015;150:1006–7.
Lane-Fall MB, Fleisher LA. Quality improvement and implementation science. Anesthesiol Clin. 2018;36:i.
Lane-Fall MB, Cobb BT, Cené CW, Beidas RS. Implementation science in perioperative care. Anesthesiol Clin. 2018;36:1–15.
Lane-Fall MB, Curran GM, Beidas RS. Scoping implementation science for the beginner: locating yourself on the “subway line” of translational research. Bmc Med Res Methodol. 2019;19:133.
Glasziou P, Haynes B. The paths from research to improved health outcomes. Évid Based Medicine. 2005;10:4.
White H. Theory-based systematic reviews. J Dev Effect. 2018;10:17–38.
Funding
Dr. Lane-Fall reported grant support from the NIH (3R01HL153735-02S1, 5P30AG059302-04, 1U01OD033246-01, 1R01HD105446-01), Agency for Healthcare Research and Quality (AHRQ; 5K12HS026372-04), and PCORI (21,106). Dr Vail reported grant support from Agency for Healthcare Research and Quality (AHRQ; Agency for Healthcare Research and Quality (AHRQ; K12HS026372).
Author information
Authors and Affiliations
Contributions
GAB, SM, and LJK conceived the idea for the study; GAB and EJR collected the data; GAB and YC analyzed the data; GAB, SM, LJK, CCD, EAV, IM and MLF wrote the manuscript, and the final version was reviewed and approved by all authors. The diverse international authorship brought together expertise in surgical outcomes research, biostatistics, study methodology and implementation science.
Corresponding author
Ethics declarations
Conflict of interest
The authors have no conflict of interest to report. No funding was received for the execution of the current study.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Bass, G.A., Kaplan, L.J., Ryan, É.J. et al. The snapshot audit methodology: design, implementation and analysis of prospective observational cohort studies in surgery. Eur J Trauma Emerg Surg 49, 5–15 (2023). https://doi.org/10.1007/s00068-022-02045-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00068-022-02045-3