Skip to main content

Advertisement

Log in

The snapshot audit methodology: design, implementation and analysis of prospective observational cohort studies in surgery

  • Original Article
  • Published:
European Journal of Trauma and Emergency Surgery Aims and scope Submit manuscript

Abstract

Purpose

For some surgical conditionns and scientific questions, the “real world” effectiveness of surgical patient care may be better explored using a multi-institutional time-bound observational cohort assessment approach (termed a “snapshot audit”) than by retrospective review of administrative datasets or by prospective randomized control trials. We discuss when this might be the case, and present the key features of developing, deploying, and assessing snapshot audit outcomes data.

Methods

A narrative review of snapshot audit methodology was generated using the Scale for the Assessment of Narrative Review Articles (SANRA) guideline. Manuscripts were selected from domains including: audit design and deployment, statistical analysis, surgical therapy and technique, surgical outcomes, diagnostic testing, critical care management, concomitant non-surgical disease, implementation science, and guideline compliance.

Results

Snapshot audits all conform to a similar structure: being time-bound, non-interventional, and multi-institutional. A successful diverse steering committee will leverage expertise that includes clinical care and data science, coupled with librarian services. Pre-published protocols (with specified aims and analyses) greatly helps site recruitment. Mentored trainee involvement at collaborating sites should be encouraged through manuscript contributorship. Current funding principally flows from medical professional organizations.

Conclusion

The snapshot audit approach to assessing current care provides insights into care delivery, outcomes, and guideline compliance while generating testable hypotheses.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

References

  1. Mason SE, Scott AJ, Markar SR, Clarke JM, Martin G, Beatty JW, et al. Insights from a global snapshot of the change in elective colorectal practice due to the COVID-19 pandemic. PLoS ONE. 2020;15: e0240397.

    CAS  PubMed  PubMed Central  Google Scholar 

  2. Khatri C, Ward AE, Nepogodiev D, Ahmed I, Chaudhry D, Dhaif F, et al. Outcomes after perioperative SARS-CoV-2 infection in patients with proximal femoral fractures: an international cohort study. BMJ Open. 2021;11: e050830.

    Google Scholar 

  3. Glasbey JC, Nepogodiev D, Omar O, Simoes JFF, Ademuyiwa A, Fiore M, et al. Delaying surgery for patients with a previous SARS-CoV-2 infection. Br J Surg. 2020;107:e601–2.

    Google Scholar 

  4. Bass GA, Gillis A, Cao Y, Mohseni S, Shamiyeh A, Rosetti L, et al. Patterns of prevalence and contemporary clinical management strategies in complicated acute biliary calculous disease: an ESTES ‘snapshot audit’ of practice. Eur J Trauma Emerg S. 2022;48:23–35.

    Google Scholar 

  5. Group 2015 European Society of Coloproctology collaborating. Risk factors for unfavourable postoperative outcome in patients with Crohn’s disease undergoing right hemicolectomy or ileocaecal resection. An international audit by ESCP and S-ECCO. Colorectal Dis. 2018;20:219–27.

    Google Scholar 

  6. Baethge C, Goldbeck-Wood S, Mertens S. SANRA—a scale for the quality assessment of narrative review articles. Res Integr Peer Rev. 2019;4:5.

    PubMed  PubMed Central  Google Scholar 

  7. Bothwell LE, Greene JA, Podolsky SH, Jones DS. Assessing the gold standard — lessons from the history of RCTs. New Engl J Med. 2016;374:2175–81.

    CAS  PubMed  Google Scholar 

  8. Bhatt A. Evolution of clinical research: a history before and beyond james lind. Perspect Clin Res. 2010;1:6–10.

    PubMed  PubMed Central  Google Scholar 

  9. Aitken R, Nixon S, Ruckley C. Lothian surgical audit: a 15-year experience of improvement in surgical practice through regional computerised audit. Lancet. 1997;350:800–4.

    CAS  PubMed  Google Scholar 

  10. Smyth LG, Martin Z, Hall B, Collins D, Mealy K. Time to audit. Irish J Med Sci. 2012;181:297–300.

    CAS  PubMed  Google Scholar 

  11. Dikki PE, Crofts TJ, Nixon SJ, Aitken RJ. Consultant supervision of surgical trainees: an objective assessment of how much actually occurs. Ann Roy Coll Surg. 1999;81:73–5.

    CAS  Google Scholar 

  12. Sedgwick DM, Barton JR, Hamer-Hodges DW, Nixon SJ, Ferguson A. Population-based study of surgery in juvenile onset ulcerative colitis. Brit J Surg. 1991;78:176–8.

    CAS  PubMed  Google Scholar 

  13. Bass G, Fleming C, Conneely J, Martin Z, Mealy K. Emergency first presentation of colorectal cancer predicts significantly poorer outcomes. Dis Colon Rectum. 2009;52:678–84.

    PubMed  Google Scholar 

  14. Herb J, Wolff R, McDaniel P, Holmes M, Lund J, Stitzenberg K. Rural representation of the surveillance, epidemiology, and end results database. Cancer Cause Control. 2021;32:211–20.

    Google Scholar 

  15. Mettlin CJ, Menck HR, Winchester DP, Murphy GP. A comparison of breast, colorectal, lung, and prostate cancers reported to the National cancer data base and the surveillance, epidemiology, and end results program. Cancer. 1997;79:2052–61.

    CAS  PubMed  Google Scholar 

  16. Duggan EM, Gates DW, Slayton JM, Blakely ML. Is NSQIP Pediatric review representative of total institutional experience for children undergoing appendectomy? J Pediatr Surg. 2014;49:1292–4.

    PubMed  Google Scholar 

  17. Ellison J, Chakravorty D, Conly J, Kim J, Litvinchuk S, Pokhrel A, et al. Comparison of matched patient data for ssis following total hip and total knee arthoplasty: IPC versus NSQIP surveillance. Infect Control Hosp Epidemiol. 2020;41:s177–8.

    Google Scholar 

  18. Shorthouse AJ, Nicholls RJ. A history of the European society of coloproctology. Colorectal Dis. 2020;22:1035–75.

    PubMed  PubMed Central  Google Scholar 

  19. Group T 2017 ES of C (ESCP) C. The. European society of coloproctology (ESCP) international snapshot audit of left colon, sigmoid and rectal resections - executive summary. Colorectal Dis. 2017;2018(20):13–4.

    Google Scholar 

  20. Committee ECS, The A. European society of coloproctology (ESCP) international snapshot audit of left colon, sigmoid and rectal resections – study protocol. Colorectal Dis. 2017;2018(20):5–12.

    Google Scholar 

  21. Group T 2017 ES of C (ESCP) collaborating. An international multicentre prospective audit of elective rectal cancer surgery; operative approach versus outcome, including transanal total mesorectal excision (TaTME). Colorectal Dis. 2018;20:33–46.

    Google Scholar 

  22. Bass GA, Gillis AE, Cao Y, Mohseni S, Group ES for T and ES (ESTES) CS, Shamiyeh A, et al. Self-reported and actual adherence to the Tokyo guidelines in the European snapshot audit of complicated calculous biliary disease. BJS Open. 2020;4:622–9.

    CAS  PubMed  PubMed Central  Google Scholar 

  23. Bass GA, Gillis AE, Cao Y, Mohseni S, Shamiyeh A, Rosetti L, et al. Patients over 65 years with acute complicated calculous biliary disease are treated differently—results and insights from the ESTES snapshot audit. World J Surg. 2021;45:2046–55.

    PubMed  PubMed Central  Google Scholar 

  24. Nepogodiev D, Omar OM, Glasbey JC, Li E, Simoes JFF, Abbott TEF, et al. Elective surgery cancellations due to the COVID-19 pandemic: global predictive modelling to inform surgical recovery plans. Br J Surg. 2020;107:1440–9.

    Google Scholar 

  25. Glasbey JC, Omar O, Nepogodiev D, Minaya-Bravo A, Bankhead-Kendall BK, Fiore M, et al. Preoperative nasopharyngeal swab testing and postoperative pulmonary complications in patients undergoing elective surgery during the SARS-CoV-2 pandemic. Br J Surg. 2020;108:88–96.

    Google Scholar 

  26. Collaborative Covids, Bhangu A, Lawani I, Ng-Kamstra JS, Wang Y, Chan A, et al. Global guidance for surgical care during the COVID-19 pandemic. Br J Surg. 2020;107:1097–103.

    Google Scholar 

  27. Collaborative Covids, Dajti I, Valenzuela JI, Boccalatte LA, Gemelli NA, Smith DE, et al. Machine learning risk prediction of mortality for patients undergoing surgery with perioperative SARS-CoV-2: the COVIDSurg mortality score. Br J Surg. 2021;108:1274–92.

    Google Scholar 

  28. Collaborative StarsC and Covids, McLean KA, Kamarajah SK, Chaudhry D, Gujjuri RR, Raubenheimer K, et al. Death following pulmonary complications of surgery before and during the SARS-CoV-2 pandemic. Brit J Surg. 2021;108:1448–64.

    Google Scholar 

  29. Esteban A, Anzueto A, Frutos F, Alía I, Brochard L, Stewart TE, et al. Characteristics and outcomes in adult patients receiving mechanical ventilation: a 28-day international study. JAMA. 2002;287:345–55.

    PubMed  Google Scholar 

  30. Esteban A, Frutos-Vivar F, Muriel A, Ferguson ND, Peñuelas O, Abraira V, et al. Evolution of mortality over time in patients receiving mechanical ventilation. Am J Resp Crit Care. 2013;188:220–30.

    Google Scholar 

  31. Ruiz-Tovar J, Boermeester MA, Bordeianou L, Chang GJ, Gorgun E, Justinger C, et al. Delphi consensus on intraoperative technical/surgical aspects to prevent surgical site infection after colorectal surgery. J Am Coll Surg. 2022;234:1–11.

    PubMed  PubMed Central  Google Scholar 

  32. Jünger S, Payne SA, Brine J, Radbruch L, Brearley SG. Guidance on conducting and REporting DElphi studies (CREDES) in palliative care: recommendations based on a methodological systematic review. Palliat Med. 2017;31:684–706.

    PubMed  Google Scholar 

  33. Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O’Neal L, et al. The REDCap consortium: building an international community of software platform partners. J Biomed Inform. 2019;95: 103208.

    PubMed  PubMed Central  Google Scholar 

  34. Group T 2017 ES of C (ESCP) collaborating. Safety of primary anastomosis following emergency left sided colorectal resection: an international, multi-centre prospective audit. Colorectal Dis. 2018;20:47–57.

    Google Scholar 

  35. Thoral PJ, Peppink JM, Driessen RH, Sijbrands EJG, Kompanje EJO, Kaplan L, et al. Sharing ICU patient data responsibly under the society of critical care medicine/European society of intensive care medicine joint data science collaboration: the Amsterdam university medical centers database (AmsterdamUMCdb) example*. Crit Care Med. 2021;49:e563–77.

    PubMed  PubMed Central  Google Scholar 

  36. Ademuyiwa AO, Arnaud AP, Drake TM, Fitzgerald JEF, Poenaru D, Bhangu A, et al. Determinants of morbidity and mortality following emergency abdominal surgery in children in low-income and middle-income countries. BMJ Global Heal. 2016;1: e000091.

    Google Scholar 

  37. Smart NJ, Nilsson PJESCP. Snapshot audit - editorial. Colorectal Dis. 2017;2018(20):3–3.

    Google Scholar 

  38. Florio G, Ferrari M, Bittner EA, Santiago RDS, Pirrone M, Fumagalli J, et al. A lung rescue team improves survival in obesity with acute respiratory distress syndrome. Crit Care. 2020;24:4.

    PubMed  PubMed Central  Google Scholar 

  39. Evans L, Rhodes A, Alhazzani W, Antonelli M, Coopersmith CM, French C, et al. Surviving sepsis campaign: international guidelines for management of sepsis and septic shock 2021. Crit Care Med. 2021;49:e1063–143.

    PubMed  Google Scholar 

  40. (ICJME) IC of MJE. Defining the Role of Authors and Contributors [Internet]. [cited 2022 Mar 10]. Available from: http://www.icmje.org/recommendations/browse/roles-and-responsibilities/defining-the-role-of-authors-and-contributors.html

  41. Group CrI. Contributor Roles Taxonomy (CReDIT) [Internet]. [cited 2022 Feb 22]. Available from: https://credit.niso.org/

  42. O’Connor AM. Interpretation of odds and risk ratios. J Vet Intern Med. 2013;27:600–3.

    PubMed  Google Scholar 

  43. Ning J, Hong C, Li L, Huang X, Shen Y. Estimating treatment effects in observational studies with both prevalent and incident cohorts. Can J Statistics. 2017;45:202–19.

    Google Scholar 

  44. Leisman DE. Ten pearls and pitfalls of propensity scores in critical care research. Crit Care Med. 2019;47:176–85.

    PubMed  Google Scholar 

  45. Lederer DJ, Bell SC, Branson RD, Chalmers JD, Marshall R, Maslove DM, et al. Control of confounding and reporting of results in causal inference studies. Guidance for authors from editors of respiratory, sleep, and critical care journals. Ann Am Thorac Soc. 2018;16:22–8.

    Google Scholar 

  46. Nepogodiev D, Bhangu A, Glasbey JC, Li E, Omar OM, Simoes JF, et al. Mortality and pulmonary complications in patients undergoing surgery with perioperative SARS-CoV-2 infection: an international cohort study. Lancet Lond Engl. 2020;396:27–38.

    Google Scholar 

  47. Glasbey JC, Nepogodiev D, Simoes JFF, Omar O, Li E, Venn ML, et al. Elective cancer surgery in COVID-19–free surgical pathways during the SARS-CoV-2 pandemic: an international, multicenter, comparative cohort study. J Clin Oncol. 2021;39:66–78.

    CAS  PubMed  Google Scholar 

  48. Nepogodiev D, Abbott TE, Ademuyiwa AO, AlAmeer E, Bankhead-Kendall BK, Biccard BM, et al. Projecting COVID-19 disruption to elective surgery. Lancet Lond Engl. 2022;399:233–4.

    Google Scholar 

  49. Collaborative Covid, Collaborative G, Nepogodiev D, Simoes JF, Li E, Picciochi M, et al. Timing of surgery following SARS-CoV-2 infection: an international prospective cohort study. Anaesthesia. 2021;76:748–58.

    Google Scholar 

  50. Harai S, Mochizuki H, Kojima Y, Nakagomi K, Yoshimura D, Takaoka S, et al. Validation of Tokyo guideline 2013 as treatment of acute cholecystitis by real world data. Digest Dis. 2019;37:303–8.

    Google Scholar 

  51. Lee S, Yang S, Chang C, Yeh H. Impact of the Tokyo guidelines on the management of patients with acute calculous cholecystitis. J Gastroen Hepatol. 2009;24:1857–61.

    Google Scholar 

  52. Giles AE, Godzisz S, Nenshi R, Forbes S, Farrokhyar F, Lee J, et al. Diagnosis and management of acute cholecystitis: a single-centre audit of guideline adherence and patient outcomes. Can J Surg. 2020;63:E241–9.

    PubMed  PubMed Central  Google Scholar 

  53. Murphy PB, Paskar D, Hilsden R, Koichopolos J, Mele TS, Surgery WORC on AC. Acute care surgery: a means for providing cost-effective, quality care for gallstone pancreatitis. World J Emerg Surg WJES. 2017;12:20.

    PubMed  Google Scholar 

  54. Han J, Spigelman AD. Adherence to guidelines for the referral of patients with colorectal cancer and abnormal tumour tissue testing for assessment of Lynch syndrome. Anz J Surg. 2019;89:1281–5.

    PubMed  Google Scholar 

  55. Murphy PB, Paskar D, Parry NG, Racz J, Vogt KN, Symonette C, et al. Implementation of an acute care surgery service facilitates modern clinical practice guidelines for gallstone pancreatitis. J Am Coll Surg. 2015;221:975–81.

    PubMed  Google Scholar 

  56. Tarasconi A, Perrone G, Davies J, Coimbra R, Moore E, Azzaroli F, et al. Anorectal emergencies: WSES-AAST guidelines. World J Emerg Surg Wjes. 2021;16:48.

    PubMed  Google Scholar 

  57. Chirica M, Kelly MD, Siboni S, Aiolfi A, Riva CG, Asti E, et al. Esophageal emergencies: WSES guidelines. World J Emerg Surg WJES. 2019;14:26.

    PubMed  Google Scholar 

  58. Tarasconi A, Coccolini F, Biffl WL, Tomasoni M, Ansaloni L, Picetti E, et al. Perforated and bleeding peptic ulcer: WSES guidelines. World J Emerg Surg WJES. 2020;15:3.

    PubMed  Google Scholar 

  59. Mayumi T, Okamoto K, Takada T, Strasberg SM, Solomkin JS, Schlossberg D, et al. Tokyo guidelines 2018: management bundles for acute cholangitis and cholecystitis. J Hepato-bil-pan Sci. 2018;25:96–100.

    Google Scholar 

  60. Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud P-AC, et al. Why don’t physicians follow clinical practice guidelines? A framework for improvement. Jama. 1999;282:1458–65.

    CAS  PubMed  Google Scholar 

  61. Adams A, Soumerai S, Lomas J, Ross-Degnan D. Evidence of self-report bias in assessing adherence to guidelines. Int J Qual Health C. 1999;11:187–92.

    CAS  Google Scholar 

  62. Lugtenberg M, Schaick JMZ, Westert GP, Burgers JS. Why don’t physicians adhere to guideline recommendations in practice? An analysis of barriers among Dutch general practitioners. Implement Sci. 2009;4:54–54.

    PubMed  PubMed Central  Google Scholar 

  63. Casey DE. Why don’t physicians (and patients) consistently follow clinical practice guidelines? comment on “worsening trends in the management and treatment of back pain.” Jama Intern Med. 2013;173:1581–3.

    PubMed  Google Scholar 

  64. Lane-Fall MB, Fleisher LA. Quality improvement and implementation science: different fields with aligned goals. Anesthesiol Clin. 2018. https://doi.org/10.1016/j.anclin.2017.12.001.

    Article  PubMed  PubMed Central  Google Scholar 

  65. Townsend SR, Rivers EP, Duseja R. Centers for medicare and medicaid services measure stewards’ assessment of the infectious diseases society of america’s position paper on SEP-1. Clin Infect Dis. 2020;72:553–5.

    Google Scholar 

  66. Barbash IJ, Davis B, Kahn JM. National performance on the medicare SEP-1 sepsis quality measure. Crit Care Med. 2018. https://doi.org/10.1097/CCM.0000000000003613.

    Article  Google Scholar 

  67. Kane-Gill SL, Winkle J, Kaplan LJ, Nadkarni V, Sorce LR, Harmon L, et al. SCCM/ACCM guideline and toolkit development pathways. Crit Care Med. 2021;49:1851–4.

    PubMed  Google Scholar 

  68. Lewis CC, Mettert KD, Dorsey CN, Martinez RG, Weiner BJ, Nolen E, et al. An updated protocol for a systematic review of implementation-related measures. Syst Rev. 2018;7:66.

    PubMed  PubMed Central  Google Scholar 

  69. van Bodegom-Vos L, Davidoff F, de Mheen PJM. Implementation and de-implementation: two sides of the same coin? Bmj Qual Saf. 2017;26:495.

    PubMed  Google Scholar 

  70. Glasgow RE, Estabrooks PA, Ory MG. Characterizing evolving frameworks: issues from Esmail, et al. (2020) review. Implement Sci. 2020;15:53.

    PubMed  PubMed Central  Google Scholar 

  71. Glasgow RE, Phillips SM, Sanchez MA. Implementation science approaches for integrating eHealth research into practice and policy. Int J Med Inform. 2014;83:e1-11.

    PubMed  Google Scholar 

  72. McNeal DM, Glasgow RE, Brownson RC, Matlock DD, Peterson PN, Daugherty SL, et al. Perspectives of scientists on disseminating research findings to non-research audiences. J Clin Transl Sci. 2020;5: e61.

    PubMed  PubMed Central  Google Scholar 

  73. Brooke BS, Finlayson SRG. What surgeons can learn from the emerging science of implementation. Jama Surg. 2015;150:1006–7.

    PubMed  Google Scholar 

  74. Lane-Fall MB, Fleisher LA. Quality improvement and implementation science. Anesthesiol Clin. 2018;36:i.

    Google Scholar 

  75. Lane-Fall MB, Cobb BT, Cené CW, Beidas RS. Implementation science in perioperative care. Anesthesiol Clin. 2018;36:1–15.

    PubMed  PubMed Central  Google Scholar 

  76. Lane-Fall MB, Curran GM, Beidas RS. Scoping implementation science for the beginner: locating yourself on the “subway line” of translational research. Bmc Med Res Methodol. 2019;19:133.

    PubMed  PubMed Central  Google Scholar 

  77. Glasziou P, Haynes B. The paths from research to improved health outcomes. Évid Based Medicine. 2005;10:4.

    Google Scholar 

  78. White H. Theory-based systematic reviews. J Dev Effect. 2018;10:17–38.

    Google Scholar 

Download references

Funding

Dr. Lane-Fall reported grant support from the NIH (3R01HL153735-02S1, 5P30AG059302-04, 1U01OD033246-01, 1R01HD105446-01), Agency for Healthcare Research and Quality (AHRQ; 5K12HS026372-04), and PCORI (21,106). Dr Vail reported grant support from Agency for Healthcare Research and Quality (AHRQ; Agency for Healthcare Research and Quality (AHRQ; K12HS026372).

Author information

Authors and Affiliations

Authors

Contributions

GAB, SM, and LJK conceived the idea for the study; GAB and EJR collected the data; GAB and YC analyzed the data; GAB, SM, LJK, CCD, EAV, IM and MLF wrote the manuscript, and the final version was reviewed and approved by all authors. The diverse international authorship brought together expertise in surgical outcomes research, biostatistics, study methodology and implementation science.

Corresponding author

Correspondence to Gary A. Bass.

Ethics declarations

Conflict of interest

The authors have no conflict of interest to report. No funding was received for the execution of the current study.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary file1 (DOCX 19 KB)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Bass, G.A., Kaplan, L.J., Ryan, É.J. et al. The snapshot audit methodology: design, implementation and analysis of prospective observational cohort studies in surgery. Eur J Trauma Emerg Surg 49, 5–15 (2023). https://doi.org/10.1007/s00068-022-02045-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00068-022-02045-3

Keywords

Navigation