Skip to main content

Advertisement

Log in

Bellwether Procedures for Monitoring Subnational Variation of All-cause Perioperative Mortality in Brazil

  • Original Scientific Report
  • Published:
World Journal of Surgery Aims and scope Submit manuscript

Abstract

Background

All-cause perioperative mortality rate (POMR) is a commonly reported metric to assess surgical quality. Benchmarking POMR remains difficult due to differences in surgical volume and case mix combined with the burden of reporting and leveraging this complex and high-volume data. We seek to determine whether the pooled and individual procedure POMR of each bellwether (cesarean section, laparotomy, management of open fracture) correlate with state-level all-cause POMR in the interest of identifying benchmark procedures that can be used to make standardized regional comparisons of surgical quality.

Methods

The Brazilian National Healthcare Database (DATASUS) was queried to identify unadjusted all-cause POMR for all patient admissions among public hospitals in Brazil in 2018. Bellwether procedures were identified as any procedure involving laparotomy, cesarean section, or treatment of open long bone fracture and then classified as emergent or elective. The pooled POMR of all bellwether procedures as well as for each individual bellwether procedure was compared with the all-cause POMR in each of the 26 states, and one federal district and correlations were calculated. Funnel plots were used to compare surgical volume to perioperative mortality for each bellwether procedure.

Results

4,756,642 surgical procedures were reported to DATASUS in 2018: 237,727 emergent procedures requiring laparotomy, 852,821 emergent cesarean sections, and 210,657 open, long bone fracture repairs. Pooled perioperative mortality for all of the bellwether procedures was correlated with all-procedure POMR among states (r = 0.77, p < 0.001). POMR for emergency procedures (2.4%) correlated with the all-procedure (emergent and elective) POMR (1.6%, r = 0.93, p < .001), while POMR for elective procedures (0.4%) did not (p = .247). POMR for emergency laparotomy (4.4%) correlated with all-procedure POMR (1.6%, r = 0.52, p = .005), as did the POMR for open, long bone fractures (0.8%, r = 0.61, p < .001). POMR for emergency cesarean section (0.05%) did not correlate with all-procedure POMR (p = 0.400). There was a correlation between surgical volume and emergency laparotomy POMR (r = − 0.53, p = .004), but not for emergency cesarean section or open, long bone fractures POMR.

Conclusion

Procedure-specific POMR for laparotomy and open long bone fracture correlates modestly with all-procedure POMR among Brazilian states which is primarily driven by emergency procedure POMR. Selective reporting of emergency laparotomy and open fracture POMR may be a useful surrogate to guide subnational surgical policy decisions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

References

  1. Shrime MG, Bickler SW, Alkire BC, Mock C (2015) Global burden of surgical disease: an estimation from the provider perspective. Lancet Glob Health 3:S8–S9. https://doi.org/10.1016/S2214-109X(14)70384-5

    Article  PubMed  Google Scholar 

  2. Meara JG, Leather AJM, Hagander L et al (2015) Global Surgery 2030: evidence and solutions for achieving health, welfare, and economic development. Lancet Lond Engl 386(9993):569–624. https://doi.org/10.1016/S0140-6736(15)60160-X

    Article  Google Scholar 

  3. Kamali P. Measuring surgical systems worldwide: an update. The Data Blog. https://blogs.worldbank.org/opendata/measuring-surgical-systems-worldwide-update. Published February 12, 2018. Accessed 3 March 2019

  4. Hoyler M, Finlayson SRG, McClain CD, Meara JG, Hagander L (2014) Shortage of doctors, shortage of data: a review of the global surgery, obstetrics, and anesthesia workforce literature. World J Surg 38(2):269–280. https://doi.org/10.1007/s00268-013-2324-y

    Article  PubMed  Google Scholar 

  5. Healthcare Access and Quality Index based on mortality from causes amenable to personal health care in 195 countries and territories, 1990–2015: a novel analysis from the Global Burden of Disease Study 2015—ScienceDirect. https://www.sciencedirect.com/science/article/pii/S0140673617308188. Accessed 4 March 2019

  6. 13th General Programme of Work (GPW13) WHO Impact Framework. October 2018. https://www.who.int/about/what-we-do/GPW13_WHO_Impact_Framework_Indicator_Metadata.pdf

  7. O’Neill KM, Greenberg SL, Cherian M et al (2016) Bellwether procedures for monitoring and planning essential surgical care in low- and middle-income countries: caesarean delivery, laparotomy, and treatment of open fractures. World J Surg 40(11):2611–2619. https://doi.org/10.1007/s00268-016-3614-y

    Article  PubMed  Google Scholar 

  8. Marks IH, Fong ZV, Stapleton SM, Hung Y-C, Bababekov YJ, Chang DC (2018) How much data are good enough? Using simulation to determine the reliability of estimating POMR for resource-constrained settings. World J Surg 42(8):2344–2347. https://doi.org/10.1007/s00268-018-4529-6

    Article  PubMed  Google Scholar 

  9. Ng-Kamstra JS, Arya S, Greenberg SLM et al (2018) Perioperative mortality rates in low-income and middle-income countries: a systematic review and meta-analysis. BMJ Glob Health 3(3):e000810. https://doi.org/10.1136/bmjgh-2018-000810

    Article  PubMed  PubMed Central  Google Scholar 

  10. Paim J, Travassos C, Almeida C, Bahia L, Macinko J (2011) The Brazilian health system: history, advances, and challenges. Lancet 377(9779):1778–1797. https://doi.org/10.1016/S0140-6736(11)60054-8

    Article  PubMed  Google Scholar 

  11. Alonso N, Massenburg BB, Galli R, Sobrado L, Birolini D (2017) Surgery in Brazilian health care: funding and physician distribution. Rev Col Bras Cir 44(2):202–207. https://doi.org/10.1590/0100-69912017002016

    Article  PubMed  Google Scholar 

  12. Massuda A, Hone T, Leles FAG, de Castro MC, Atun R (2018) The Brazilian health system at crossroads: progress, crisis and resilience. BMJ Glob Health 3(4):e000829. https://doi.org/10.1136/bmjgh-2018-000829

    Article  PubMed  PubMed Central  Google Scholar 

  13. Watters DA, Hollands MJ, Gruen RL et al (2015) Perioperative mortality rate (POMR): a global indicator of access to safe surgery and anaesthesia. World J Surg 39(4):856–864. https://doi.org/10.1007/s00268-014-2638-4

    Article  PubMed  Google Scholar 

  14. Início - DATASUS. http://datasus.saude.gov.br/. Accessed 4 March 2019

  15. QUALISS - Indicadores Hospitalares Essenciais - 2013/14 - ANS - Agência Nacional de Saúde Suplementar. http://www.ans.gov.br/prestadores/qualiss-programa-de-qualificacao-dos-prestadores-de-servicos-de-saude/qualiss-programa-de-qualificacao-de-prestadores-de-servicos-de-saude/monitoramento-da-qualidade-dos-prestadores-de-servicos-de-saude/modulos-e-indicadores/qualiss-indicadores-hospitalares-essenciais-2013-14?highlight=WyJ0YXhhIiwidGF4YXMiLCJ0YXhhZGEiLCJkZSIsIm1vcnRhbGlkYWRlIiwidGF4YSBkZSIsInRheGEgZGUgbW9ydGFsaWRhZGUiLCJkZSBtb3J0YWxpZGFkZSJd. Accessed 13 March 2019

  16. Basic indicators for health in Brazil: concepts and applications - Book - 2nd edition - 2008. http://www.ripsa.org.br/2014/10/30/indicadores-basicos-para-a-saude-no-brasil-conceitos-e-aplicacoes-livro-2a-edicao-2008-2/. Accessed 13 Feb 2020

  17. Brazil (ed) (2006) Guia de vigilância epidemiológica. 6a ed., [1a reimpressão]. Brasília, DF: Ministério da Saúde, Secretaria de Vigilância em Saúde, Departamento de Vigilância Epidemiológica

  18. Machado JP, Martins M, da Leite I C, Machado JP, Martins M, da Leite I C (2016) Quality of hospital databases in Brazil: some elements. Rev Bras Epidemiol 19(3):567–581. https://doi.org/10.1590/1980-5497201600030008

    Article  PubMed  Google Scholar 

  19. Bittencourt SA, Camacho LAB, do LealM C (2006) Hospital Information Systems and their application in public health. Cad Saude Publica 22(1):19–30. https://doi.org/10.1590/s0102-311x2006000100003

    Article  PubMed  Google Scholar 

  20. Massenburg BB, Saluja S, Jenny HE et al (2017) Assessing the Brazilian surgical system with six surgical indicators: a descriptive and modelling study. BMJ Glob Health 2(2):e000226. https://doi.org/10.1136/bmjgh-2016-000226

    Article  PubMed  PubMed Central  Google Scholar 

  21. Prin M, Guglielminotti J, Mtalimanja O, Li G, Charles A (2018) Emergency-to-elective surgery ratio: a global indicator of access to surgical care. World J Surg 42(7):1971–1980. https://doi.org/10.1007/s00268-017-4415-7

    Article  PubMed  Google Scholar 

  22. Hanna JS, Herrera-Almario GE, Pinilla-Roncancio M et al (2020) Use of the six core surgical indicators from the Lancet Commission on Global Surgery in Colombia: a situational analysis. Lancet Glob Health 8(5):e699–e710. https://doi.org/10.1016/S2214-109X(20)30090-5

    Article  PubMed  Google Scholar 

  23. Population Projection | IBGE. https://www.ibge.gov.br/en/statistics/social/population/18176-population-projection.html?=&t=resultados. Accessed 30 Oct 2019

  24. Hosseinpoor AR, Bergen N, Barros AJD, Wong KLM, Boerma T, Victora CG (2016) Monitoring subnational regional inequalities in health: measurement approaches and challenges. Int J Equity Health 15(1):18. https://doi.org/10.1186/s12939-016-0307-y

    Article  PubMed  PubMed Central  Google Scholar 

  25. Ariyaratnam R, Palmqvist CL, Hider P et al (2015) Toward a standard approach to measurement and reporting of perioperative mortality rate as a global indicator for surgery. Surgery 158(1):17–26. https://doi.org/10.1016/j.surg.2015.03.024

    Article  PubMed  Google Scholar 

  26. Ng-Kamstra JS, Greenberg SLM, Kotagal M et al (2015) Use and definitions of perioperative mortality rates in low-income and middle-income countries: a systematic review. Lancet Lond Engl 385(Suppl 2):S29. https://doi.org/10.1016/S0140-6736(15)60824-8

    Article  Google Scholar 

  27. Thompson AM, Ashraf Z, Burton H, Stonebridge PA (2005) Mapping changes in surgical mortality over 9 years by peer review audit. BJS 92(11):1449–1452. https://doi.org/10.1002/bjs.5082

    Article  CAS  Google Scholar 

  28. Cecatti JG, Costa ML, Haddad SM et al (2016) Network for surveillance of severe maternal morbidity: a powerful national collaboration generating data on maternal health outcomes and care. BJOG Int J Obstet Gynaecol 123(6):946–953. https://doi.org/10.1111/1471-0528.13614

    Article  CAS  Google Scholar 

  29. Al-Temimi MH, Griffee M, Enniss TM et al (2012) When is death inevitable after emergency laparotomy? Analysis of the American College of Surgeons National Surgical Quality Improvement Program Database. J Am Coll Surg 215(4):503–511. https://doi.org/10.1016/j.jamcollsurg.2012.06.004

    Article  PubMed  Google Scholar 

  30. Saunders DI, Murray D, Pichel AC, Varley S, Peden CJ (2012) UK emergency laparotomy network. Variations in mortality after emergency laparotomy: the first report of the UK emergency laparotomy network. Br J Anaesth 109(3):368–375. https://doi.org/10.1093/bja/aes165

    Article  CAS  PubMed  Google Scholar 

  31. Beiles CB, Retegan C, Maddern GJ (2015) Victorian audit of surgical mortality is associated with improved clinical outcomes. ANZ J Surg 85(11):803–807. https://doi.org/10.1111/ans.12787

    Article  PubMed  Google Scholar 

  32. Anderson GA, Ilcisin L, Abesiga L et al (2017) Surgical volume and postoperative mortality rate at a referral hospital in Western Uganda: measuring the lancet commission on global surgery indicators in low-resource settings. Surgery 161(6):1710–1719. https://doi.org/10.1016/j.surg.2017.01.009

    Article  PubMed  Google Scholar 

  33. Nakamura-Pereira M, do Carmo Leal M, Esteves-Pereira AP et al (2016) Use of Robson classification to assess cesarean section rate in Brazil: the role of source of payment for childbirth. Reprod Health 13(S3):128. https://doi.org/10.1186/s12978-016-0228-7

    Article  PubMed  PubMed Central  Google Scholar 

  34. Molina G, Weiser TG, Lipsitz SR et al (2015) Relationship between cesarean delivery rate and maternal and neonatal mortality. JAMA 314(21):2263–2270. https://doi.org/10.1001/jama.2015.15553

    Article  CAS  PubMed  Google Scholar 

  35. Betrán AP, Ye J, Moller A-B, Zhang J, Gülmezoglu AM, Torloni MR (2016) The increasing trend in caesarean section rates: global, regional and national estimates: 1990–2014. PLoS ONE 11(2):e0148343. https://doi.org/10.1371/journal.pone.0148343

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  36. Rocha TAH, da Silva NC, Barbosa ACQ et al (2018) National registry of health facilities: data reliability evidence. Ciênc Amp Saúde Colet 23(1):229–240. https://doi.org/10.1590/1413-81232018231.16672015

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Paul Truche.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendices

Appendix 1

See Table 3.

Table 3 DATASUS codes used for each bellwether procedure

Appendix 2

See Table 4.

Table 4 2018 perioperative mortality per 100 bellwether procedures by state

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Truche, P., Roa, L., Citron, I. et al. Bellwether Procedures for Monitoring Subnational Variation of All-cause Perioperative Mortality in Brazil. World J Surg 44, 3299–3309 (2020). https://doi.org/10.1007/s00268-020-05607-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00268-020-05607-x

Navigation