Skip to main content

Advertisement

Log in

The Shapiro–Procalcitonin algorithm (SPA) as a decision tool for blood culture sampling: validation in a prospective cohort study

  • Original Paper
  • Published:
Infection Aims and scope Submit manuscript

Abstract

Purpose

Blood cultures (BC) are the gold standard for bacteremia detection despite a relatively low diagnostic yield and high costs. A retrospective study reported high predictive values for BC positivity when combining the clinical Shapiro score with procalcitonin (PCT).

Methods

Single-center, prospective cohort study between 01/2016 and 02/2017 to validate SPA algorithm, including a modified Shapiro score ≥ 3 points (S) PLUS admission PCT > 0.25 µg/l (P), or presence of overruling safety criteria (A) in patients with systemic inflammatory response syndrome. The diagnostic yield of SPA compared to non-standardized clinical judgment in predicting BC positivity was calculated and results presented as odds ratios (OR) with 95% confidence intervals.

Results

Of 1438 patients with BC sampling, 215 (15%) had positive BC which increased to 31% (173/555) in patients fulfilling SP criteria (OR for BC positivity 9.07 [6.34–12.97]). When adding 194 patients with overruling safety criteria (i.e., SPA), OR increased to 11.12 (6.99–17.69), although BC positivity slightly decreased to 26%. With an area under the receiver operating curve of 0.742, SPA indicated better diagnostic performance than its individual components. Positive BC in 689 patients not fulfilling SPA (sampling according to non-standardized clinical judgment) were rare (3%; OR for BC positivity 0.09 [0.06–0.14]). Eight out of 21 missed pathogens were still identified by sampling the primary infection focus.

Conclusions

This study validates the high predictive value of SPA for bacteremia, increasing true BC positivity from 15 to 26%. Restricting BC sampling to SPA would have reduced BC sampling by 48%, while still detecting 194/215 organisms (90%), which makes SPA a valuable diagnostic stewardship tool.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  1. Ratzinger F, Dedeyan M, Rammerstorfer M, Perkmann T, Burgmann H, Makristathis A, et al. A risk prediction model for screening bacteremic patients: a cross sectional study. PLoS ONE. 2014;9:e106765.

    Article  Google Scholar 

  2. Laupland KB. Incidence of bloodstream infection: a review of population-based studies. Clin Microbiol Infect. 2013;19:492–500.

    Article  CAS  Google Scholar 

  3. Bearman GM, Wenzel RP. Bacteremias: a leading cause of death. Arch Med Res. 2005;36:646–59.

    Article  Google Scholar 

  4. Weinstein MP, Towns ML, Quartey SM, Mirrett S, Reimer LG, Parmigiani G, et al. The clinical significance of positive blood cultures in the 1990s: a prospective comprehensive evaluation of the microbiology, epidemiology, and outcome of bacteremia and fungemia in adults. Clin Infect Dis. 1990s;24:584–602.

    Article  CAS  Google Scholar 

  5. Yoshida T, Tsushima K, Tsuchiya A, Nishikawa N, Shirahata K, Kaneko K, et al. Risk factors for hospital-acquired bacteremia. Intern Med. 2005;44:1157–62.

    Article  Google Scholar 

  6. Reimer LG, Wilson ML, Weinstein MP. Update on detection of bacteremia and fungemia. Clin Microbiol Rev. 1997;10:444–65.

    Article  CAS  Google Scholar 

  7. Wisplinghoff H, Bischoff T, Tallent SM, Seifert H, Wenzel RP, Edmond MB. Nosocomial bloodstream infections in US hospitals: analysis of 24,179 cases from a prospective nationwide surveillance study. Clin Infect Dis. 2004;39:309–17.

    Article  Google Scholar 

  8. Tokuda Y, Miyasato H, Stein GH. A simple prediction algorithm for bacteraemia in patients with acute febrile illness. QJM. 2005;98:813–20.

    Article  CAS  Google Scholar 

  9. Weinstein MP. Current blood culture methods and systems: clinical concepts, technology, and interpretation of results. Clin Infect Dis. 1996;23:40–6.

    Article  CAS  Google Scholar 

  10. Lee A, Mirrett S, Reller LB, Weinstein MP. Detection of bloodstream infections in adults: how many blood cultures are needed? J Clin Microbiol. 2007;45:3546–8.

    Article  Google Scholar 

  11. Khatib R, Simeunovic G, Sharma M, Fakih MG, Johnson LB, Briski L, et al. Blood culture series benefit may be limited to selected clinical conditions: time to reassess. Clin Microbiol Infect. 2015;21:332–6.

    Article  CAS  Google Scholar 

  12. Wang SJ, Kuperman GJ, Ohno-Machado L, Onderdonk A, Sandige H, Bates DW. Using electronic data to predict the probability of true bacteremia from positive blood cultures. Proc AMIA Symp. 2000:893–7.

  13. Paul M, Andreassen S, Nielsen AD, Tacconelli E, Almanasreh N, Fraser A, et al. Prediction of bacteremia using TREAT, a computerized decision-support system. Clin Infect Dis. 2006;42:1274–82.

    Article  Google Scholar 

  14. Previsdomini M, Gini M, Cerutti B, Dolina M, Perren A. Predictors of positive blood cultures in critically ill patients: a retrospective evaluation. Croat Med J. 2012;53:30–9.

    Article  CAS  Google Scholar 

  15. Bates DW, Cook EF, Goldman L, Lee TH. Predicting bacteremia in hospitalized patients. A prospectively validated model. Ann Intern Med. 1990;113:495–500.

    Article  CAS  Google Scholar 

  16. Leibovici L, Greenshtain S, Cohen O, Mor F, Wysenbeek AJ. Bacteremia in febrile patients. A clinical model for diagnosis. Arch Intern Med. 1991;151:1801–6.

    Article  CAS  Google Scholar 

  17. Poses RMAM. When you hear hoofbeats: physicians overvalue recent experience when diagnosing bacteremia [abstract]. Clin Res. 1989;37:781A.

    Google Scholar 

  18. Makadon HJ, Bor D, Friedland G, Dasse P, Komaroff AL, Aronson MD. Febrile inpatients: house officers' use of blood cultures. J Gen Intern Med. 1987;2:293–7.

    Article  CAS  Google Scholar 

  19. Shapiro NI, Wolfe RE, Wright SB, Moore R, Bates DW. Who needs a blood culture? A prospectively derived and validated prediction rule. J Emerg Med. 2008;35:255–64.

    Article  Google Scholar 

  20. Jones GR, Lowes JA. The systemic inflammatory response syndrome as a predictor of bacteraemia and outcome from sepsis. QJM. 1996;89:515–22.

    Article  CAS  Google Scholar 

  21. Lee J, Hwang SS, Kim K, Jo YH, Lee JH, Kim J, et al. Bacteremia prediction model using a common clinical test in patients with community-acquired pneumonia. Am J Emerg Med. 2014;32:700–4.

    Article  Google Scholar 

  22. Metersky ML, Ma A, Bratzler DW, Houck PM. Predicting bacteremia in patients with community-acquired pneumonia. Am J Respir Crit Care Med. 2004;169:342–7.

    Article  Google Scholar 

  23. Laukemann S, Kasper N, Kulkarni P, Steiner D, Rast AC, Kutz A, et al. Can we reduce negative blood cultures with clinical scores and blood markers? Results from an observational cohort study. Medicine (Baltimore). 2015;94:e2264.

    Article  Google Scholar 

  24. Weinstein MP, Reller LB, Murphy JR, Lichtenstein KA. The clinical significance of positive blood cultures: a comprehensive analysis of 500 episodes of bacteremia and fungemia in adults. I. Laboratory and epidemiologic observations. Rev Infect Dis. 1983;5:35–533.

    Article  CAS  Google Scholar 

  25. The European Commitee on Antimicrobial Suspectibility Testing. Breakpoint tables for interpretation of MICs and zone diameters, Version 6.0, 2016. https://www.eucast.org/clinical_breakpoints/.

  26. Hall KK, Lyman JA. Updated review of blood culture contamination. Clin Microbiol Rev. 2006;19:788–802.

    Article  Google Scholar 

  27. Coburn B, Morris AM, Tomlinson G, Detsky AS. Does this adult patient with suspected bacteremia require blood cultures? JAMA. 2012;308:502–11.

    Article  CAS  Google Scholar 

  28. Bates DW, Goldman L, Lee TH. Contaminant blood cultures and resource utilization. The true consequences of false-positive results. JAMA. 1991;265:365–9.

    Article  CAS  Google Scholar 

  29. Kim B, Choi J, Kim K, Jang S, Shin TG, Kim WY, et al. Bacteremia prediction model for community-acquired pneumonia: external validation in a multicenter retrospective cohort. Acad Emerg Med. 2017;24:1226–344.

    Article  Google Scholar 

  30. Kim B, Kim K, Lee J, Kim J, Jo YH, Lee JH, et al. Impact of bacteremia prediction rule in CAP: before and after study. Am J Emerg Med. 2018;36:758–62.

    Article  Google Scholar 

  31. Lee CY, Kunin CM, Chang C, Lee SS, Chen YS, Tsai HC. Development of a prediction model for bacteremia in hospitalized adults with cellulitis to aid in the efficient use of blood cultures: a retrospective cohort study. BMC Infect Dis. 2016;16:581–91.

    Article  Google Scholar 

  32. Tudela P, Lacoma A, Prat C, Modol JM, Gimenez M, Barallat J, et al. Prediction of bacteremia in patients with suspicion of infection in emergency room. Med Clin (Barc). 2010;135:685–90.

    Article  Google Scholar 

  33. Takeshima T, Yamamoto Y, Noguchi Y, Maki N, Gibo K, Tsugihashi Y, et al. Identifying patients with bacteremia in community-hospital emergency rooms: a retrospective cohort study. PLoS ONE. 2016;11:e0148078.

    Article  Google Scholar 

  34. Leli C, Ferranti M, Marrano U, Al Dhahab ZS, Bozza S, Cenci E, et al. Diagnostic accuracy of presepsin (sCD14-ST) and procalcitonin for prediction of bacteraemia and bacterial DNAaemia in patients with suspected sepsis. J Med Microbiol. 2016;65:713–9.

    Article  CAS  Google Scholar 

  35. Tromp M, Lansdorp B, Bleeker-Rovers CP, Gunnewiek JM, Kullberg BJ, Pickkers P. Serial and panel analyses of biomarkers do not improve the prediction of bacteremia compared to one procalcitonin measurement. J Infect. 2012;65:292–301.

    Article  CAS  Google Scholar 

  36. Jeong S, Park Y, Cho Y, Kim HS. Diagnostic utilities of procalcitonin and C-reactive protein for the prediction of bacteremia determined by blood culture. Clin Chim Acta. 2012;413:1731–6.

    Article  CAS  Google Scholar 

  37. Jessen MK, Mackenhauer J, Hvass AM, Ellermann-Eriksen S, Skibsted S, Kirkegaard H, et al. Prediction of bacteremia in the emergency department: an external validation of a clinical decision rule. Eur J Emerg Med. 2016;23:44–9.

    Article  Google Scholar 

  38. Smit J, Rieg SR, Wendel AF, Kern WV, Seifert H, Schonheyder HC, et al. Onset of symptoms, diagnostic confirmation, and occurrence of multiple infective foci in patients with Staphylococcus aureus bloodstream infection: a look into the order of events and potential clinical implications. Infection. 2018;46:651–8.

    Article  Google Scholar 

  39. Chalasani NP, Valdecanas MA, Gopal AK, McGowan JE Jr, Jurado RL. Clinical utility of blood cultures in adult patients with community-acquired pneumonia without defined underlying risks. Chest. 1995;108:932–6.

    Article  CAS  Google Scholar 

  40. McMurray BR, Wrenn KD, Wright SW. Usefulness of blood cultures in pyelonephritis. Am J Emerg Med. 1997;15:137–40.

    Article  CAS  Google Scholar 

  41. Pasternak EL 3rd, Topinka MA. Blood cultures in pyelonephritis: Do results change therapy? Acad Emerg Med. 2000;7:1170.

    PubMed  Google Scholar 

  42. Metlay JP, Waterer GW, Long AC, Anzueto A, Brozek J, Crothers K, et al. Diagnosis and treatment of adults with community-acquired pneumonia. An official clinical practice guideline of the American Thoracic Society and infectious diseases society of America. Am J Respir Crit Care Med. 2019;200:e45–e67.

    Article  Google Scholar 

Download references

Acknowledgements

We thank the nurses in the emergency department responsible for BC and biomarker sampling throughout the study period, the study nurses involved in data collection, and the laboratory and microbiology teams who performed all blood tests and microbiological analyses needed. In addition, we thank all the patients who participated in this study.

Funding

This work was supported by the Research Fund of the Kantonsspital Aarau, Switzerland. The sponsor had no role in the study design, data collection or interpretation, and writing and submitting the report.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Anna Conen.

Ethics declarations

Conflict of interest

On behalf of all authors, the corresponding author states that there is no conflict of interest.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wyss, G., Berger, S., Haubitz, S. et al. The Shapiro–Procalcitonin algorithm (SPA) as a decision tool for blood culture sampling: validation in a prospective cohort study. Infection 48, 523–533 (2020). https://doi.org/10.1007/s15010-020-01423-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s15010-020-01423-6

Keywords

Navigation