The Surviving Sepsis Campaign: results of an international guideline-based performance improvement program targeting severe sepsis
- 19k Downloads
The Surviving Sepsis Campaign (SSC or “the Campaign”) developed guidelines for management of severe sepsis and septic shock. A performance improvement initiative targeted changing clinical behavior (process improvement) via bundles based on key SSC guideline recommendations on process improvement and patient outcomes.
Design and setting
A multifaceted intervention to facilitate compliance with selected guideline recommendations in the ICU, ED, and wards of individual hospitals and regional hospital networks was implemented voluntarily in the US, Europe, and South America. Elements of the guidelines were “bundled” into two sets of targets to be completed within 6 h and within 24 h. An analysis was conducted on data submitted from January 2005 through March 2008.
Data from 15,022 subjects at 165 sites were analyzed to determine the compliance with bundle targets and association with hospital mortality. Compliance with the entire resuscitation bundle increased linearly from 10.9% in the first site quarter to 31.3% by the end of 2 years (P < 0.0001). Compliance with the entire management bundle started at 18.4% in the first quarter and increased to 36.1% by the end of 2 years (P = 0.008). Compliance with all bundle elements increased significantly, except for inspiratory plateau pressure, which was high at baseline. Unadjusted hospital mortality decreased from 37 to 30.8% over 2 years (P = 0.001). The adjusted odds ratio for mortality improved the longer a site was in the Campaign, resulting in an adjusted absolute drop of 0.8% per quarter and 5.4% over 2 years (95% CI, 2.5–8.4%).
The Campaign was associated with sustained, continuous quality improvement in sepsis care. Although not necessarily cause and effect, a reduction in reported hospital mortality rates was associated with participation. The implications of this study may serve as an impetus for similar improvement efforts.
KeywordsSevere sepsis Septic shock Knowledge transfer Performance measures Surviving sepsis campaign Performance improvement Sepsis bundles Quality improvement
Severe sepsis accounts for 20% of all admissions to intensive care units (ICUs) and is the leading cause of death in non-cardiac ICUs, yet comprehensive clinical practice guidelines had not existed [1, 2]. In 2002, hopeful that outcomes of sepsis might be improved by standardizing care and informed by data from an increasing number of clinical trials [3, 4, 5, 6, 7, 8, 9, 10], the European Society of Intensive Care Medicine (ESICM), the International Sepsis Forum (ISF), and the Society of Critical Care Medicine (SCCM) launched the Surviving Sepsis Campaign (SSC or “the Campaign”) . Evidence-based guidelines were developed through a formal and transparent process [12, 13, 14]. The initial guidelines were published in 2004 (endorsed by 11 professional societies); an updated version was published in 2008 (involving 18 organizations comprising professional societies and organized networks of hospitals).
The development and publication of guidelines often do not lead to changes in clinical behavior and guidelines are rarely, if ever, integrated into bedside practice in a timely fashion [15, 16, 17, 18, 19, 20]. The most effective means for achieving knowledge transfer remains an unanswered question across all medical disciplines [21, 22]. Recognizing that implementing guidelines presents a significant challenge, the Campaign set out to develop and evaluate a multifaceted model to change bedside practice to be consistent with the recently published management guidelines for patients with severe sepsis and septic shock. A central part of that program was an international registry into which providers could recruit and enter patients and monitor their institution’s performance. This analysis of the registry data describes the global initiative, its implementation, and reports its impact on process improvement and patient outcomes.
The SSC performance improvement initiative was launched in multiple sites internationally to measure changes in the rates at which the sites achieved the targets of the guideline bundles and to assess the impact of compliance with the program on hospital mortality. The Campaign activities included: the development of sepsis bundles; creation of educational materials; recruitment of sites and local physician and nurse champions through national and international meetings; organization of regional launch meetings where the initiative was introduced and educational materials presented; and the distribution of a secure database application that allowed for data collection and transfer, and offered a simple means for providing practice audit and feedback to local clinicians.
Guideline and bundle development
Sites and patient selection
Any hospital wishing to join the Campaign was eligible. Participation was voluntary. Participant sites were recruited at professional critical care congresses and meetings, through the SSC and IHI Web sites, and by interest generated from publication of the SSC guidelines. Campaign symposia were regularly held at international congresses and other venues between 2004 and 2008 to increase awareness and participation. Local champions and Campaign faculty were identified and trained to develop regional and national networks.
Sites were encouraged to set up screening procedures to identify patients with severe sepsis based on previously established criteria . Sites were provided a sample screening tool in the Campaign manual and on the Web site . Participating sites were asked to screen for patients in the emergency department (ED), the clinical wards, and the ICU. Methods of screening were ultimately established locally, and no effort to supervise the quality or completeness of screening was attempted.
To be enrolled, a subject had to have a suspected site of infection, two or more systemic inflammatory response syndrome (SIRS) criteria , and one or more organ dysfunction criteria. (See Supplemental Fig. 1 online.) Clinical and demographic characteristics and time of presentation with severe sepsis criteria were collected for analysis of time-based measures. Time of presentation was determined through chart review and defined in instructions to site data collectors on the Campaign Web site and educational materials. For patients enrolled from the ED, the time of presentation was defined as the time of triage. For patients admitted to the ICU from the medical and surgical wards and for patients in the ICU at the time of diagnosis, the time of presentation was determined by chart review for the diagnosis of severe sepsis.
Educational materials and resources
Educational materials available on the SSC Web site included directions for implementing the bundles and supporting data for each bundle element. A comprehensive manual, Implementing the Surviving Sepsis Campaign, was published in 2005 and included the data collection tool in CD format . The manual was also distributed at meetings. It included protocols for participation and links to download the database. It also reviewed issues related to ensuring consistency and quality in data collection. The manual contents were placed on the IHI and SSC Web sites. Cards and posters of the two sepsis bundles (Fig. 1) were printed and widely distributed.
During the course of the study period, initiation meetings were held for participating hospital groups and regional SSC launches, at which educational materials were distributed, methods for data collection described, institutional change concepts introduced, and examples of implementation discussed. Ultimately, hospital-level efforts and local protocol development were the purview of individual improvement teams at each institution or network. An e-mail list server with voluntary membership was established to allow teams to collaborate across sites by asking questions of their colleagues and to direct communication from the SSC to sites. List members were encouraged to share tools, protocols, and experiences. Although no formal evaluation was in place to assess the quality of data entered, concern regarding this topic was the second most frequently discussed area among participants (following concern regarding roadblocks to achieving physician engagement). Two of the authors (CS and SRT) served as primary references for all questions regarding data collection and entry throughout the Campaign, and provided training for each site when requested. A bi-monthly electronic newsletter was published to share successes, strategies, and events.
Bundle targets and clinical outcomes
The primary outcome measure was change in compliance with bundle targets over time. We defined compliance as evidence that all bundle elements were achieved within the indicated time frame (i.e, 6 h for the resuscitation bundle; 24 h for the management bundle). As such, failure to comply might occur either because of the failure of the physician to attempt to meet the target or the failure to reach the target despite the clinician’s attempt. Secondary outcome measures included hospital mortality, hospital length of stay, and ICU length of stay. Ten performance measures were established, based on the individual elements of the resuscitation bundle and the management bundle.
Data were entered into the SSC database locally at individual hospitals into pre-established, unmodifiable fields documenting performance data and the time of specific actions and findings. Data on the local database contained private health information (PHI) that enabled individual sites to audit and review local practice and compliance as well as provide feedback to clinicians involved in the initiative. Data stripped of PHI were submitted every 30 days to the secure master SSC server at the Society of Critical Care Medicine (Mount Prospect, Ill.) via file transfer protocol (FTP) or as comma-delimited text files attached to e-mail submitted to the Campaign’s server.
The global SSC improvement initiative was reviewed and approved by the Cooper University Hospital Institutional Review Board (Camden, NJ) as meeting criteria for exempt status. Individual hospitals were encouraged to refer to these documents and submit to their local IRBs per local policy for documentation of exempt status or waiver of consent. The US Department of Health and Human Services’ Office for Human Research Protections clarified that quality improvement activities such as SSC often qualify for IRB exemption and do not require individual informed consent .
Analysis set construction
Inclusion in database by quarter
Sites were characterized by: hospital size (<250, 250–500, >500 beds); teaching status; ICU type (medical, medical/surgical, other); and geographic region (Europe, North America, South America). Subjects were characterized by baseline severe sepsis information: location of enrollment (ED, ICU, ward); site of infection (pulmonary, urinary tract, abdominal, CNS, skin, bone, wound, catheter, cardiac, device, other); acute organ dysfunction (cardiovascular, pulmonary, renal, hepatic, hematologic). Subject age and gender were not collected in deference to country-specific privacy laws.
Data were organized by quarter through 2 years, with the first 3 months that a site entered subjects into the database defined as the first quarter regardless of when those months occurred from January 2005 through March 2008. Results are presented by site quarter, comparing the initial quarter to the final quarter for all sites and by comparing the initial quarter to all subsequent quarters.
Because differences in bundle achievement and outcomes could be confounded by changes in the characteristics of subjects entered into the database, risk-adjustment logistic regression models were constructed to control for baseline subject characteristics. All baseline characteristics present in the database were included in the risk-adjustment models including location of enrollment, acute organ dysfunctions, and site of infection. Site of infection was reduced to pulmonary or non-pulmonary to decrease the number of covariate patterns in the data and increase the utility of the model residuals to assess model fit. Because the collection of some bundle elements was conditioned on subject characteristics, different models were constructed for each subpopulation. The model assessing the base set of elements applicable to all subjects (lactate measurement, blood culture before antibiotic administration, broad spectrum antibiotic administration, and glucose control) included the baseline subject characteristics as well as these elements. The model assessing the administration of drotrecogin alfa in subjects with multiple organ failures also included the baseline subject characteristics and the base set of bundle elements. The model assessing plateau pressure control in mechanically ventilated subjects also included the baseline subject characteristics and the base set of bundle elements. The model assessing the administration of drotrecogin alfa, low-dose steroids, CVP >8, and ScvO2 >70 in subjects in shock despite fluids also included the baseline subject characteristics and the base set of bundle elements.
To demonstrate that a decrease in hospital mortality over time was not associated with entering less severely ill patients in the database at individual sites, a logistic regression model was constructed. It contained all subjects entered over the maximum of 2 years of data collection and the baseline subject characteristics for the quarter of participation for up to eight quarters. Because sites could enter the Campaign at any time, the possibility that decreased hospital mortality over time was associated with a global decrease in mortality for the same severity of illness was investigated by constructing a logistic regression model for hospital mortality using the first quarter of data collection from each site, including the baseline subject characteristics and the calendar quarter (1 for the first quarter of 2005 through 13 for the first quarter of 2008).
We compared raw rates including hospital mortality and bundle compliance using Fisher’s exact test. We expressed the effects of predictor variables on hospital mortality using odds ratios, including 95% confidence intervals for risk-adjusted results. We assessed logistic regression model fit using the Hosmer–Lemeshow C statistic, the χ2 dispersion, the proportion of log-likelihood accounted for by the model, and an examination of model residuals. We constructed the databases in Access and FoxPro (Microsoft Corp., Redmond, WA) and conducted analyses in DataDesk (Data Description, Ithaca, NY) and SAS (SAS Institute, Cary, NC).
N = 15,022
N = 165
Hospital mortality (%)
Site of infection
Baseline acute organ dysfunctions
Number of acute organ dysfunctions
No cardiovascular dysfunction
Cardiovascular dysfunction no hypotension
Lactate >4 only
Lactate >4 and vasopressors
Change in achievement of bundle targets over time
Change in achievement of bundle targets
Initial quarter achieved (%)
Final quarter achieved (%)a
P value compared to initial
Remaining quarters achieved (%)
P value compared to initial
Initial care bundle (first 6 h of presentation)
Blood cultures before antibiotics
Broad spectrum antibiotics
Fluids and vasopressors
CVP >8 mmHg
All resuscitation measures
Management bundle (first 24 h after presentation)
Administration of drotrecogin alfa policy
Plateau pressure control
All management measures
Changes in hospital mortality
Multivariable mortality prediction model
Ward compared to ED
ICU compared to ED
Pneumonia as source of sepsis compared to other infections
Organ dysfunction at presentation
Site duration in campaign
Relationship between bundle targets and hospital mortality
Risk-adjusted impact of bundle targets on hospital mortality
Obtain blood cultures before antibiotics
Commence broad-spectrum antibiotics
Achieve tight glucose control
Administer drotrecogin alfa
Administer drotrecogin alfa
Shock despite fluidsc
Administer low-dose steroids
Shock despite fluidsc
Demonstrate CVP ≥8 mmHg
Shock despite fluidsc
Demonstrate ScvO2 ≥70%
Shock despite fluidsc
Achieve low plateau pressure control
The Surviving Sepsis Campaign—a performance improvement effort by hospitals across Europe, South America, and the US—recruited the largest prospective series of severe sepsis patients yet studied. The effort took place in 30 countries, was voluntary (no sites or clinicians were paid for data collection or for becoming part of the Campaign), and was multidisciplinary, reflecting the ethos of the founding professional societies. By instituting a practice improvement program grounded in evidence-based guidelines, SSC increased compliance with the change bundles that was associated with better patient outcomes. These results are consistent with other published studies that established the impact of performance “bundles” on outcomes [32, 33, 34, 35].
SSC was a performance improvement process, and not a dedicated scientific evaluation of the impact of the guidelines on clinical outcome. Efficacy was inferred by observation of change over time, rather than through the more rigorous approach of a randomized controlled trial. Thus, conclusions regarding the clinical impact of bundle elements, or even of the process itself, must be interpreted with caution. The observation that early detection of infection and institution of antibiotic therapy led to improved survival is consistent with both empirical data  and generally held professional opinion. On the other hand, the observation that achievement of glucose control is associated with better outcome is not necessarily supported by recent RCT data .
Certain limitations must be considered in interpreting these findings. Participation in the process was entirely voluntary. The hospitals themselves are not necessarily representative of hospitals that did not participate, and the generalizability of our findings is, therefore, speculative. Further, we do not know whether the patients were a comprehensive or representative sample of all potentially eligible subjects at each site. Sites with varying lengths of participation are included in the analysis. While the rate of enrollment over time was relatively constant for each site, the possibility that the types of patients selected changed over time cannot be excluded. We believe the data are encouraging and supportive of the Campaign’s creating beneficial effects both on patient care and patient outcome. Because the bundles combine physiologic endpoints and processes of care, measures of compliance may not be precise. However, the improvement in measures over time probably reflects improving compliance, assuming the case mix was reasonably stable. The independent association of these bundle targets with outcome does not necessarily imply a causal relationship between the bundle care recommendation and outcomes. Failure to achieve a target may be indicative of greater severity, so compliance with the attempt alone may produce the false impression that compliance is associated with reduced mortality. Therefore, attention to adjustment for severity of patient illness at time of enrollment should be attempted.
Similarly, failure to achieve blood glucose control despite attempting to do so is not the same as failure to make the attempt. Attempting to discriminate failure to achieve a target versus patient responsiveness adds a layer of complexity and subjectivity to the scoring process that would be difficult to validate. Nevertheless, because patient responsiveness is unlikely to change over time, the scoring should reflect each hospital’s improvement attempts. By combining a number of elements in the care bundles, the Campaign sought to maximize outcome improvement. At the same time, such an approach compromises measuring the effect of individual elements.
The fact that performance improvement studies are susceptible to general trends in the change in mortality and clinical practice patterns over time is another potential limitation of the study, but the variable start times for each site established that such effects were unlikely to explain the improvement in mortality. The baseline mortality rate for sites entering at variable times throughout the 2-year study period did not change. Formal severity scores were not obtained for patients entered into the database due to limited personnel resources in the absence of external site funding and confidentiality concerns. Therefore, decreasing mortality seen over the 2-year initiative might be explained by the enrollment of less severely ill patients over time, in spite of the static baseline center mortality. To control for entry of less severely ill patients in the database over time as the reason for decreasing mortality, severity was assessed based on variables linked to patient mortality that were available in the database (Table 4). When mortality was adjusted accordingly, although the magnitude of the effect was slightly reduced, it remained statistically significant.
In conclusion, the results of this study demonstrate that the use of a multifaceted performance improvement initiative was successful in changing sepsis treatment behavior as evidenced by a significant increase in compliance with sepsis performance measures. This compliance was associated with a significant reduction in hospital mortality in patients with severe sepsis and septic shock over the duration of the 2-year study, but the study design does not allow us to say, with certainty, whether this was due to some or all bundle elements, increased awareness of severe sepsis, or other unrelated factors. Many unanswered questions remain that could provide direction for future research, including the mortality trend in hospitals that have not implemented the bundles, and confirmation of which components of the bundles reduce mortality. These results are consistent with an earlier report from Spain , and extend the findings of that study by suggesting that the improvement in achievement of bundle targets and association with improved outcome is sustained over time and is demonstrated across a wide number of countries and settings. Professional societies frequently generate evidence-based clinical practice guidelines, but efforts to disseminate such guidelines have rarely been of a scale comparable to this Campaign. The results of this study should encourage similar efforts to implement guidelines as a means to improve outcomes.
The authors gratefully acknowledge the dedication and efforts of Deb McBride during the Campaign and in the development of this manuscript. We also acknowledge the individuals leading the effort at participating sites who made all of this happen as volunteers who believed in the Campaign and what we were trying to accomplish as their sole motivation. The work was supported by Eli Lilly and Co., Edwards Lifesciences, Philips Medical Systems, the Society of Critical Care Medicine, and European Society of Intensive Care Medicine.
Dr. Levy has received grants from Eli Lilly & Co and Philips Medical Systems. Dr. Marshall has consultancies with Eisai, Eli Lilly, Specter Diagnostics, Bayer, Artisan, and Leo Pharma. Dr. Artigas has received grants from Eli Lilly. Dr. Beale has disclosed payment from multiple sources that were paid to his department and institution (details on file with the editorial office). Drs. Reihart and Silva have consultancies with Eli Lilly. Dr. Angus has participation in DSMB, Prowess-Shock, and Eli Lilly. The remaining authors have not disclosed any potential conflicts of interest.
- 4.Annane D, Sébille V, Charpentier C, Bollaert PE, François B, Korach JM, Capellier G, Cohen Y, Azoulay E, Troché G, Chaumet-Riffaud P, Bellissant E (2002) Effect of treatment with low doses of hydrocortisone and fludricortisone on mortality in patients with septic shock. JAMA 288:862–871CrossRefPubMedGoogle Scholar
- 5.Bernard GR, Vincent JL, Laterre PF, LaRosa SP, Dhainaut JF, Lopez-Rodriguez A, Steingrub JS, Garber GE, Helterbrand JD, Ely EW, Fisher CJ Jr, Recombinant human protein C Worldwide Evaluation in Severe Sepsis (PROWESS) study group (2001) Efficacy and safety of recombinant human activated protein C for severe sepsis. N Engl J Med 344:699–709CrossRefPubMedGoogle Scholar
- 12.Dellinger RP, Carlet JM, Masur H, Gerlach H, Calandra T, Cohen J, Gea-Banacloche J, Keh D, Marshall JC, Parker MM, Ramsay G, Zimmerman JL, Vincent JL, Levy MM, Surviving Sepsis Campaign Management Guidelines Committee (2004) Surviving Sepsis Campaign guidelines for management of severe sepsis and septic shock. Crit Care Med 32:858–873CrossRefPubMedGoogle Scholar
- 13.Dellinger RP, Levy MM, Carlet JM, Bion J, Parker MM, Jaeschke R, Reinhart K, Angus DC, Brun-Buisson C, Beale R, Calandra T, Dhainaut JF, Gerlach H, Harvey M, Marini JJ, Marshall J, Ranieri M, Ramsay G, Sevransky J, Thompson BT, Townsend S, Vender JS, Zimmerman JL, Vincent JL (2008) Surviving Sepsis Campaign: international guidelines for management of severe sepsis and septic shock: 2008. Intensive Care Med 34:17–60, erratum 34:783–785Google Scholar
- 14.Surviving Sepsis Campaign implementation and the appropriate role of industry. http://www.survivingsepsis.org/About_the_Campaign/Documents/Industry_20Fact_20Sheet__2003-2006_2_.pdf. Accessed 5 Dec 2009
- 27.Severe sepsis bundles. Resuscitation bundle. http://www.survivingsepsis.org/Bundles/Pages/default.aspx. Accessed 5 Dec 2009
- 28.Severe sepsis bundles. Management bundle. http://www.survivingsepsis.org/Bundles/Pages/default.aspx. Accessed 5 Dec 2009
- 29.Levy MM, Fink MP, Marshall JC, Abraham E, Angus D, Cook D, Cohen J, Opal SM, Vincent JL, Ramsay G; SCCM/ESICM/ACCP/ATS/SIS (2003) 2001 SCCM/ESICM/ACCP/ATS/SIS international sepsis definitions conference. Crit Care Med 31:1250–1256Google Scholar
- 30.Townsend S, Dellinger RP, Levy MM, Ramsay G (eds) (2005) Implementing the Surviving Sepsis Campaign. Society of Critical Care Medicine, Mount ProspectGoogle Scholar
- 31.http://www.hhs.gov/ohrp/qualityfaq.html. Accessed 12 Aug 2009
- 35.Nguyen HB, Corbett SW, Steele R, Banta J, Clark RT, Hayes SR, Edwards J, Cho TW, Wittlake WA (2007) Implementation of a bundle of quality indicators for the early management of severe sepsis and septic shock is associated with decreased mortality. Crit Care Med 35:1105–1112CrossRefPubMedGoogle Scholar
- 36.Kumar A, Roberts D, Wood KE, Light B, Parrillo JE, Sharma S, Suppes R, Feinstein D, Zanotti S, Taiberg L, Gurka D, Kumar A, Cheang M (2006) Duration of hypotension before initiation of effective antimicrobial therapy is the critical determinant of survival in human septic shock. Crit Care Med 34:1589–1596CrossRefPubMedGoogle Scholar
- 38.Ferrer R, Artigas A, Levy MM, Blanco J, González-Díaz G, Garnacho-Montero J, Ibáñez J, Palencia E, Quintana M, de la Torre-Prados MV, Edusepsis Study Group (2008) Improvement in process of care and outcome after a multicenter severe sepsis educational program in Spain. JAMA 299:2294–2303CrossRefPubMedGoogle Scholar