Bedside prediction rule for infections after pediatric cardiac surgery
- First Online:
- Cite this article as:
- Algra, S.O., Driessen, M.M.P., Schadenberg, A.W.L. et al. Intensive Care Med (2012) 38: 474. doi:10.1007/s00134-011-2454-3
- 773 Downloads
Infections after pediatric cardiac surgery are a common complication, occurring in up to 30% of cases. The purpose of this study was to develop a bedside prediction rule to estimate the risk of a postoperative infection.
All consecutive pediatric cardiac surgery procedures between April 2006 and May 2009 were retrospectively analyzed. The primary outcome variable was any postoperative infection, as defined by the Center of Disease Control (2008). All variables known to the clinician at the bedside at 48 h post cardiac surgery were included in the primary analysis, and multivariable logistic regression was used to construct a prediction rule.
A total of 412 procedures were included, of which 102 (25%) were followed by an infection. Most infections were surgical site infections (26% of all infections) and bloodstream infections (25%). Three variables proved to be most predictive of an infection: age less than 6 months, postoperative pediatric intensive care unit (PICU) stay longer than 48 h, and open sternum for longer than 48 h. Translation into prediction rule points yielded 1, 4, and 1 point for each variable, respectively. Patients with a score of 0 had 6.6% risk of an infection, whereas those with a maximal score of 6 had a risk of 57%. The area under the receiver operating characteristic curve was 0.78 (95% confidence interval 0.72–0.83).
A simple bedside prediction rule designed for use at 48 h post cardiac surgery can discriminate between children at high and low risk for a subsequent infection.
KeywordsPediatric intensive care unit Infections Cardiopulmonary bypass Prediction rule
Infections occurring after pediatric cardiac surgery are a frequent complication, with the reported incidence varying widely from 16 to 31% [1, 2, 3, 4]. These infections are an important burden in the recovery after surgery, as they cause significant morbidity and lengthen pediatric intensive care unit (PICU) and total hospital stays .
The incidence of postoperative infections in children after cardiac surgery is higher than may be expected in the general PICU population (6–15%) [5, 6, 7]. This is presumed to be due to the hypoinflammatory phase of the systemic inflammatory response to cardiac surgery . The most common types of infections are those occurring at the surgical site and bloodstream infections [1, 2, 3, 4]. Perioperative risk factors have been identified previously, yielding younger age at surgery, higher surgical complexity, longer surgical and cardiopulmonary bypass (CPB) duration, a longer PICU stay, and delayed sternal closure as important risk factors [1, 2, 3, 4, 9, 10, 11, 12, 13, 14, 15]. Although these factors have helped to unravel the etiology of the infections, they do not necessarily reliably determine those patients which are most at risk. This creates the need for a prediction model, which aims to assist the clinician in the decision-making process. In the case of postoperative infections, the question is which preventive measures need to be taken, and in which patients?
In this study we used retrospective data from a recent pediatric cardiac surgery cohort from our center in order to identify which variables are predictive of postoperative infections. The aim was to develop a prediction rule to estimate the risk of an infection during hospital stay. The rule was designed for use at 48 h postoperatively, as the current protocol at our center is to stop prophylactic antibiotics at this time.
In this retrospective study we included all consecutive cardiac surgery procedures performed with CPB in patients under the age of 18 years, between April 2006 and May 2009 at the Wilhelmina Children’s Hospital, University Medical Center Utrecht, the Netherlands. The Wilhelmina Children’s Hospital is a university teaching hospital with a level III PICU, and is one of the four pediatric heart centers in the Netherlands. Patients were excluded if they died during or within 48 h after surgery, if charts were incomplete, or if long-term broad-spectrum antibiotics were already started preoperatively because of bloodstream infections. All data were collected by retrospective chart review using standardized case report forms. The local institutional medical ethics committee approved the study and waived the need for consent.
All patients received perioperative antibiotic prophylaxis, consisting of cefazolin 100 mg/kg a day, starting at the induction of anesthesia and continued until 48 h postoperatively or until sternal closure. A single dose of dexamethasone (1 mg/kg) was administered to all patients at the induction of anesthesia. Preoperative disinfection of the skin of the thorax was performed with chlorhexidine solution 0.5% in 70% alcohol. After correction of the heart defect and directly before skin closure, disinfection of the skin and wound margins was repeated with chlorhexidine solution 0.5% in 70% alcohol. During the study period no specific Staphylococcus aureus eradication protocols were performed. All procedures were performed by the same surgical and anesthesiology team, the latter being responsible for care in the operating room as well as at the PICU.
All known risk factors for postoperative infection from the literature were considered for use in the prediction model. However, only those readily available at the bedside were included in the analyses, and these were subsequently dichotomized (into a yes/no variable) using accepted thresholds from the literature. The eligible variables were age less than 6 months [2, 4, 9, 10, 11, 13, 14, 16]; preoperative admission at the PICU [3, 4, 9, 10, 13, 16]; surgical complexity [2, 3, 4, 10, 15]; previous cardiac surgery with the use of CPB [3, 4, 10, 14]; duration of surgery (timed from first incision until closure) greater than 3 h [9, 14]; CPB duration greater than 2 h [2, 3, 9, 14, 17, 18]; lowest nasopharyngeal temperature less than 25°C [16, 19, 20]; use of inotropes [2, 11, 13], endotracheal tube [5, 11, 13, 14], open sternum, and rethoracotomy [2, 3, 5, 12, 14, 16]; PICU stay longer than 48 h postoperatively [2, 3, 5, 6, 11, 13]; red blood cell transfusion (total of intra- and postoperative transfusion) greater than 50 mL/kg [3, 11, 14, 16, 17]; and peak glucose greater than 10 mmol/L in the first 24 h postoperatively [21, 22]. Surgical complexity was the only variable to be categorized into three groups, which was a simplified version of the RACHS-1 and Aristotle score [23, 24]. The ‘low complexity’ group (reference group) consisted of atrial and/or ventricular septal defect closures with or without ductus arteriosus ligation; the ‘high complexity’ group comprised all neonatal procedures resulting in a functionally univentricular heart. All other procedures were classified as ‘medium complexity’.
The primary outcome of this study consisted of all infections presenting between 48 h after surgery until discharge from hospital. The occurrence of a postoperative infection was defined by the criteria of the Centre of Disease Control (CDC), revised by Horan et al. in 2008 . If the origin or presence of an infection was not clear during chart review, the case was presented to an expert panel of two pediatric intensivists (NJGJ and AJvV) blinded to patient name and potentially predictive variables. When pneumonia was considered, chest X-rays were assessed by a pediatric radiologist (MG), similarly blinded. If there was consensus that a patient had an apparent infection, but insufficient data were available to classify the infection according to CDC criteria, it was classified as ‘infection not otherwise specified’. Bloodstream infections include both confirmed cases (‘laboratory confirmed’), and unconfirmed cases, where clinical symptoms suffice (‘clinical sepsis’), in accordance with the CDC criteria. Also, bloodstream infections were only classified as such when they were not related to an infection at another site. Surgical site infections (SSI) were categorized into incisional SSI or organ/space SSI. Incisional SSI consist of superficial and deep incisional SSI, where the superficial incisional SSI involve only skin and subcutaneous tissue, and the deep incisional SSI involve deep soft tissues (i.e., fascial and muscle layers). Because of the difficulty of retrospective assignment of tissue layers, these were combined into one category (incisional SSI). Organ/space SSI are defined as infections occurring in organs or spaces which are opened during the procedure, excluding skin, fascia, and muscle (e.g., mediastinitis, pleuritis). Microbiologic and virology data were collected from charts and the hospital database. Proven infections were defined as infections confirmed either by culture or polymerase chain reaction (PCR), and these infections were used as secondary outcome.
All variables were assessed for their association with infections using two-sided Pearson chi-square or Fisher’s exact tests, as appropriate. For missing data, imputation techniques were used as complete case analysis would probably introduce bias . A p value less than 0.15 in the univariable analysis allowed the variable to be used in the multivariable logistic regression model, providing it was not colinear with other variables (Pearson correlation greater than 0.7). Manual stepwise backward logistic regression was then performed. The choice for the final model was based on a balance between a high area under the curve (AUC) and the clinical utility. The discriminative potential of the final model was assessed using the AUC of the receiver operating characteristic (ROC) curve. A useless predictive model has an ROC-AUC of 0.5 and a perfectly predictive model results in an ROC-AUC of 1.0. The calibrative potential was assessed using the Hosmer–Lemeshow test. The final model was internally validated using bootstrap techniques, which provide a ‘shrinkage factor’ for the variable estimates. Alternative models that included more variables were compared with the final, fully reduced model. Furthermore, the robustness of the model was tested by using the secondary outcome (proven infections) and by repeating the analysis for complete cases only.
The final model was translated into a prediction rule, yielding ‘rule points’ for each variable. Rule points were calculated by dividing the multivariable regression coefficient by the lowest coefficient and rounding to the nearest integer. All patients were categorized according to their scores and the corresponding positive and negative predictive values were calculated. The calibration of the model was assessed by calculating the predicted risks of all cases belonging to one risk group.
Bootstrap techniques were performed with R for Windows version 2.10.1 (R Foundation for Statistical Computing, Vienna, Austria). SPSS version 15.0 (SPSS Inc., Chicago, IL) was used for all other statistical analyses.
All procedures (n = 412)
Procedures without infection (n = 310)
Procedures with infection (n = 102)
Postoperative PICU stay (days)
Postoperative hospital stay (days)
Postoperative infections occurred after 102 procedures, yielding an incidence of 25% (95% confidence interval [CI] 21–29). The total number of infections was 127, with 81 procedures being followed by a single infection, 17 procedures by two, and four procedures by three infections. The median start of infection was 7 days after surgery (interquartile range [IQR] 4–12).
Infection types and isolated microorganisms
Infection type (CDC criteria)
n (% of all infections)
Surgical site infection
Urinary tract infection
Respiratory tract infection
Total (% of all infections)
Univariable analysis of procedures without and with postoperative infection
Procedures without infection (n = 310)
Procedures with infection (n = 102)
OR (95% CI)
Age <6 monthsa
Preoperative admission PICUa
Previous cardiac surgery
Surgery duration >3 h
CPB duration >2 ha
Lowest nasal temp <25°Ca
Inotropes >48 h
Endotracheal tube >48 h
PICU stay >48 ha
Open sternum at 48 ha
RBC transfusion >50 mL/kga,b
Peak glucose >10 mmol/L in first 24 ha
Bootstrapping resulted in a shrinkage factor of 88%, suggesting some overfitting of the model. Addition of other clinical variables, yielded similar ROC-AUCs (e.g., with addition of surgical complexity, the ROC-AUC remained identical). A complete cases analysis also resulted in the same predictive variables and ROC-AUC. Finally, when proven infections only were used, the final model was similar but with a somewhat reduced ROC-AUC of 0.72 (95% CI 0.65–0.79).
Multivariable analysis and derivation of prediction rule points
Univariable OR (95% CI)
Multivariable OR (95% CI)
Points for rule
Age <6 months
PICU stay >48 h
Open sternum >48 h
Performance of various cutoffs for rule points
Number of rule points
True positive (n = 102)
Positive predictive value (%)
n (not in rule points)
True negative (n = 310)
Negative predictive value (%)
This study confirms that infections remain a common complication in children recovering from cardiac surgery. We propose a novel bedside scoring system to assess the risk of a postoperative infection in children following cardiac surgery. Using three variables, namely age less than 6 months, postoperative PICU stay longer than 48 h, and open sternum for longer than 48 h, patients at high risk of developing an infection can be distinguished from those at low risk.
Recently, Barker and colleagues  similarly developed a prediction rule, designed for clinical use. The model included the variables age, complexity, genetic abnormality, previous cardiac surgery, preoperative length of stay, and preoperative ventilator support. Although their model predicted as well as our study (ROC-AUC of 0.78), variables such as genetic abnormality and surgical complexity are not ideal in a bedside prediction rule, as the former has often not yet been confirmed preoperatively, and the latter demands a search through the extensive lists of Aristotle and RACHS-1 complexity scores. In addition, as the authors point out, many of the infection cases were diagnosed without the use of predefined specific criteria.
The current prediction rule is based on three simple variables: the age of the patient, PICU stay longer than 48 h, and an open sternum for longer than 48 h. Other studies have also shown that these are important risk factors for postoperative infections. Neonates and young infants are known to have an immature immune system lacking a proper innate immune response, likely responsible for the higher rate of infections in this group [2, 3, 4, 9, 11, 27]. Prolonged admittance (more than 48 h) at the PICU is commonly associated with longer duration of mechanical ventilation and increased use of intravascular catheters [3, 5, 9, 11]. Furthermore, delayed sternal closure has not only been associated with a higher risk of SSI, but also with an increased occurrence of bloodstream infections . As these two infection types make up the majority of the infections found in this study, this emphasizes the importance of the open sternum as a risk factor.
As our results show, the incidence of postoperative infections remains high. This may be due to the inclusion of all infections, as defined by the CDC criteria (revised in 2008), where not all infections require a positive culture or PCR . Comparing the specific infection incidences to those in the literature, SSI occurred after 6.4% of all procedures in this study, whereas this varies 0.0–9.9% in recent reports [1, 2, 3, 4, 9, 13, 27]. Regarding bloodstream infections, these also occurred after 6.4% of all procedures in our study, of which half were proven by cultures and the other half defined as ‘clinical sepsis’. Recent reported incidences vary from 2.6 to 15%, where comparison of incidences is again difficult due to different criteria [1, 2, 3, 4, 10]. The isolated pathogens in SSI are in accordance with the reports in the literature, as S. aureus was the most commonly found pathogen in our study [13, 14]. Similarly, bloodstream infections are most often caused by gram-positive species, which our study confirms .
Regarding the clinical application of our prediction rule, various options may be possible. Firstly, the rule may be used to determine those patients that are at the highest risk of an infection, i.e., for use in a clinical trial assessing the effectiveness of antimicrobial interventions. Secondly, clinicians may wish to use the model to decide on the routine antibiotic prophylaxis. As the most prevalent infections in our cohort were SSI and bloodstream infections, mostly caused by gram-positive bacteria, and with a median start of 1 week after surgery, a possibility may be to prolong the cefazolin treatment in high-risk groups. This may be prolonged for a set number of days, or for example until drains and/or central lines have been removed, as suggested in a recent study . Overall, improving compliance of personnel to hygiene measures is likely one of the most important issues in infection prevention.
However, a preventive strategy specifically directed at one type of infection may be more effective. It was recently shown in adults that preoperative screening and eradication of S. aureus was an effective preventive measure . Since the end of our study, this has become common practice in our hospital, the results of which have to be evaluated in future. Another preventive strategy against SSI is the continuation of prophylactic antibiotics for 2–3 days after delayed sternal closure, with or without routine culturing of the sternum, which may or may not induce antimicrobial resistance [29, 31, 32]. Regarding bloodstream infections, the use of lines coated with antibiotics, chlorhexidine wound dressings, routine culturing of incision sites, or the continuation of antibiotics are all possible measures to consider [33, 34].
Limitations of this study mainly apply to issues of heterogeneity in the infection cases. As we assessed all types of postoperative infections, we cannot define which risk factors specifically predict a surgical site infection, a bloodstream infection, or an airway infection. This is due to the size of our cohort, which restricts multivariable analyses per subgroup. However, a (smaller) single-center study usually does result in a more homogeneous group as far as perioperative strategies are concerned. Also, all data can be verified, which is crucial to the validity, especially in a study focussed on infections. Another limitation is that the prediction model has not been externally validated. The specific perioperative management at our hospital may differ from others, although our infection cases are very similar to those in the literature. Important characteristics of our perioperative management are the choice of cefazolin as perioperative prophylaxis and the use of dexamethasone during the induction of anesthesia (which may or may not influence susceptibility to infections [35, 36]). Finally, it is important to note that the prediction rule proposed in this study is based on categories of patients. Hence, the individual patient, who may already clinically show signs of a local infection, will likely have higher odds of infection than the predicted ‘baseline’ risk stated in this paper. However, aspecific clinical symptoms such as fever or a high C-reactive protein level after cardiac surgery fail to predict occurrence of an infection, which underlines the need for a reliable prediction rule .
In conclusion, postoperative infections remain common in this recent cohort of children undergoing cardiac surgery. Using important risk factors, we have developed a bedside prediction rule which estimates the risk of a subsequent infection during hospital stay. This tool may prove useful for directing preventive measures to those patients at the highest risk.
The authors would like to thank Prof. A.J. van Vught (Pediatric Intensive Care, University Medical Center Utrecht, the Netherlands) for taking part in our infection expert panel, Dr. M. de Groot (Radiology, University Medical Center Utrecht, the Netherlands) for giving her expert opinion on the chest X-rays, and Dr. R.H.H. Groenwold for assistance with bootstrapping techniques. Project support was entirely from institutional departmental funds.
Conflicts of interest
The authors have no conflicts of interest.
This article is distributed under the terms of the Creative Commons Attribution Noncommercial License which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.