Abstract
We assessed the diagnostic accuracy of the age-adjusted quick Sequential Organ Failure Assessment score (qSOFA) for predicting mortality and disease severity in pediatric patients with suspected or confirmed infection. We conducted a systematic search of PubMed, EMBASE, the Cochrane Library, and Web of Science. Eleven studies with a total of 172,569 patients were included in the meta-analysis. The pooled sensitivity, specificity, and diagnostic odds ratio of the age-adjusted qSOFA for predicting mortality and disease severity were 0.69 (95% confidence interval [CI] 0.53–0.81), 0.71 (95% CI 0.36–0.91), and 6.57 (95% CI 4.46–9.67), respectively. The area under the summary receiver-operating characteristic curve was 0.733. The pooled sensitivity and specificity for predicting mortality were 0.73 (95% CI 0.66–0.79) and 0.63 (95% CI 0.21–0.92), respectively. The pooled sensitivity and specificity for predicting disease severity were 0.73 (95% CI 0.21–0.97) and 0.72 (95% CI 0.11–0.98), respectively. The performance of the age-adjusted qSOFA for predicting mortality and disease severity was better in emergency department patients than in intensive care unit patients. The age-adjusted qSOFA has moderate predictive power and can help in rapidly identifying at-risk children, but its utility may be limited by its insufficient sensitivity.
Similar content being viewed by others
Introduction
Recently, remarkable progress has been achieved in reducing overall incidence of infectious diseases1,2. However, infectious diseases remain a leading cause of childhood morbidity and mortality globally3,4. Specifically, mortality of up to 20% has been reported in children with sepsis5, largely because the lack of specific signs and symptoms in children makes early diagnosis and treatment challenging6. In addition, rapid deterioration can occur when compensation fails in pediatric patients7,8. Thus, early recognition of sepsis is crucial to ensure timely management and to reduce mortality9,10.
Pediatric sepsis has been defined by the International Pediatric Sepsis Consensus Conference (IPSCC) as the presence of systemic inflammatory response syndrome (SIRS) with suspected or proven infection in a child11. However, the SIRS criteria lack specificity for identifying infected patients at high risk of mortality because children with non-infectious conditions can also meet the SIRS criteria; moreover, children who meet the SIRS criteria for sepsis often do not have organ dysfunction12,13.
In the case of adults, the Sepsis-1 and Sepsis-2 consensus definitions also adopted the SIRS criteria14,15. However, the Third International Consensus Definitions for Sepsis and Septic Shock (SEPSIS-3) task force revised the sepsis definition as the presence of a dysregulated host response that manifests as detrimental organ dysfunction, thus enabling the differentiation of sepsis from uncomplicated infections or non-infectious conditions16,17. Organ dysfunction is specifically defined by acute changes in the Sequential Organ Failure Assessment score (SOFA) with ≥ 2 points16,17.
The SEPSIS-3 task force also recommended the bedside tool, the quick SOFA (qSOFA), for the early recognition of adult patients with suspected infection at risk for poor outcomes. The qSOFA is a simplified version of the SOFA, comprising only three components: low systolic blood pressure (≤ 100 mmHg), high respiratory rate (≥ 22 breaths/min), and altered mental status (Glasgow Coma Scale [GCS] < 15)16,17. The SOFA and qSOFA showed better prognostic performance than the former sepsis criteria among adult patients in various clinical settings17,18,19,20. However, the SEPSIS-3 criteria were developed and validated for adult patients and did not consider age-dependent physiologic variables16.
Recently, there have been attempts to adapt the SEPSIS-3 criteria for pediatric patients21,22. The age-adjusted or age-adapted qSOFA, which is adjusted according to age-specific cutoffs, has shown promising results among pediatric patients in emergency department (ED)23,24 and intensive care unit (ICU) settings13,25. However, there is no systematic review and meta-analysis reporting the predictive value of the age-adjusted qSOFA in children. Therefore, we aimed to evaluate the performance of the age-adjusted qSOFA in predicting outcomes, including mortality and disease severity, among pediatric patients with suspected or confirmed infection.
Materials and methods
This systematic review and meta-analysis is reported according to the Preferred Reporting Items for Systematic reviews and Meta-Analyses statement (PRISMA)26 and is registered with PROSPERO (CRD42021232257).
Study selection, eligibility, and data extraction
Two authors (SHY and HK) independently conducted literature searches of PubMed, EMBASE, the Cochrane Library, and Web of Science, without language or time restrictions, on January 6, 2021, with the aim of finding eligible studies assessing the performance of age-adjusted qSOFA in predicting mortality and/or disease severity in pediatric patients with suspected or confirmed infection. Various combinations of the following key words were used in the systematic search: “Quick Sequential Organ Failure Assessment,” “qSOFA,” “quick SOFA,” “q-SOFA,” “quick-SOFA,” and “pediatric,” “child,” “adolescent,” “infant,” and “neonate.”
Studies were eligible if they aimed to assess the performance of age-adjusted qSOFA to predict mortality or disease severity in pediatric patients (aged < 18 years) with suspected or confirmed infection. We used the following as indicators reflecting disease severity: admission or transfer to an ICU (including a critical care unit), development of severe sepsis11, or prolonged hospital stay (dependent on the authors’ definition, regardless of duration). If enrolled patients received a diagnostic code (e.g., International Classification of Diseases code) indicative of an infection or were diagnosed with sepsis/septic shock via consensus definition, we accepted them as patients with confirmed infection. In addition, if enrolled patients had signs or symptoms of infection (e.g., fever), or were treated for a bacterial infection (e.g., treated with therapeutic antibiotics), we inferred suspected infection. Studies were included if they reported sufficient data to construct a 2 × 2 contingency tables. Reviews, editorials, expert opinions, animal experiments, or studies presenting duplicate data were excluded.
The following information was retrieved from each study: first author, publication year, sample size, patient source (e.g., ED or ICU), time of age-adjusted qSOFA assessment, cutoff criteria of age-adjusted qSOFA, true positives, false positives, true negatives, and false negatives derived from the sensitivity and specificity of the age-adjusted qSOFA in predicting mortality and disease severity. When studies comprised multiple groups, each group was considered as an individual study.
Quality assessment
Currently, there is no widely used assessment tool for assessing the quality of studies of predictive risk scores. This study used a revised seven-item quality assessment scale27,28, which was derived from the Quality Assessment of Diagnostic Accuracy Studies tool29 and Newcastle–Ottawa Scale30. It comprises seven criteria: unbiased patient selection; representative of a wide spectrum of disease severity; predictor variables assessed blinded to outcome; outcome assessed blinded to the predictor variables; accurate definition of outcomes; availability of the same clinical data; and adequate follow-up27,28. We defined adequate follow-up as a follow-up of > 90%. Two reviewers (SE and SHY) independently performed the methodological quality assessment. Any disagreements were resolved by discussion.
Statistical analyses
Summary estimates of sensitivity, specificity, positive and negative likelihood ratios (LR+ and LR–), and pooled diagnostic odds ratio (DOR) were calculated using a bivariate random-effects model31. The DOR of a test (or score) is the ratio of the odds of positivity among patients versus the odds among healthy individuals or a control group32,33. When the DOR increases to greater than 1, the discriminative power of the outcome becomes greater32. We used summary receiver-operating characteristic (SROC) curves to calculate the area under the curve (AUC), which assisted in estimating the discriminative power of a test or score33. The AUC takes values between 0 and 1, with higher values indicating better test (or score) performance34. Heterogeneity of sensitivity and specificity were evaluated from the forest plots of the studies’ estimates and using a χ2 test (P < 0.1, significant). In the presence of significant heterogeneity, we conducted meta-regression analysis and a priori planned subgroup analysis to explore the sources of heterogeneity using the following as covariates with 95% confidence interval (CI): patient source (ED vs. ICU); sample size (< 10,000 vs. ≥ 10,000); outcome (mortality vs. disease severity); scales for assessing mental status in age-adjusted qSOFA (GCS vs. Alert, Voice, Pain, Unresponsive [AVPU] scale); age-specific vital signs criteria (2005 IPSCC definition vs. others); center (single center vs. multicenter); and cut-off value (≥ 2 vs. ≥ 1). We excluded studies in the meta-regression analysis if they used both the GCS and AVPU scale for mental status checks, or if their primary outcome was both in-hospital mortality and disease severity concomitantly. In addition, we also performed pooled analysis using one study population per study to examine whether the results were biased by including the same populations multiple times. As the reason for separation into different datasets from a study varies (e.g., outcomes, cutoff, age-specific vital signs criteria), we selected the data using the cutoff value of ≥ 2 and 2005 IPSCC definition as age-specific vital sign criteria. We measured publication bias with visualization of funnel plots and Egger’s test. Statistical analyses and meta-analyses were conducted using R program, version 3.6.3 (R Foundation for Statistical Computing, Vienna, Austria); P-values < 0.05 were considered statistically significant.
Results
PubMed, EMBASE, Web of Science and Cochrane database searches as per the predefined search words revealed 81 articles. After removing duplicates and screening abstracts, 20 full-text articles were read, resulting in 11 articles that met the inclusion criteria for the systematic review and meta-analysis. Reasons for exclusion are shown in the flow diagram (Fig. 1). Data from 172,569 patients of 11 observational studies13,23,24,25,35 were finally included. The general characteristics of the included studies are presented in Table 1 and Supplementary Table S1.
Study characteristics
The majority of studies were retrospective, and only one study13 was prospective. Six studies13,24,25 were designed to evaluate the value of the age-adjusted qSOFA in predicting mortality. Four studies24,35 evaluated the performance of the age-adjusted qSOFA in predicting disease severity; three studies24,35 evaluated the value of qSOFA in predicting ICU admission, and one study35 evaluated the value of qSOFA in predicting the development of severe sepsis11. Only one study23 was designed to evaluate the ability of the age-adjusted qSOFA to predict both ICU transfer and/or mortality within 30 days as the primary outcome.
Patient sources were as follows: 122,943 ICU patients from four studies13,25, 49,448 ED patients from five studies23,24, and 178 pediatric tertiary referral center patients from two studies35. The majority of the studies were single-center studies (n = 7, 63.6%)23,24,35 and chose cut-off criteria as ≥ 2 (n = 9, 81.8%)13,23,24,25,35. Most studies (n = 9, 81.8%)13,23,24,25,35 adopted the 2005 IPSCC definition for age-specific vital signs criteria. Six (54.5%) 13,25,35 studies used GCS, four studies (36.4%)24 used AVPU, and one study23 used either GCS or AVPU to assess mental status. All of the studies were published between 2018 and 2020 (Table 1 and Supplementary Table S1).
Quality assessment of the included studies
Three studies (27.3%) enrolled patients consecutively25, and one single-center study23 defined suspected bacterial infection as the commencement of antibiotics within 24 h after ED arrival at the non-academic facility and excluded surgical diagnoses; thus, the study was deemed not representative of a wide spectrum of disease severity. Although all studies assessed the predictor variables that constituted the age-adjusted qSOFA blinded to outcomes, no studies clearly reported that the outcomes were assessed blindly to the age-adjusted qSOFA. Overall, outcomes were clearly defined and the same clinical data was available in all studies. All included studies showed adequate follow-up of patients (Supplementary Table S2).
Age-adjusted qSOFA for predicting mortality and disease severity
Included studies showed a wide range of sensitivities (0.29–1.00) and specificities (0.05–0.99) (Fig. 2 and Supplementary Table S3). Pooled sensitivity and specificity of qSOFA for predicting mortality and disease severity are 0.685 (95% CI 0.527–0.809) and 0.706 (95% CI 0.362–0.911), respectively. Pooled LR+, LR–, and DOR were 2.919 (95% CI 2.186–3.898), 0.519 (95% CI 0.428–0.630), and 6.565 (95% CI 4.459–9.667), respectively. The AUC was 0.733 (95% CI 0.683–0.768) (Fig. 3). Significant heterogeneity was noted in terms of sensitivity (χ2 = 233.079; P < 0.001) and specificity (χ2 = 47,040.96; P < 0.001). No significant publication bias was found in the funnel plot and Egger’s test (P = 0.8671) (Supplementary Fig. S1). When including one study population per study, five studies with a total of 55,301 patients were included and analyzed. Compared with the original results, the pooled sensitivity was slightly lower (0.685 vs. 0.571), and pooled specificity was higher (0.706 vs. 0.851). However, the pooled results of DOR (6.565 vs. 6.816) and AUC (0.733 vs. 0.711) were similar (Supplementary Tables S4 and S5 and Supplementary Figs. S2–S4).
Summary receiver-operating characteristic (SROC) curve of the predictive performance of age-adjusted quick Sequential Organ Failure Assessment score for mortality and disease severity in pediatric patients with suspected or confirmed infection. The area under the curve of the SROC was 0.733 (95% CI 0.683–0.768). conf.region, 95% confidence region for SROC curve.
Heterogeneity exploration and subgroup analysis
A meta-regression analysis revealed that patient source, sample size, outcome, center, and scales for assessing mental status were significant factors affecting heterogeneity (Supplementary Table S6). When comparing summary estimates of the DOR between subgroups, significant differences were only found in relation to patient source and scales for assessing mental status (Table 2). Age-adjusted qSOFA showed a significantly higher pooled DOR in the studies including ED patients than in the studies including ICU patients [22.214 (95% CI 7.115–69.360) vs. 4.092 (95% CI 3.058–5.474), P = 0.005]; Studies that used the AVPU to assess mental status also showed a significantly higher pooled DOR compared with studies that used the GCS [23.009 (95% CI 4.559–116.123) vs. 3.968 (95% CI 3.015–5.224), P = 0.036].
Age-adjusted qSOFA for mortality
Six studies assessed the performance of age-adjusted qSOFA for predicting mortality. Pooled sensitivity and specificity of age-adjusted qSOFA for predicting mortality were 0.729 (95% CI 0.655–0.792) and 0.626 (95% CI 0.206–0.915), respectively. Pooled LR+, LR– and DOR were 1.925 (95% CI 1.629–2.275), 0.452 (95% CI 0.381–0.535), and 4.433 (95% CI 3.223–6.097), respectively. AUC was found to be 0.735 (95% CI 0.677–0.780) (Table 3). Further detailed accuracy estimates, coupled forest plots, SROC curves, and heterogeneity test results of studies evaluating predictive accuracy of the age-adjusted qSOFA for mortality are provided in the Supplementary Tables S7 and S8 and Supplementary Figs. S5–S7.
Age-adjusted qSOFA for disease severity
Four studies reported the performance of age-adjusted qSOFA for predicting disease severity. Pooled sensitivity and specificity of age-adjusted qSOFA for predicting disease severity was 0.731 (95% CI 0.207–0.966) and 0.724 (95% CI 0.113–0.982). Pooled LR+, LR–, and DOR were 3.341 (95% CI 0.498–22.416), 0.708 (95% CI 0.618–0.811), and 8.866 (95% CI 1.355–58.035), respectively. The AUC was 0.786 (95% CI 0.518–0.905) (Table 3). Detailed accuracy estimates, coupled forest plots, SROC curves, and heterogeneity test results of studies evaluating the predictive accuracy of the age-adjusted qSOFA for disease severity are provided in the Supplementary Tables S9 and S10 and Supplementary Figs. S8–S10.
Discussion
In this review, we assessed the performance of the age-adjusted qSOFA in predicting mortality and disease severity in pediatric patients with suspected or confirmed infection. We identified 11 studies, including 172,569 patients from the ED, pediatric tertiary referral center, and ICU. We found that the age-adjusted qSOFA had a moderate performance for predicting in-hospital mortality and disease severity in pediatric patients.
The qSOFA was initially recommended by the SEPSIS-3 task force as a readily available bedside tool16,36, and the age-adjusted qSOFA has the same advantages: it does not require laboratory tests and enables prompt and repeatable assessment of patients. However, as a screening tool to identify ‘at-risk patients’, the age-adjusted qSOFA satisfies the requirements for convenience and feasibility, but does not satisfy the requirement for high sensitivity37. In clinical practice, screening tools typically require high sensitivity to safely rule out those at low risk of adverse outcomes38.
Determining which patients are at high risk of severe illness or mortality is essential for appropriate clinical decision making. When clinicians initially encounter pediatric patients with suspected infection, the specific outcomes (e.g. mortality, ICU admission or prolonged hospital admission itself) would be not matter at that moment, only whether this patient has a potential to become a severe, critical patient requiring close observation, and intensive treatment will be of more interest to clinicians. Thus, we intended to assess the predictive performance of age-adjusted qSOFA as a quick, easy, bedside screening tool for identifying these ‘at risk patients’. Then, we demonstrated the individual performance of age-adjusted qSOFA according to the specific outcomes, such as mortality and disease severity, for clinicians to consider further prognostic aspects.
As described in previous studies39,40,41, we assessed the discriminative power of the prediction score (age-adjusted qSOFA) for identifying at-risk pediatric patients by calculating AUC. An AUC above 0.7 was considered to be acceptable and useful34,40. In our results, aged-adjusted qSOFA achieved an AUC of 0.733, indicating a useful discrimination for pediatric patients at risk who need close monitoring and intensive treatment.
Likewise, the DOR was also calculated as another single indicator of age-adjusted qSOFA performance for discrimination of at-risk patients42. DOR of 6.57 in our result means that the odds of positivity (above cutoff value of age-adjusted qSOFA) in at risk patients is about six times higher than the odds of positivity in non-risk patients. DOR does not depend on disease prevalence33. However, it depends on what criteria are used to define disease or pathological conditions of the study population (e.g., comorbidity, disease severity)33. Because considerable heterogeneity existed in our analysis, we conducted the subgroup analysis of DOR of age-adjusted qSOFA according to the various factors that can affect the results and also the causes of the heterogeneity in the pooled analysis.
Regarding patient sources, qSOFA has reported a better predictive power to that of the full SOFA for in-hospital mortality in adult patients outside the ICU16,17. However, the full SOFA showed higher predictive validity when compared with the qSOFA among patients in the ICU16,17. The majority of patients in ICU are administered vasopressor support and/or mechanical ventilation, thus the qSOFA may not have a reasonable clinical value for patients in this setting17. Our results also found that the age-adjusted qSOFA has a better DOR for predicting mortality and disease severity in ED patients than in ICU patients. These results showed that the age-adjusted qSOFA is more useful for screening pediatric patients outside the ICU.
Scales assessing mental status is a significant source of heterogeneity in this meta-analysis. Currently, the qSOFA in adults uses the GCS16. In our analysis, studies using the AVPU to assess mental status showed higher predictive performance than studies using the GCS. The AVPU scale is less complex than the GCS, and uses only four categories (Alert; Verbal response; response to Pain; Unresponsive). The AVPU scale can be used quickly and easily43 and has been reported to correlate well with the GCS44. According to the results of this study, it is reasonable to use the AVPU scale to assess mental status in the age-adjusted qSOFA.
However, there are important limitations to the application of the age-adjusted qSOFA in the pediatric field. First, there is a global tendency not to measure blood pressure in pediatric acute care settings45. In addition, hypotension presents at a late stage of septic shock in pediatric patients7,46. Unlike adults, blood pressure is typically maintained in children in the early stage of septic shock, compensated by increased heart rate and systemic vascular resistance47,48,49. Thus, it may not be a valuable measure in frontline health care facilities such as ED47.
To address these limitations, Romaine et al.24 suggested a novel scale, the “Liverpool quick Sequential Organ Failure Assessment (LqSOFA)” score. The LqSOFA score, which ranges 0–4, comprises respiratory rate, age-adjusted heart rate, capillary refill time, and level of consciousness assessed using the AVPU scale. Romaine et al.24 reported that LqSOFA with ≥ 2 criteria showed equal sensitivity (0.6) and specificity (0.988) for predicting sepsis-related mortality when compared with an age-adjusted qSOFA with ≥ 2 criteria. In addition, when compared with age-adjusted qSOFA ≥ 2 criteria, LqSOFA ≥ 2 criteria showed low but better sensitivity (0.392 vs. 0.289) and similar high specificity (0.992 vs. 0.991) for the prediction of critical care admission within 48 h.
When comparing SIRS to qSOFA criteria, recent meta-analyses have consistently presented a higher sensitivity but lower specificity of SIRS criteria than those of the qSOFA for the prediction of in-hospital mortality among adult patients in various clinical settings39,50,51,52,53. In this review, we could not compare the pooled predictive performance of the age-adjusted qSOFA with that of the SIRS criteria, because there were few pediatric studies that provided the required data. Schlapbach et al.13 compared the predictive performance of the age-adjusted qSOFA with that of SIRS criteria for in-hospital mortality and showed that the age-adjusted qSOFA had a lower sensitivity but higher specificity and LR+ than those of SIRS criteria. Higher specificity and LR+ indicate that the age-adjusted qSOFA is a better scale for ruling in pediatric patients at risk of mortality. Regarding disease severity, van Nassau et al.23 reported that age-adjusted qSOFA ≥ 2 criteria showed lower sensitivity and LR+ but higher specificity than those of SIRS ≥ 2 criteria in predicting prolonged hospitalization (length of stay ≥ 7 days).
The present study has several strengths. As far as we are aware, our review is the first systematic review and meta-analysis to evaluate the predictive performance of the age-adjusted qSOFA in pediatric patients. Our meta-analyses used data from favorable quality studies with a large sample size. This may provide the substrate for future guidelines for screening infectious pediatric patients who are likely to progress to severe disease, or who are at risk of death.
This study has some limitations. First, there is a significant heterogeneity in this meta-analysis. We investigated the factors affecting heterogeneity by meta-regression and subgroup analysis, although we could not investigate factors related to differing diagnostic criteria and specific clinical settings. Second, if the predictive ability of the age-adjusted qSOFA was assessed with different outcomes or with different criteria in a same cohort, we consider them as separate studies54. Because the pooled results of AUC and DOR were similar between results using one study population per study and results using several datasets from the same study population, the overall predictive power of the age-adjusted qSOFA for mortality and morbidity can be considered similar in both analyses. This also indicates that the results would not to be strongly biased by including the same populations multiple times. Nevertheless, our results still need to be interpreted and applied cautiously because the same study population were pooled. Third, most of the included studies are retrospective studies, which were not devised to the validate the age-adjusted qSOFA. Fourth, most of the studies were conducted in western countries. Further studies are required to ensure the applicability of the results of studies of the age-adjusted qSOFA to other countries. Fifth, we did not search gray literature, as we aimed to review the characteristics of published literature. Incorporating a gray literature search may help to minimize the effects of publication bias55; however, we found no significant publication bias in this analysis. Sixth, long-term outcomes or healthcare costs were not available in the literature that was included; thus we could not evaluate these in this analysis. Finally, we could not compare the overall predictive performance of the age-adjusted qSOFA with other predictive biomarkers, due to the limited number of clinical studies.
Conclusions
Current evidence suggests that the age-adjusted qSOFA has a moderate predictive value for mortality and disease severity in pediatric patients with suspected or confirmed infection. The age-adjusted qSOFA is a simple and feasible tool to use in settings outside the ICU such as ED, and in resource-limited settings. However, a screening tool with higher sensitivity for pediatric patients is needed.
Data availability
All data generated or analyzed during this systematic review are included in this manuscript (and its Supplementary Materials).
References
Lepage, P. & Blumental, S. Specialty grand challenge in pediatric infectious diseases. Front. Pediatr. 5, 185–185 (2017).
Yang, S. et al. Epidemiological features of and changes in incidence of infectious diseases in China in the first decade after the SARS outbreak: An observational trend study. Lancet Infect Dis 17, 716–725 (2017).
Bhutta, Z. A. & Saeed, M. A. Childhood infectious diseases: Overview. Int. Encycl. Public Health, 620–640 (2008).
Organization, W. H. Children: Improving Survival and Well-being (World Health Organization, 2020).
Fleischmann-Struzek, C. et al. The global burden of paediatric and neonatal sepsis: A systematic review. Lancet Respir. Med. 6, 223–230 (2018).
Mathias, B., Mira, J. C. & Larson, S. D. Pediatric sepsis. Curr. Opin. Pediatr. 28, 380–387 (2016).
Brierley, J. et al. Clinical practice parameters for hemodynamic support of pediatric and neonatal septic shock: 2007 update from the American College of Critical Care Medicine. Crit. Care Med. 37, 666–688 (2009).
Han, Y. Y. et al. Early reversal of pediatric-neonatal septic shock by community physicians is associated with improved outcome. Pediatrics 112, 793–799 (2003).
Cavaillon, J.-M., Singer, M. & Skirecki, T. Sepsis therapies: Learning from 30 years of failure of translational research to propose new leads. EMBO Mol. Med. 12, e10128 (2020).
Husabø, G. et al. Early diagnosis of sepsis in emergency departments, time to treatment, and association with mortality: An observational study. PLoS ONE 15, e0227652 (2020).
Goldstein, B., Giroir, B. & Randolph, A. International pediatric sepsis consensus conference: Definitions for sepsis and organ dysfunction in pediatrics. Pediatr. Crit. Care Med. 6, 2–8 (2005).
Scott, H. F., Deakyne, S. J., Woods, J. M. & Bajaj, L. The prevalence and diagnostic utility of systemic inflammatory response syndrome vital signs in a pediatric emergency department. Acad. Emerg. Med. 22, 381–389 (2015).
Schlapbach, L. J., Straney, L., Bellomo, R., MacLaren, G. & Pilcher, D. Prognostic accuracy of age-adapted SOFA, SIRS, PELOD-2, and qSOFA for in-hospital mortality among children with suspected infection admitted to the intensive care unit. Intensive Care Med. 44, 179–188 (2018).
Bone, R. C. et al. Definitions for sepsis and organ failure and guidelines for the use of innovative therapies in sepsis. The ACCP/SCCM Consensus Conference Committee. American College of Chest Physicians/Society of Critical Care Medicine. Chest 101, 1644–1655 (1992).
Levy, M. M. et al. 2001 SCCM/ESICM/ACCP/ATS/SIS international sepsis definitions conference. Intensive Care Med. 29, 530–538 (2003).
Singer, M. et al. The third international consensus definitions for sepsis and septic shock (Sepsis-3). JAMA 315, 801–810 (2016).
Seymour, C. W. et al. Assessment of clinical criteria for sepsis: for the third international consensus definitions for sepsis and septic shock (Sepsis-3). JAMA 315, 762–774 (2016).
Raith, E. P. et al. Prognostic accuracy of the SOFA score, SIRS criteria, and qSOFA score for in-hospital mortality among adults with suspected infection admitted to the intensive care unit. JAMA 317, 290–300 (2017).
Wang, J. Y., Chen, Y. X., Guo, S. B., Mei, X. & Yang, P. Predictive performance of quick Sepsis-related Organ Failure Assessment for mortality and ICU admission in patients with infection at the ED. Am. J. Emerg. Med. 34, 1788–1793 (2016).
Freund, Y. et al. Prognostic accuracy of sepsis-3 criteria for in-hospital mortality among patients with suspected infection presenting to the Emergency Department. JAMA 317, 301–308 (2017).
Matics, T. J. & Sanchez-Pinto, L. N. Adaptation and validation of a pediatric sequential organ failure assessment score and evaluation of the sepsis-3 definitions in critically ill children. JAMA Pediatr. 171, e172352 (2017).
Kawasaki, T. et al. Paediatric sequential organ failure assessment score (pSOFA): A plea for the world-wide collaboration for consensus. Intensive Care Med. 44, 995–997 (2018).
van Nassau, S. C. et al. Translating sepsis-3 criteria in children: Prognostic accuracy of age-adjusted quick SOFA score in children visiting the Emergency Department with suspected bacterial infection. Front. Pediatr. 6, 266 (2018).
Romaine, S. T. et al. Accuracy of a modified qSOFA score for predicting critical care admission in febrile children. Pediatrics 146, e20200782 (2020).
Peters, C., Murthy, S., Brant, R., Kissoon, N. & Görges, M. Mortality risk using a pediatric quick sequential (sepsis-related) organ failure assessment varies with vital sign thresholds. Pediatr. Crit. Care Med. 19, e394–e402 (2018).
Moher, D., Liberati, A., Tetzlaff, J. & Altman, D. G. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. J. Clin. Epidemiol. 62, 1006–1012 (2009).
Hess, E. P. et al. Diagnostic accuracy of the TIMI risk score in patients with chest pain in the emergency department: A meta-analysis. CMAJ 182, 1039–1044 (2010).
Gao, W., Yang, H. X. & Ma, C. E. The value of BISAP score for predicting mortality and severity in acute pancreatitis: A systematic review and meta-analysis. PLoS ONE 10, e0130412 (2015).
Whiting, P., Rutjes, A. W., Reitsma, J. B., Bossuyt, P. M. & Kleijnen, J. The development of QUADAS: A tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC Med. Res. Methodol. 3, 25 (2003).
Wells, G. A., Shea B., O’Connell, D., Peterson, J., Welch, V., Losos, M. & Tugwell, P. The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomized studies in meta-analyses http://www.ohri.ca/programs/clinical_epidemiology/oxford.asp (2009).
Reitsma, J. B. et al. Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. J. Clin. Epidemiol. 58, 982–990 (2005).
Karakaya, J. Evaluation of binary diagnostic tests accuracy for medical researches. Turk. J. Biochem. 46, 103–113 (2021).
Šimundić, A.-M. Measures of diagnostic accuracy: basic definitions. EJIFCC 19, 203–211 (2009).
Mandrekar, J. N. Receiver operating characteristic curve in diagnostic test assessment. J. Thorac. Oncol. 5, 1315–1316 (2010).
Zallocco, F. et al. Assessment of clinical outcome of children with sepsis outside the intensive care unit. Eur. J. Pediatr. 177, 1775–1783 (2018).
Shankar-Hari, M. et al. Developing a new definition and assessing new clinical criteria for septic shock: For the third international consensus definitions for sepsis and septic shock (Sepsis-3). JAMA 315, 775–787 (2016).
Maxim, L. D., Niebo, R. & Utell, M. J. Screening tests: A review with examples. Inhalation Toxicol. 26, 811–828 (2014).
Galvin, R. et al. Adverse outcomes in older adults attending emergency departments: A systematic review and meta-analysis of the Identification of Seniors at Risk (ISAR) screening tool. Age Ageing 46, 179–186 (2016).
Maitra, S., Som, A. & Bhattacharjee, S. Accuracy of quick Sequential Organ Failure Assessment (qSOFA) score and systemic inflammatory response syndrome (SIRS) criteria for predicting mortality in hospitalized patients with suspected infection: A meta-analysis of observational studies. Clin. Microbiol. Infect. 24, 1123–1129 (2018).
Altschul, D. J. et al. A novel severity score to predict inpatient mortality in COVID-19 patients. Sci. Rep. 10, 16726 (2020).
Suwanpasu, S. & Sattayasomboon, Y. Accuracy of Modified Early Warning Scores for predicting mortality in hospital: A systematic review and meta-analysis. J. Intensive Crit. Care 2, 29 (2016).
Glas, A. S., Lijmer, J. G., Prins, M. H., Bonsel, G. J. & Bossuyt, P. M. The diagnostic odds ratio: A single indicator of test performance. J. Clin. Epidemiol. 56, 1129–1135 (2003).
Nuttall, A. G., Paton, K. M. & Kemp, A. M. To what extent are GCS and AVPU equivalent to each other when assessing the level of consciousness of children with head injury? A cross-sectional study of UK hospital admissions. BMJ Open 8, e023216–e023216 (2018).
Hoffmann, F. et al. Comparison of the AVPU scale and the pediatric GCS in prehospital setting. Prehosp. Emerg. Care 20, 493–498 (2016).
Marlais, M., Lyttle, M. D. & Inwald, D. T. Ten concerns about blood pressure measurement and targets in paediatric sepsis. Intensive Care Med. 43, 433–435 (2017).
Randolph, A. G. & McCulloh, R. J. Pediatric sepsis: Important considerations for diagnosing and managing severe infections in infants, children, and adolescents. Virulence 5, 179–189 (2014).
Fleming, S. et al. The diagnostic value of capillary refill time for detecting serious illness in children: A systematic review and meta-analysis. PLoS ONE 10, e0138155 (2015).
Davis, A. L. et al. American College of Critical Care Medicine clinical practice parameters for hemodynamic support of pediatric and neonatal septic shock. Crit. Care Med. 45, 1061–1093 (2017).
Fathi, E. M., Narchi, H. & Chedid, F. Noninvasive hemodynamic monitoring of septic shock in children. World J. Methodol. 8, 1–8 (2018).
Franchini, S., Scarallo, L., Carlucci, M., Cabrini, L. & Tresoldi, M. SIRS or qSOFA? Is that the question? Clinical and methodological observations from a meta-analysis and critical review on the prognostication of patients with suspected sepsis outside the ICU. Intern. Emerg. Med. 14, 593–602 (2019).
Jiang, J., Yang, J., Mei, J., Jin, Y. & Lu, Y. Head-to-head comparison of qSOFA and SIRS criteria in predicting the mortality of infected patients in the emergency department: A meta-analysis. Scand. J. Trauma Resusc. Emerg. Med. 26, 56 (2018).
Song, J. U., Sin, C. K., Park, H. K., Shim, S. R. & Lee, J. Performance of the quick Sequential (sepsis-related) Organ Failure Assessment score as a prognostic tool in infected patients outside the intensive care unit: A systematic review and meta-analysis. Crit. Care 22, 28 (2018).
Fernando, S. M. et al. Prognostic accuracy of the quick sequential organ failure assessment for mortality in patients with suspected infection: A systematic review and meta-analysis. Ann. Intern. Med. 168, 266–275 (2018).
Rao, G. et al. Methodological standards for meta-analyses and qualitative systematic reviews of cardiac prevention and treatment studies: A scientific statement from the American Heart Association. Circulation 136, e172–e194 (2017).
Paez, A. Gray literature: An important resource in systematic reviews. J. Evid. Based Med. 10, 233–240 (2017).
Funding
This research received no external funding.
Author information
Authors and Affiliations
Contributions
Conceptualization, S.E. and S.H.Y.; methodology, S.H.Y., H.Y.K. and M.L.; validation, HJ.K., C.M.K. and G.E.B.; formal analysis and visualization, H.Y.K. and M.L.; investigation, S.E., HM.K. and S.H.Y.; data curation, HM.K. and S.H.Y.; writing—original draft preparation, S.E. and S.H.Y.; writing—review and editing, S.H.Y. and M.K.K. All authors have read and agreed to the published version of the manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Eun, S., Kim, H., Kim, H.Y. et al. Age-adjusted quick Sequential Organ Failure Assessment score for predicting mortality and disease severity in children with infection: a systematic review and meta-analysis. Sci Rep 11, 21699 (2021). https://doi.org/10.1038/s41598-021-01271-w
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-021-01271-w
- Springer Nature Limited
This article is cited by
-
External validation of clinical severity scores to guide referral of paediatric acute respiratory infections in resource-limited primary care settings
Scientific Reports (2023)
-
Defining the role of host biomarkers in the diagnosis and prognosis of the severity of childhood pneumonia: a prospective cohort study
Scientific Reports (2023)
-
Recognizing Sepsis in Children in Low-Resourced Settings: Guidelines for Frontline Clinicians
Current Pediatrics Reports (2023)