Introduction

Fever, dyspnea, and vomiting/diarrhea are major causes of emergency care attendance in childhood. Serious infections (SI) could be the underlying cause of these symptoms. Morbidity and mortality after Emergency Department (ED) visit due to serious infections or a complicated disease course of a self-limiting viral illness should not be underestimated. Infections account for 20% of childhood deaths in England, Wales, and Northern Ireland, with the greatest number in children aged 1–4 years [11, 14]. In the Netherlands, between 1969 and 2006, mortality due to infectious diseases compared to total childhood mortality was around 3.0% [22].

Serious infections are mostly defined as sepsis (including bacteremia), meningitis, pneumonia, osteomyelitis, cellulitis, gastroenteritis with severe dehydration, complicated urinary tract infection (positive urine culture and systemic effects such as fever), and viral respiratory tract infections complicated by hypoxia (e.g., bronchiolitis) [18]. At the ED, serious infections can be hard to recognize, as they can present similar to a self-limiting (viral) disease during early presentation, eventually leading to a diagnostic or treatment delay.

Dealing with this uncertainty on diagnosis or disease course after ED discharge, clinicians usually schedule revisits in a substantial number of cases. In addition, they provide parents with instructions on expected disease course, alarming signs and symptoms, and when to revisit, a well-known concept called “safety netting” [1, 16].

A recent systematic review concluded that studies concerning effects of safety netting interventions were mostly conflicting or with limited evidence [7]. They described strong associated characteristics of revisits as young children, infectious/respiratory symptoms, and progression of symptoms. However, evidence on follow-up management and its time frame as a part of the whole process of safety netting in children at risk for serious infections is lacking [10].

To improve the process of safety netting, we aimed to identify characteristics of (unscheduled) revisits and the timing of these revisits in a prospectively collected cohort of children with fever, vomiting/diarrhea, or dyspnea, discharged from the ED.

Methods

Study design and setting

We conducted a prospective follow-up study at the ED of the Erasmus MC-Sophia Children’s Hospital in Rotterdam. This large inner-city university hospital is visited annually by nearly 7000 children with a mixed ethnic population of which 35% have chronic comorbidity.

Participants

We prospectively enrolled all consecutive children (≥ 1 month–< 16 years) attending the ED with fever, vomiting/diarrhea, or dyspnea from March 2010 to October 2013. Febrile children were defined as eligible if fever had been noted at home in the 24 h prior to presentation, when body temperature measured at the ED was ≥38.5 °C or fever was used as a positive discriminator of the Manchester Triage System (MTS) [6]. Children with vomiting/diarrhea needed to be suspected of a recent infectious cause. To be included, the illness episode had to be preceded by a minimum symptom free period of 2 weeks and the illness episode needed to be related to an infectious disease. Children were assigned to dyspnea when respiratory complaints, with or without bronchoconstriction, were the main reason of visiting the ED. Children with dyspnea who also suffered from fever were assigned to dyspnea if these symptoms took precedence over fever-related complaints. Given the aim of the study, i.e., improving discharge advice, we excluded children who were admitted to the hospital ward after initial ED visit. Next, as children with a known medical history or medical diagnosis get specific safety netting advice for their chronic condition in their outpatient follow-up (by pediatrician and specialist nurse), they are another population compared to the children with common acute illnesses at the ED. As children with a known medical history or medical diagnosis may be managed differently at ED or by (experienced) parents, we excluded children with complex needs as well as children with predefined asthma [24].

Revisit

Data collection

All children who attended the ED were routinely triaged with the MTS. This digital recorded triage system is used to prioritize patients according to acuity [21]. In the analysis, MTS categories were reformatted into three categories: (1) emergent/very urgent, (2) urgent, and (3) non-urgent/standard to guarantee sufficient numbers per category. We collected patient characteristics from a structured electronic patient record system (gender, age, reason of ED visit, visit date, triage information), referral profile, duration of the complaints, clinical signs and symptoms, observations, and measures from physical examination (e.g., vital signs, temperature, breathing difficulty, clinical appearance) [13, 20, 24].

During the process of discharge, patients received information on alarming signs and symptoms, expected disease course, and on when and how to return. Part of the children received a scheduled revisit, by judgment of the attending physician, based on either the clinical signs and symptoms or expected complications, or on parental concern. In addition to these scheduled revisits (i.e., initiated/appointed by the physician at discharge), patients could revisit unscheduled (i.e., patient-initiated). These data were collected using a standardized telephonic questionnaire on the disease course which parents were asked to answer 3 days after ED discharge. The questionnaire included specifically data on duration or reoccurrence of symptoms as well as on complications, and on revisits to the hospital ED, to primary care, or to other health care settings. When the child was not yet fully recovered, we continued our follow-up by telephone until complete remission of their symptoms.

Outcome measures and definitions

Our primary outcome measures were (1) revisits, defined as all revisits occurring for the same health care problem at either the GP (primary care) and the emergency department (secondary care) after the first ED visit, and (2) the time until this revisit, measured as the time gap between discharge and revisit. Secondary outcome measures included unscheduled revisits (defined as an unplanned control visits after the initial visit) and hospitalization following a revisit.

To evaluate parental concern, parents were asked if they considered their child’s illness at initial ED revisit to be different from earlier episodes. This is in accordance with previous studies in primary care, showing that parental concern is an important determinant of serious infections [17, 18].

Ethics

Ethical approval was obtained from the institutional review board (IRB) of the Erasmus MC (MEC-2005-314). Informed consent was required and obtained from all parents.

Statistical analysis

Variable selection

Variable selection for studying potential characteristics of revisits were based on previously published decision models or risk scores [2, 3, 8] and a recent systematic review on characteristics of pediatric health care revisits (Table 1) [10].

Table 1 Variable selection according to decision model, risk scores, and systematic review

Characteristics of revisits

Since patients with fever, vomiting/diarrhea, or dyspnea may differ in their disease course and time frame, we performed analysis separately for each of these patient groups. Time until ED revisit was evaluated by Kaplan-Meier survival analysis. Previous research in our setting showed that 12% of all discharged children underwent revisits of which 4% included interventions [4]. To analyze 10–15 characteristics of revisits, it was decided that we should have at least 10 times as many events (100–150 revisits) [4, 5]. With these distributions, we estimated to include at least around 830 (100/0.12) to 1250 (150/0.12) children.

Missing values

To allow optimal use of available data in multivariate models, missing data were imputed 10 times using a multiple imputation process with the mice algorithm in R software (version 3.0) under the assumption to be missing at random [26]. The imputation model included all variables which were considered in the multivariable logistic regression analysis, the outcome variable (revisits), and several relevant variables describing case mix of the patients (e.g., gender and MTS urgency) (Tables S1, and S2.1, S2.2, S2.3). All analyses, except for multiple imputation, were performed with SPSS software (version 20.0, SPSS Inc., Chicago).

Results

Successful follow-up by telephone was achieved for 1765 children, encompassing 80% of the total eligible population (n = 2214) (Fig. 1). Overall patients’ median age was 22 months (IQR 11–48), with 57% boys (n = 1000). The revisit rate was 30% (n = 527) and 3% (n = 54) of the children were hospitalized after revisiting the ED (Table 2). Most children were triaged as urgent patients (54%; n = 944) and 51% were referred by physicians.

Fig. 1
figure 1

Patient flowchart

Table 2 Demographics of total population

Febrile children constituted 64% (n = 1136) of included children, with 346 (n = 31%) revisits. Twenty-one percent (n = 372) children suffered from vomiting/diarrhea with 108 (29%) revisits. Fifteen percent (n = 257) of all children had dyspnea, with 73 (n = 28%) revisits.

Characteristics of revisits overall

Out of 527 revisits, 352 (67%) revisits were unscheduled (Table 3). The number of unscheduled revisits was the lowest for children with vomiting/diarrhea (n = 57, 15.3%) and the highest for children with dyspnea (n = 55, 21.4%) (Table 3).

Table 3 Characteristics of revisits

Children revisited the ED after a median of 2 days (IQR 1.0–3.0). Children with vomiting/diarrhea revisited the ED significantly at a shorter interval (1.0 day (IQR 1.0–2.0)) than children with fever or dyspnea (2.0 (IQR 1.0–3.0)) (log rank p < 0.0001).

Characteristics of revisits of febrile children

Age, parental concern, and chest wall retractions were associated with revisits in febrile children (multivariable ORs between 1.30–1.98) (p value < 0.1) (Table 4). Young age and parental concern, in particular, were associated with unscheduled revisits (respectively, OR (CI 95%) 1.42 (1.04–1.95) and OR (CI 95%) 1.81 (1.13–2.90)) (Table 4).

Table 4 Determinants of revisits in children with fever, vomiting/diarrhea, and dyspnea

Characteristics of revisits of children with vomiting/diarrhea

The characteristics age < 1 year, ill appearance, clinical signs of dehydration at initial assessment, and tachypnea were associated with revisits (p value < 0.10) (Table 4). Age and tachypnea remained strongly independent associated with unscheduled revisits (Table 4).

Characteristics of revisits of children with dyspnea

In children with dyspnea, we could only identify the determinant “age < 3 years” to be significantly associated with revisits (p value < 0.10) (Table 4).

Discussion

Main findings

In a prospectively study on clinical symptoms and signs that are associated with health care revisits in children with fever, dyspnea, and vomiting/diarrhea, we observed young age, parental concern, and alarming signs and symptoms (chest wall retractions, ill appearance, clinical signs of dehydration, and tachypnea) to be the most important. Children with vomiting/diarrhea revisited the ED at a shorter interval (median 1 day; IQR 1.0–2.0) compared with children with fever or dyspnea (median 2 days; IQR 1.0–4.0).

Clinical implications and comparison with other studies

In order to optimize the process of safety netting, we prospectively evaluated characteristics of revisits in children at risk for serious infections discharged from the ED, originating from the question on which children need revisits and in what time frame. Although we identified various characteristics, they do not select a definite population that will not (need to) revisit the ED.

In summary, there is a need for safety netting in all children after discharge from the ED, however, with special attention for a subgroup of children at risk with young age, parental concern, and specific symptoms and signs. Our results support specific time frames for specific presenting conditions.

Strengths and limitations

The major strength of this prospective study is the large number of children with complete follow-up, as we included up to 80% of the eligible children successfully in our study. Second, our study did not only include revisits to our hospital ED, but also to other EDs in the area as well as revisits to primary care or other emergency care settings.

Lastly, we studied the role of parental concern in the emergency care setting [17, 18]. We found an association between parental concern and revisits only in the group of febrile children. In the majority of affirmative answers, parental concern was caused by a longer duration or a more severe illness. It is important to remark this indicator of a probable complicated clinical course, as it emphasizes the meaningful role of parents in the assessment of their child’s illness in secondary care settings in addition to the known role in primary care [18].

This study has some limitations. In our study, we chose revisits as our primary outcome measure and we separately analyzed unscheduled revisits. As former research showed the following risk factors for pediatric ED revisits: arrival in the evening, respiratory diagnosis, and acute triage category [19], one might argue that our secondary outcome, i.e., unscheduled revisit and hospitalization, would be of more clinical relevance. However, unscheduled revisits can be influenced by the clinical setting and by the time frame the scheduled revisit was originally planned in, and also would be related to parental background and concepts of disease and their uncertainty or comprehension ability to understand provided information.

There are several factors, influencing the attending physician’s decision to schedule a follow-up appointment or to admit a patient, besides having to perform further diagnostic tests or treatment. We observed 293/527 (55.6%) visits with an intervention (defined as diagnostics, treatment, or admission) (Table 3). Admission occurred in 54 (10.2%) patients.

In all other revisits (234/527; 44.4%) patients did not receive any diagnostics or treatment, nor were they admitted to the hospital. However, to regard them just as a “reassurance”-revisit for parents would be too simplistic, as other factors like alarming signs, gut feeling, and experience of the attending physician can influence this decision. We can only speculate about the reasons as detailed information is missing, and this topic was beyond the scope of our study.

Selection bias and recall bias are well-known problems of questionnaire studies [12, 23]. However, our study reached a high response rate of 80%, in contrast to most response rates of telephonic or postal questionnaire studies of less than 60% [25]. Recall bias may especially have influenced the subjective determinant parental concern. However, as parents were called only 3 days after ED discharge, this should be less of a problem in our study.

Conclusion

In this prospective cohort study on ED patients, we observed young age, parental concern, and alarming signs and symptoms (chest wall retractions, ill appearance, clinical signs of dehydration, and tachypnea) being associated with emergency health care revisits in children with fever, dyspnea, and vomiting/diarrhea. In addition to the general need for safety netting procedures in children at risk for serious infections, these characteristics could help to define targeted review of children during post-discharge period. A control visit after ED discharge is disease-specific, and the post-discharge interval seems to be shorter for children with vomiting/diarrhea than others in particular.