Significance Statement

What is already known on this subject?

An increasing number of preterm and low birth weight newborns are undergoing car seat tolerance screening. These infants are at increased risk for cardiorespiratory compromise associated with a semi-upright position while situated in infant safety seats.

What this study adds?

We highlight the differences in CSTS adherence by indication for screening and socioeconomic status. These findings underscore the need for clarification of national and local CSTS guidelines and understanding of provider decision making with respect to car seat screening.

Introduction

The American Academy of Pediatrics (AAP) recommends car seat tolerance screening (CSTS) to detect episodes of apnea, bradycardia, or oxygen desaturations in premature and/or low birth weight infants prior to initial hospital discharge (Bull et al., 2009). In recent decades, CSTS has been broadly implemented in well-baby nurseries and neonatal intensive care units (NICUs) across the United States (US). Standard processes for conducting a CSTS have not been established (Williams & Martin, 2003). Initial CSTS recommendations were based on the increased risk of hypoventilation among preterm infants while in car seats (Willett et al., 1986), but low birth weight infants have similar rates of failing CSTS (Bass, 2015; Davis, 2015; McLaurin-Jiang et al., 2019). Among the 500,000 US-born infants that are preterm and/or low birth weight each year (Martin et al., 2018), the observed rate of CSTS failure ranges from 4 to 10% (Davis et al., 2013; Jensen et al., 2018; Schutzman et al., 2013).

Given the different settings in which preterm and low birth weight newborns receive care, CSTS adherence may vary. For instance, a 2003 survey of 72 level 1 (well-baby), 2 (special care nursery), or 3 (NICU) nurseries found that 75% of the hospitals had instituted a CSTS program (Williams & Martin, 2003). However, adherence to the AAP recommendations varied by level of nursery with only 19% of well-baby nurseries compared to 78% of level 3 NICUs conducting CSTS screening at that time (Williams & Martin, 2003). As rates of late preterm births increase in the US (Huff et al., 2019), lower level nurseries may increasingly care for late preterm and low birth weight infants.

Annually 2/3 of out of home sudden infant death syndrome is associated with car seat use (Liaw et al., 2019). However, whether CSTS prevents morbidity associated with car seat use among infants at-risk is unknown (Pilley & McGuire, 2006). Recently, a national survey of well-baby nurseries found wide variation in CSTS and in providers’ thoughts about the utility of CSTS (Davis & Cheo, 2020).

To our knowledge, no study has examined current rates of adherence to CSTS policies in both well-baby nursery (level 1) and NICU settings (levels 2–5). Our primary aim was to describe CSTS adherence by indication (preterm birth and/or low birth rate). Our secondary aim was to evaluate infant characteristics associated with CSTS adherence.

Methods

We conducted a retrospective review of electronic health record (EHR) data extracted from a central data repository at one academic and one community hospital in a single health care system. Both hospitals have well-baby nurseries. The NICUs are level 5 (academic hospital) and level 3 (community hospital). We included infants born alive who met hospital criteria for CSTS and were discharged from either hospital between April 5, 2014 (when Epic ® EHR was implemented) and December 31, 2018 (Fig. 1). We excluded infants who had a discharge status other than “home” or that required tracheostomy or home ventilator as these infants may undergo non-standard CSTS given need for additional monitors or equipment.

Fig. 1
figure 1

Flow diagram of study population

A CSTS protocol has been in effect within this hospital system for more than 10 years and was not altered during the study period. The protocol was based on the AAP Recommendations for Safe Transportation of Preterm and Low Birth Weight Newborns at Hospital Discharge (Bull et al., 2009). All infants born < 37 weeks gestation (PTM) and/or < 2.27 kg (LBW) were routinely screened prior to discharge. Based on these eligibility criteria, three groups of infants were identified: (1) preterm, appropriate weight for gestational age (PTM), (2) preterm, low birth weight (P-LBW), and (3) term, low birth weight (T-LBW) infants. Although providers may choose to screen additional infants not meeting one of these criteria (e.g., term infants with Trisomy 21 or congenital heart disease), for this analysis, we focused only on infants specified in the hospital policy.

CSTS is conducted by a trained registered nurse in either the well nursery or NICU using the infant’s own car seat within 24 h of expected hospital discharge. The infant’s heart rate, respiratory rate, and oxygen saturations are measured for 90 min or the duration of the car ride home from the hospital (whichever is longer). A certified car seat technician with expertise in safe car seat installation is available to assist as needed with optimal infant positioning.

The primary outcome was adherence to hospital CSTS policy as defined by having met institutional criteria for screening and receiving a screen (yes/no). All CSTS results are logged by the infant’s nurse in a discrete data field within the EHR. Results are documented as “pass” or “fail” and verified by the physician prior to infant’s discharge.

Covariates were similarly extracted from discrete data fields in the EHR. Race/ethnicity (non-Hispanic White, non-Hispanic Black, Hispanic or Latino, Asian, Other/Unknown) is typically completed by administrative staff upon maternal admission. We used maternal race/ethnicity as infant race/ethnicity was often undocumented. Infant sex (male/female), gestational age (weeks), birth weight (kilograms), pregnancy type (singleton/multiple gestation), hospital discharge unit (NICU, well nursery, or pediatric floor), caffeine exposure, substance exposure (to alcohol, cocaine, or opiates), Apgar 1 and 5 min, hospital type, discharge disposition (home with self-care vs. transfer to acute care facility), and discharge year were also extracted. To account for the incomplete data in 2014, we examined the trend in adherence using quarter of year as a continuous variable. There were 19 quarters over the course of this study period.

Additional maternal covariates included insurance payor (Medicaid, private, or other/unknown), maternal age, preferred language of mother (English or Spanish), mode of delivery (vaginal or cesarean), and parity. Rates of missing data were low (< 1%) for most variables other than insurance payor (8.7%) and 1- and 5-min Apgar scores (2.2%). Only individuals with complete data were utilized in the analyses.

We identified maternal and infant diagnoses (Supplemental Table 1) and medication exposures (caffeine) for which we hypothesized associations with providers’ perception of risk of apnea or bradycardia and thus might have influenced their decision to conduct screening.

Statistical Analysis

In bivariate analyses, Chi-square or Fisher Exact tests (for categorical variables and t-tests or Wilcoxon Rank sum tests (for continuous variables) were used to determine the association of patient characteristics with CSTS adherence. In multivariable logistic regression models to examine adherence to CSTS policy, we included the following covariates chosen a priori: race/ethnicity, gestational age, birth weight, sex, Medicaid status, preferred language, hospital and discharge year. Because of significant differences in the NICU and well nursery populations, we stratified analyses by hospital unit (Supplemental Table 2). We used StataIC version 15 (Stata Corp, College Station, TX) for all statistical analyses. The University of North Carolina at Chapel Hill Institutional Review Board approved this study which was performed in accordance with the ethical standards laid down in the 1964 Declaration of Helsinki and its later amendments.

Results

Of the 4574 potentially eligible preterm and/or low birth weight infants, 643 were excluded because of discharge to an outside facility, tracheostomy and/or ventilator dependency, or not surviving to discharge (Fig. 1). The final sample comprised 3931 infants born to 3756 mothers over the 4.75 years study period.

Infants were born preterm (PTM, 55.1%), both preterm and low birth weight (P-LBW, 34.0%), or term and low birth weight (T-LBW, 7.1%). Adherence rates were 92.7% in the NICU and 95.2% in the well-baby nursery with initial CSTS failure rates of 6.1% and 9.9%, respectively (Table 1). Babies who were transferred to and subsequently discharged from the pediatric floor had the lowest adherence rates (Table 1). Adherence was higher among infants at the community hospital compared to the academic hospital (96.1% vs. 91.4%, p < 0.001).

Table 1 Baseline characteristics of infants meeting institutional criteria for car seat tolerance screening (April 2014–December 2018)

NICU

In bivariate analysis, the mean maternal age was higher among infants undergoing CSTS compared to unscreened infants (31.2 ± 5.9 vs. 29.9 ± 6.0 years, p = 0.014). Adherence was lowest among T-LBW (80.7%) compared to PTM (95.1%) or P-LBW (92.2%) infants, p < 0.001. Adherence varied by race/ethnicity with greater adherence among non-Hispanic White and Asian mothers compared to non-Hispanic Black, Hispanic, or unknown race/ethnicity (Table 2). Males were more likely to undergo CSTS (93.9% vs. 91.2%, p = 0.28). The academic NICU had lower adherence than the community NICU (89.8% vs. 97.0%, p < 0.001). Adherence significantly increased from 2014 to 2018 (uOR 1.06, 95% CI 1.02, 1.10, Fig. 2).

Table 2 Bivariate associations of infant characteristics with adherence to car seat tolerance screening in the NICU and nursery (April 2014–December 2018)
Fig. 2
figure 2

Adherence to car seat tolerance screening in NICU and nursery by quarter, 2014–2018

In the fully-adjusted multivariable model (Table 3), a 1 kg increase in birth weight was associated with 2.05 greater odds of adherence (95% CI 1.45, 2.90). Discharge from the community hospital was associated with higher adherence (aOR 6.22, 95% CI 4.17, 9.30) while Medicaid insurance was associated with lower adherence (0.62, 95% CI 0.48, 0.80).

Table 3 Adjusted odds ratio (aOR) of car seat tolerance screening adherence by patient characteristics in NICU and well nursery locations

Nursery

In bivariate analysis, there was no difference in mean maternal age between infants by adherence. T-LBW infants had lower CSTS adherence rates than PTM or P-LBW infants (81.6% vs. 96.7% and 97.1%, p < 0.001). Screened infants had a lower mean gestational age (36.8 ± 1.1 vs. 36.2 ± 0.78 weeks, p < 0.001). Compared to infants who were > 2.25 kg, infants ≤ 2.25 kg had lower rates of adherence (Table 2). Adherence significantly increased each year from 2014 to 2018 (unadjusted OR 1.06, 95% CI 1.02, 1.10, Fig. 2).

In the fully adjusted multivariable model (Table 3), later study quarter was associated with higher adherence (aOR 1.74, 95% CI 1.09, 2.79).

Analysis of Academic vs. Community NICU

In both hospitals, adherence was lower among T-LBW infants than PTM or P-LBW infants, and adherence was inversely associated with gestational age (Supplemental Table 2). At the academic hospital, adherence was lower among infants with Medicaid insurance compared to non-Medicaid insurance (87.4% vs. 91.8%, p = 0.020) and later study quarter was associated with higher adherence (unadjusted OR 1.06, 95% 1.02, 1.11). At the community hospital, infants with a history of apnea or caffeine exposure had greater adherence (Supplemental Table 2).

Discussion

While several retrospective studies have described infant predictors of CSTS failure, this is the first to examine clinical factors associated with adherence to institutional CSTS policies. In all hospital units and settings, adherence to CSTS was lowest among term, low birth weight infants compared to preterm infants regardless of weight category. Lower adherence to CSTS policies among term and low birth weight infants is a novel finding. Previous literature suggests that term and low birth weight infants have similar likelihood of CSTS failure as their preterm counterpoints (Bass, 2015; Davis, 2015; McLaurin-Jiang et al., 2019). This is likely due to decreased muscle tone, greater susceptibility to airway obstruction while seated semi-upright, and small size which complicates positioning in car seat.

However, since the AAP’s first policy statement on CSTS in 1991, routine screening for T-LBW infants was not specifically mentioned until the 2009 policy update (Bull et al., 2009). The most recent AAP Policy Statement on Safe Transportation of Newborns references low birth weight as < 2.5 kg which is the cutoff for CSTS used by approximately 50% of level 2 and 3 nurseries surveyed (Bull et al., 2009; Davis et al., 2013). Comparatively, the criteria used at this institution are more restrictive (cut-off < 2.3 kg) which might identify higher-risk infants with higher rates of adherence. As this is the first study to examine CSTS adherence in this manner, we are unable to assess how adherence in this study may generalize to other institutions with more sensitive weight eligibility criteria.

To what extent US hospitals have implemented and routinely conducted CSTS among T-LBW infants is not known. Our findings that T-LBW infants had lower adherence despite explicit inclusion in the CSTS guidelines within this institution is important given that some institutions may not have a written policy for CSTS of term infants. Given that many standard car seats have a weight minimum of 5 lbs (2.27 kg), beyond detecting significant cardiorespiratory events, routine CSTS for T-LBW infants has the added benefit of ensuring that caregivers are using a weight-appropriate car seat and are able to appropriately position their children in the car seat prior to discharge.

Although the same CSTS policy was in place across nursery and NICU settings, we suspect there are unit level differences in practice that contribute to variance in adherence. The NICU, by design, cares for infants with greater medical complexity than those cared for in the nursery. It is possible that infants in the NICU undergo additional observation or medical management that may influence providers’ decisions to complete pre-discharge CSTS. Within the academic nursery setting, the EHR provides prompts/reminders to complete CSTS prior to discharge as it is an element of the admission order set for all preterm infants, which likely improves adherence. However, a similar prompt is not provided for LBW infants, so for this group, CSTS adherence depends more heavily on the medical team to recall that CSTS screening is warranted.

Further analyses supported differences in the acuity of patients cared for at the academic vs. community NICU (e.g., lower gestational age, birth weight, longer length of stay). We excluded patients undergoing tracheostomy or with ventilator dependency to eliminate patients who did not warrant CSTS due to presumed discharge home on continuous monitoring. As a referral center, the academic NICU also transfers some infants back to referring centers which is often done prior to CSTS. Although we accounted for this in our analysis, there may be other unidentified factors unique to the academic setting that were not evaluated in this study. In the community NICU, a history of apnea or caffeine use strongly predicted CSTS adherence.

Although the hospitals in this study are within the same health care system and a 50-mile geographic radius, important sociodemographic differences were noted between the academic and community NICU. The academic NICU cared for a higher percentage of patients with Medicaid (44% vs 15%). Unexpectedly, we found a lower rate of CSTS adherence for Medicaid patients in the academic setting which persisted after controlling for relevant factors including race, gestational age, birth weight. Furthermore, CSTS adherence among non-Hispanic Black infants was lower than other racial/ethnic groups. While our study lacked the sufficient power to examine racial/ethnic variation in CSTS, it is possible that racial and socioeconomic characteristics influence implementation of CSTS.

Implicit bias may also impact provider non-adherence. A 2019 systematic review found that racial inequities in NICU care exist at all levels (structure, process, outcome) and correspond with worse patient outcomes (Sigurdson et al., 2019). Indeed racial inequities in breastfeeding rates have been associated with level of adherence to the Baby Friendly Hospital Initiative, an initiative by the World Health Organization and UNICEF to improve support of breastfeeding during newborn hospitalization (Merewood et al., 2019). Because these racial and socioeconomic differences were only seen in one setting at one hospital, it is difficult to generalize these findings or understand the implications. However, the magnitude of differences in adherence within this population warrants prompt attention and evaluation for quality improvement to better understand risks and benefits of CSTS, and subsequently standardize CSTS in this setting.

Non-adherence to institutional clinical guidelines may occur for multiple reasons including provider knowledge, attitude, and behavior; characteristics of the guidelines, health care systems, and implementation strategies (Arts, et al., 2016; Cabana et al., 1999; Gurses et al., 2010); or contraindications or patient preference (Arts et al., 2016). In the case of CSTS, we do not suspect patient preference factors largely into adherence. Only one infant documented parents declining screening during this study period. Alternatively, when comparing premature Black infants to non-Black infants of the same gestational age, the Black infants are known to have improved respiratory outcomes (Jensen et al., 2018; Loftin et al., 2012; MacDorman & Gregory, 2015; McLaurin-Jiang et al., 2019). In addition, small epidemiologic studies have reported lower risk of CSTS failure among Black infants (Jensen et al., 2018; McLaurin-Jiang et al., 2019). This alternative explanation may lead providers to perceive a decreased risk of car seat associated morbidity for Black compared to non-Black infants and thereby intentionally offer screening less. However, currently recommendations for CSTS do not vary based on infant race and/or ethnicity, and it is important to note that Black infants are at higher risk of dying from SIDS and other sleep related deaths (Mathews & Macdorman, 2006). A cross-sectional study involving four academic pediatric clinics found that Black, non-Hispanic caregivers had higher odds of non-adherence to car seat safety (AOR 2.4, 95% CI 1.3, 4.4) and sleeping safety (AOR 2.1, 95% CI 1.3, 3.2) (Heerman et al. n.d.). The CSTS is potentially an important opportunity to engage parents in specific education related to car seat safety and highlight the risk of improper car seat use on their infant’s health. It is unknown whether receipt of CSTS and associated parental education influences child outcomes or parental behaviors with safe use of car seats and infant sleep practices.

Perhaps supported by increasing awareness of populations at risk for failure, the number of CSTS completed annually has increased within this health care system (McLaurin-Jiang et al., 2019). We found increasing adherence to CSTS in both NICU and nursery settings which could be largely contributing to the increasing use of CSTS. With increased screening, there is greater risk for false positive results or unintended harms which have, to our knowledge, not been systematically defined in the setting of CSTS. Additional studies are needed to examine the benefits of CSTS in preterm and T-LBW infants (such as reductions in Brief Resolved Unexplained Events, Sudden Infant Death Syndrome, readmissions, and neurodevelopmental delays).

One limitation of this study is the cross-sectional study design which limits the ability to determine the directionality of relationships between infant factors and adherence. Second, although this study is strengthened by automatic (instead of manual) extraction of EHR data and consistent documentation of CSTS throughout the study period, we lacked information on providers’ rationale or decision-making that could influence guideline adherence. Third, since guidelines may differ at other institutions, the external validity may be limited. Finally, although demographic and institutional cultural differences exist between the academic and community settings, external validity of this study is enhanced by including two large hospitals with differing socioeconomic demographics and medical acuity.

Although low birth weight term infants have CSTS failure rates similar to preterm infants, adherence to CSTS for these infants is significantly lower in both well-baby nurseries and NICUs. This study further illuminates socioeconomic disparities in adherence to clinical practice guidelines for the most vulnerable infants in the NICU. Such disparities require multicomponent interventions including implicit bias training for clinicians. Our findings also have implications for optimizing and standardizing CSTS processes. Future studies aiming to clarify the benefit of CSTS are needed to ensure appropriate adherence in high-risk populations.