UNICEF reports that approximately 8 million children worldwide live in institutions (Pinheiro 2006). Numerous studies have demonstrated that residential foster care can have negative consequences for children (e.g., Baptista et al. 2014; Delgado et al. 2012; Dregan and Gulliford 2012; Li et al. 2017; López et al. 2010; Rutter et al. 2010; Smyke et al. 2012; Troller-Renfree et al. 2018; Tibu et al. 2014). The findings from these various studies resulted in recommendations to limit residential foster care and to promote home-based foster care (Tarren-Sweeney 2017), especially for young children (Dozier et al. 2012; Palacios 2003; Del Valleand Bravo 2003; Del Valle et al. 2008). However, while there is considerable knowledge about the negative consequences of residential foster care, there is less knowledge on the impact of home-based foster care.

Foster care, already introduced in the 1987 law that created a new child protection system in Spain, was proposed as the great alternative for those children who had to be separated from their families. Up until then, the solution used in most cases was the admission to a center or foster home, were they remained for many years, if not all of their childhood until reaching coming of age (Del Valle et al. 2009). The subsequent 1/96 Organic Law regarding the Legal Protection of Minors, established as a basic principle the upbringing of the child in a family context, either by recuperating the functions of good parenting by the families (with family intervention programs and support materials), or by the fostering of the child by another family or even adoption (López et al. 2010). The priority that children always have the chance of developing within a family is one of the issues of greater legal, scientific and profesional consensus. However, in the thirty years that have elapsed, family foster care has not become a priority measure and residential care remains the predominant solution (Del Valle et al. 2009).

The report of EUROARRCC (1998) offers an overview of the characteristics of children in home-based foster care. With foster care samples from Finland, Scotland, Ireland, and Spain, the findings indicated that 67% of the children had scores in the clinical range on internalizing and externalizing symptom dimensions. In a more recent study with Australian children in foster care (Sawyer et al. 2007), 61% of the children were in the clinical range on the internalizing and externalizing symptom dimensions (care-giver ratings on the CBCL). Similar results have occurred in other studies (e.g., Goemans et al. 2018; Humphreys et al. (2015). These studies suggest that many of the children in home-based foster care have scores in the clinical range on various symptom and impairment dimensions.

Although it is clear that many children in home-based foster care have scores in the clinical range, only a few studies have examined the psychological problems of children in home-based foster care in Spain. A study by Gil-Lario et al. (2013), for example, evaluated 32 children in foster care with BASC ratings by foster parents and teachers. Foster parents rated the children as significantly higher on internalizing, attention, and externalizing symptom dimensions as well as significantly lower on social and adaptive skills than teachers. In addition, mean scores on the BASC scales for the 32 children were in the clinical range for the attention (parents and teachers), externalizing (foster parents only), and adaptive skills scales (foster parents only). This study, however, did not include a comparison group and also did not evaluate if the duration of time in home-based foster care was associated with improvements in the symptom and impairment scores.

Another Spanish study was undertaken by Fernández-Molina et al. (2011), in order to measure behavioral problems in adolescents who were in pre-adoptive, residential and extended family care, using the Child Behavior Checklist (CBCL). These researchers found that adolescents in residential care had higher scores than those adolescents who are in pre-adoptive or extended family care. The researchers also concluded that adolescents in pre-adoptive care present fewer behavioral problems and are to a greater extent within the normal range of the CBCL.

The overall purpose of the study was to compare a sample of Spanish children in foster care to a non-foster care sample of Spanish children on clinical symptoms (i.e., anxiety, depression, sluggish cognitive tempo (SCT), ADHD-inattention (IN), ADHD-hyperactivity/impulsivity (HI), oppositional defiant disorder [ODD], and limited prosocial emotions [LPE]) and impairment (i.e., academic and social impairment) dimensions. The first objective was to determine the mean differences (Cohen’s d values) between foster care and non-foster care groups on the symptom and impairment dimensions. Given the risk factors associated with the removal of a child from the family and placement in foster care, it was expected that the foster care group would have significantly higher scores on all the symptom and impairment measures than the non-foster care group. The second objective was to determine if the foster care and non-foster care differences on the symptom and impairment dimensions remained significant after controlling for children’s sex and age. It was expected that foster care children would continue to show significantly higher scores on the symptom and impairment dimensions than the non-foster care children even after controlling for sex and age. The third objective was to determine if the number of months in foster care would be associated with an improvement in the symptom and impairment dimension scores. It was expected that longer stays in foster care would be associated with lower scores on the symptom and impairment dimensions. The fourth objective was to determine if children with longer stays in foster care (greater than the medium number of months) would have symptom and impairment scores that did not differ significantly from the non-foster care group while children with shorter stays in foster care (less than the medium number of months) would still differ significantly from the non-foster care group. Answers to the questions associated with the four objectives will allow a better understanding of the mental health of Spanish children in foster care and the impact of foster care on their mental health.

Methods

Participants

Foster care group

There were 281 children in foster care at the time of the study in the Province of Alicante, Spain. A total of 87 foster care families agreed to participate in the study with 49 of these families having a foster child in the age range of 8 to 13 years of age, the age range of the non-foster care comparison sample. The mean age of the 49 children was 10.06 (SD = 1.51, 57% girls). The ethnicity of the 49 children was 51% Caucasian, 32% Roma, 13% the sub-Saharan, and 4% other ethnic groups. The socioeconomic level of the foster care families was 25% medium-high income, 42% medium income, 24% medium-low income, and 9% low income with 81% two parent families and 19% single-parent families. Of the 49 families 11% reported 10 grades of education, 17% reported 12 grades of education, 26% reported vocational training (e.g., electricians, plumbers, mechanics, and administrators with three to five years of education beyond the high school diploma) and 30% reported a university degree.

Comparison group

The comparison group consisted of 1776 children from 32 elementary schools from Mallorca, Spain (see Sáez et al. 2018 for more details on this sample). The mean age of the children was 10.30 years (SD = 1.31, range 8 to 13, 49% girls). Mothers completed the rating scale on 1648 children and fathers on 1358 children.

A total of 84% of the mothers and 86% of the fathers were married with 62% of the mothers and 71% of the fathers having permanent employment (13 and 12%, respectively, reported occasional employment). For mothers (fathers) 17% (25%) reported 10 grades of education, 19% (22%) reported twelve grades of education, 23% (21%) reported vocational training (e.g., electricians, plumbers, mechanics, and administrators with three to five years of education beyond the high school diploma) and 37% (29%) reported a university degree (approximately 4% were missing).

Procedures

Child and Adolescent Behavior Inventory (CABI)

The foster care parents and the non-foster care parents completed the CABI (Burns et al. 2015a, 2015b). The foster care parents completed the CABI jointly (i.e., one CABI for each foster care child) while the non-foster care mothers and fathers completely the CABI separately. The mothers and fathers in the comparison group were instructed to complete the CABI independently. The CABI measures SCT (15 symptoms), ADHD-IN (9 symptoms), ADHD-HI (9 symptoms), ODD (8 symptoms), limited prosocial emotions (LPE, 4 symptoms of the DSM-5 with Limited Prosocial Emotions Specifier), anxiety (6 symptoms) depression (6 symptoms), social impairment (4 items: quality of interactions with parents, other adults, siblings, and peers), and academic impairment (5 items: quality of homework/classwork, reading skills, arithmetic skills, writing skills, and global academic skills).

The SCT, ADHD, ODD, LPE, anxiety, and depression symptoms were rated on a 6-point scale (i.e., almost never [never or about once per month], seldom [about once per week], sometimes [several times per week], often [about once per day], very often [several times per day], and almost always [many times per day]. A 7-point scale was used for the academic and social impairment items (i.e., severe difficulty, moderate difficulty, slight difficulty, average performance [average interactions] for grade level, slightly above average, moderately above average, and excellent performance [excellent interactions] for grade level). The LPE, academic impairment, and social impairment items were reverse keyed so that higher scores represent LPE, greater academic impairment, and greater social impairment, respectively.

Earlier studies provide support for the reliability (internal consistency, test-retest, inter-rater) and validity of scores from the ADHD-IN, ADHD-HI, ODD, LPE, anxiety, depression, social impairment, and academic impairment scales with Spanish children (e.g., Belmar et al. 2017; Bernad et al. 2016; Burns et al. 2017; Sáez et al. 2018; Seijas et al. 2018a, 2018b; Servera et al. 2016). In the current study, Cronbach’s alpha (mothers, fathers) in the non-foster care group was excellent for SCT (0.93, 0.92), ADHD-IN (0.95, 0.95), ADHD-HI (0.93, 0.93), ODD (0.92, 0.91), LPE (0.84, 0.85), anxiety (0.72, 0.75), depression (0.87, 0.84), social impairment (0.90, 0.91), and academic impairment (0.94, 0.95) scores. Inter-rater correlations for mothers with fathers varied from 0.66 for anxiety to 0.87 for academic impairment. For the foster care group, Cronbach’s alpha for SCT, ADHD-IN, ADHD-HI, ODD, LPE, anxiety, depression, social impairment, and academic impairment were 0.96, 0.97, 0.97, 0.95, 0.87, 0.85, 0.92, 0.87, and 0.93, respectively.

Data Analyses

The analyses used version 8.0 of the statistical software, (Muthén and Muthén 19982017). The robust maximum likelihood estimator was used for the analyses (MLR). The first analysis determined the mean differences on the symptom and impairment dimensions for foster care and the non-foster care groups (i.e., the foster care ratings were compared to the non-foster care mother group and the non-foster care father group). Cohen d value and its 95% confidence interval was used to determine the magnitude of the group differences on the symptom and impairment measures. The second anlaysis regressed the symptom and impairment measures on the sex of the child, the age of the child, and the group membership (i.e., foster care versus non-foster care groups). The purpose of this analysis was to determine whether group membership would uniquely predict the symptom and impairment dimensions after controlling for the sex and age of the child. The partial standardized regression coefficients for this analysis can be intepreted in the same manner as Cohen’s d value (i.e., the d value representing the number of standard deviations the foster care group is higher than the non-foster care group after controlling for the age and sex of the child). The fourth analysis determined the correlation of the number of months in foster care with the symptom and impairment dimensions. The fifth analysis created two dummy coded predictors (i.e., (1) short duration of stay in foster care [less than medium number of months, coded 1] versus non-foster care comparison group [coded 0]; and (2) long duration of stay in foster care [greater than the medium number of months, coded 1] versus non-foster care comparison group [coded 0]. The symptom and impairment dimensions were regressed on these two predictors to determine if the long stay in the foster care group would no longer differ significantly from the non-foster care group on the symptom and impairment dimensions while the short stay in foster care group would still have significantly higher scores than the non-foster care group on the symptom and impairment dimensions.

Results

Missing Information

Covariance coverage was greater than 99% for all variances and covariances for ratings by mothers, fathers, and foster parents. The participants thus left very few blank items. The MLR estimator also does not delete any cases with missing information on the outcome measures.

Foster Care versus Comparison Group

Table 1 shows the results for the comparison of the foster care and non-foster care groups. The foster care group had significantly (p < 0.05) higher means than the non-foster care group on all the symptom and impairment scales. The weakest effects were for the social impairment and academic impairment scales (i.e., d values of approximately 0.38 for social impairment and 0.60 for academic impairment). The d values for the symptom dimensions varied from 0.69 for anxiety to 1.53 for SCT with most of the d values for the symptom measures being greater than 1.00 (i.e., greater than 1.00 standard deviation higher than the non-foster care group). Almost identical results occurred for the comparison of the foster care group to the non-foster care mother and father groups.

Table 1 Comparison of foster care and non-foster care groups

Table 2 shows the results from the partial standardized regression coefficients of the regression of the symptom and impairment measures on the age and sex of the child along with group membership (foster care versus the non-foster care group). Even after controlling for sex and age, the partial standardized regression coefficients are almost identical to the Cohen d values in Table 1. Since the symptom and impairment measures are standardized, the partial standardized regression coefficients can be interpreted in the same manner as Cohen d (e.g., the foster care group mean score on the anxiety measure was 0.69 standard deviations higher than the non-foster care mother group after controlling for child sex and age).

Table 2 Partial standardized regression coefficients for the regression of symptom and impairment measures on children’s sex, age, and group membership (foster care versus comparison)

Relationship of Months in Foster Care with Symptom and Impairment Measures

Table 3 shows the correlation for the number of months in foster care with the symptom and impairment measures for the 49 children in foster care. A higher number of months in foster care was associated with significantly (p < 0.01) lower scores on the SCT, anxiety, depression, ADHD-inattention, and academic impairment measures. Months in foster care maintained a significant (p < 0.01) negative association with SCT (β = −0.44, SE = 0.12), anxiety (β = −0.39, SE = 0.12), depression (β = −0.33, SE = 0.12), ADHD-IN (β = −0.43, SE = 0.12), and academic impairment (β = −0.32, SE = 0.12) even after controlling for the sex and age of the children in foster care.

Table 3 Correlations (SEs) of number of months in foster care with symptom and impairment measures

Table 4 shows the results from the regression of the symptom and impairment dimensions on the two dummy coded predictors (i.e., (1) short duration in foster care versus non-foster care group; (2) long duration in foster care versus non-foster care group). The children with a short duration in foster care (less than the medium number of months) had significantly (p < 0.01) higher scores on all the symptom and impairment dimensions than the non-foster care mother and father comparison groups. The d values for these comparisons ranged from 0.66 for social impairment to 2.25 for SCT. In contrast, the children with a long duration in foster care (greater than the medium number of months) did not differ significantly (p > 0.05) from the non-foster care mother group on the anxiety, depression, ADHD-IN, ADHD-HI, social impairment, and academic impairment dimensions (d value for these non-significant results ranged from 0.05 to 0.48). Similar results occurred for the comparison of the long duration in foster care group to the non-foster care father group—that is, a lack of a significant (p > 0.05) difference on the anxiety, ADHD-IN, ADHD-HI, LPE, social impairment, and academic impairment dimensions (d value for these non-significant ranged results from 0.07 to 0.44).

Table 4 Partial standardized regression coefficients for the regression of symptom and impairment measures on length of stay in foster care (less than or greater than medium months) versus non-foster care mother and father groups

Discussion

The purpose of our study was to compare Spanish children in foster care to Spanish children not in foster care on a wide range of symptom (i.e., anxiety, depression, SCT, ADHD-IN, ADHD-HI, ODD, and LPE) and impairment (social and academic) measures. More specifically, the purpose was to determine if the children in foster care had significantly higher scores on the symptom and impairment measures than the children not in foster care. In addition, we sought to determine if the number of months in foster care was associated with a decrease in the scores on the symptom and impairment measures. Finally, and perhaps the most important objective, the study sought to determine if children with longer stays in foster care (greater than the medium number of months) would have symptom and impairment scores that did not differ significantly from children not in foster care while children with shorter stays in foster care (less than the medium number of months) would still differ significantly from the non-foster care group.

The children in foster care had significant higher scores than the children not in foster care on all the symptom and impairment measures, coinciding with results from previous investigations (Goemans et al. 2018; Humphreys et al. 2015; Sawyer et al. 2007). The smallest differences (d values of 0.37 to 0.60) were for social and academic impairment with the differences for the symptom measures being much larger (d values from 0.69 to 1.59). The largest differences occurred for depression, SCT, ODD, and ADHD-IN (d values from 1.04 to 1.53). The children in foster care thus had significantly elevated scores on the symptom and impairment measures relative to the children not in foster care. In addition, a greater number of months in foster care was associated with significantly lower scores on SCT, anxiety, depression, ADHD-IN, and academic impairment measures. Finally, while children with a shorter duration in foster care (i.e., less than the medium number of months) continued to differ significantly from the children not in foster care on all the symptom and impairment measures, children with a longer duration in foster care (greater than the medium number of months) did not differ significantly from the control group on anxiety, depression, ADHD-IN, ADHD-HI, social impairment, and academic impairment. Although it is important to remember these findings are based on cross-sectional data, it was nonetheless encouraging to find such outcomes associated with the length of stay in foster care.

While our findings are consistent with a wide range of other studies that indicate that children in home-based foster care have higher clinical and impairment scores than comparison groups (Delgado et al. 2012; Dregan and Gulliford 2012; Fries et al. 2008, Gunnar and Van Dülmen 2007; Kjelsberg and Nygren 2004; Li et al. 2017; Martín et al. 2008; Shechory and Sommerfeld 2007; Smyke et al. 2012), our findings are more unique in the outcome that children with longer stays in foster care did not differ from the non-foster care comparison groups on the anxiety, depression (mother comparison only), ADHD-IN, ADHD-HI, LPE (father comparison group only) social impairment, and academic impairment dimensions. Even when the longer stay in foster-care group still had significantly higher scores than the non-foster care comparison groups (i.e., SCT and ODD measures), the magnitude of the difference was much smaller for the longer vs. shorter stay relative to the comparison groups (i.e., SCT: d value of approximately 0.60 vs. 2.00, ODD: d values of approximately 0.70 vs. 1.60). Longer durations of the home-based foster care in the current study was thus associated with a non-significant difference between the foster-care and the non-foster care comparisons groups on most of the symptom and impairment measures. These findings suggest the foster care duration was associated with an increase in the normalization of behavior of the foster care children. In other words, providing the foster care children with a normal social and emotional context was associated with a reduction in clinical symptoms and impairment.

Limitations and Suggestions for Future Research

The two main limitations were the small number of children in the foster care sample and the cross-sectional nature of the study. Future research would benefit from a larger sample of children in foster care as well as a broader age range, especially younger children. Future research should also compare children in the complete range of Spanish protective services (i.e., Reception Centers, Host Homes and Extended Family Care) with children in home-based foster care to non-foster care comparison groups. Finally, longitudinal research would provide a useful way to follow-up on the cross-sectional findings of the current study, especially the association of duration of stay in foster care with lower scores on the symptom and impairment dimensions. For example, if a home-based foster care sample were assessed at the start of foster care and at subsequent 4-month intervals through the duration of the foster care with each foster care child matched to a comparison child with assessments at the same time points, then such a study would allow a better understanding of the improvements associated with foster care.