Introduction

The Child Behaviour CheckList/6–18 (CBCL/6–18) [1] is a parent report form to screen for emotional, behavioural, and social problems in children and adolescents aged 6–18. It is an empirically based questionnaire, and its reliability and validity have been widely demonstrated [1]. The checklist returns a profile of scores on eight syndrome scales and six DSM-oriented scales. Several studies have examined the associations between CBCL/6–18 scales and diagnoses based on DSM criteria [2, 3]. In recent years, however, researchers’ interests have moved toward the identification of recurrent profiles characterized by concurrent elevations on more scales, and among these profiles one that has received particular attention is the Child Behaviour Checklist-Dysregulation Profile (CBCL-DP) [4]. This profile is characterized by co-occurring elevations in attention problems, aggressive, and anxious/depressed scales, and it reflects the condition of emotional and behavioural dysregulation described for the first time by Biederman et al. [5]. The CBCL-DP has demonstrated its utility in terms of diagnosis and outcome prediction [4, 610]. The majority of these studies used an a priori identified profile that sums the T-score of the three scales, or they alternatively used person-centred statistical approaches, such as Latent class analysis (LCA), applying the method exclusively to the items of these identified three scales. Only a small number of studies used a bottom-up approach, which explores the different profiles that emerge within a population while considering all the syndromic scales of the CBCL. This approach can be found in the work of Connell et al. [11] and of Basten et al. [12]. These studies used LCA to identify profiles of psychopathological traits from CBCL/1.5–5 scales in a sample of economically disadvantaged families and in a population-based sample. Despite coming from different starting points, both authors identified a 4-class solution with an externalizing class, an internalizing class, a normative group, and a highly problematic and dysregulated class. Only one study [13] applied this methodology on a sample of older children and adolescents. These authors performed an LCA on CBCL/6-18 syndrome scales of a combined sample of general-population subjects and referred children and they identified six classes of subjects, including a dysregulated class. The main limit of this interesting work, however, is the small sample size. Interestingly, Bonadio et al. [14] in a similar way used Latent Profile Analysis (i.e. LCA with continuous indicators) to identify psychopathological profiles from the Ohio Scales-Problem Severity Scale (OS PS) filled out by youth and parent dyads of a community mental health sample. In this case, using a different instrument, authors identified five classes of subjects, including a high risk class with elevated scores both on internalizing and externalizing symptoms, which very closely resemble the CBCL-DP.

The present study had two major aims. The first aim was to replicate and extend the preliminary results presented by De Caluwé et al. [13] by examining whether it was possible to identify different psychopathological profiles in a very large mixed sample (including both general and referred children and adolescents). To achieve this goal, we performed an LCA, including the full spectrum of the CBCL syndromic scales. The second aim was to evaluate the relationship between identified classes and DSM-IV diagnoses, also taking the presence/absence of comorbidity into consideration.

Methods

Subjects

To maximize the population variability in all scales, a combined sample was used that included both general-population subjects and referred subjects.

The Italian preadolescent mental health project (PrISMA) is a two-phase survey that was carried out in Italy to estimate the prevalence and correlates of mental health problems in urban preadolescents. The study population consisted of 3418 subjects at the time of the first screening phase (49.6% males; 10–14 years old, M = 12.08, SD = 0.90) and of 631 subjects in the second diagnostic phase (46.0% males; 10–14 years old, M = 12.16, SD = 0.91). The main features of the PrISMA study are summarized in Table 1. Full details concerning research design and methods are available elsewhere [15, 16].

Table 1 Socio-demographic and behavioural characteristics of the samples

The Genesis project is an ongoing longitudinal study on a clinical sample of children and adolescents who were referred for emotional and behavioural problems to the Child Psychiatry Unit of ‘Eugenio Medea’ Scientific Institute in Bosisio Parini (LC), Conegliano Veneto (TV), Pasian di Prato (UD), and San Vito al Tagliamento (PN). The subsample used in this study consisted of 1226 subjects during the first assessment (76.9% males; 6–17 years old, M = 9.11, SD = 2.34). The main features of the Genesis study are summarized in Table 1.

The study protocols were approved by the Research Ethical Committee of our Scientific Institute and have been performed in accordance with the ethical standards laid down in the 1964 Declaration of Helsinki and its later amendments. Parents’ written informed consent was obtained for all participants.

Measures

Socio-economic status

For this study, we selected fathers’ and mothers’ educational levels as an indicator of socio-economic status. The parents’ education levels were recoded for analysis into two classes: ‘at risk’ (less than 10 years of school) and ‘not at risk’ (10 years or above). Data of the two separate samples and of the total sample are reported in Table 1.

Emotional and behavioural assessment

Child Behaviour CheckList 6–18 (CBCL/6–18) [1]. This is an empirically based checklist of social competence and behavioural problems that was filled out by parents of children and adolescents aged 6–18. According to the Achenbach System of Empirically Based Assessment (ASEBA), the CBCL/6–18 is divided into eight syndrome scales: Anxious/depressed, Withdrawn/depressed, Somatic complaints, Social problems, Thought problems, Attention problems, Rule-breaking behaviour, and Aggressive behaviour. In this study, we used the T-score based on the set of multicultural norms ‘group 2’, which applies to the normative sample of the Italian population [17, 18]. Scores on the eight clinical scales were dichotomized as ‘not at risk’ (T < 65) or ‘at risk’ (T ≥ 65). Clinical characteristics of the samples are presented in Table 1.

Development and Well-Being Assessment (DAWBA) [19]. This is a diagnostic interview that combines a structured and a semi-structured part and is designed to generate the present-state psychiatric diagnoses for children and adolescents following DSM-IV criteria. The DAWBA has shown satisfactory validity and inter-rater reliability [19]. This interview was administered to the 631 subjects of the second phase of the PrISMA project. The diagnostic evaluation was conducted on probable cases of mental disorders and on a sample of non-probable cases. All subjects exceeding the cutoff scores (90th percentile of the frequency distribution) of CBCL internalizing and/or externalizing scales and a 10% random sample of those who did not exceed the cutoff scores were selected for this second phase. Full details concerning research design and methods are available elsewhere [15].

Kiddie schedule for affective disorders and Schizophrenia for school-age childrenpresent and lifetime version (K-SADS-PL) [20]. This is a semi-structured diagnostic interview created to assess current and past episodes of psychopathology in children and adolescents according to DSM-III-R and DSM-IV criteria. All subjects in the Genesis project were assessed through K-SADS-PL interviews.

Clinical and socio-demographic characteristics of subjects who have entered the diagnostic phase are reported in Table 2.

Table 2 Clinical and socio-demographic characteristics of the subjects who have entered the diagnostic phase

Data analyses

Preliminary analysis

To identify differences between the two samples, they were compared using the χ 2 statistic in terms of gender, parents’ educational levels, CBCL/6–18 scores, and the T test for age.

Latent class analysis

To examine whether different groups of subjects could be identified in the two samples, we performed a Latent Class Analysis (LCA), a person-centred statistical approach able to assign persons to a statistically independent class when they respond in the same way to items (or scales) of a questionnaire [21]. Thus, each class has a specific symptom (item or scale) endorsement profile [22]. LCA was performed using Mplus 6.11 [23] on the CBCL/6–18 syndrome scales in the two samples separately (with age and gender as covariates) and in the total sample (introducing the clinical status as covariate). Models estimating 1-class through 5-class solutions were compared. The best solution was determined by looking at the Bayesian Information Criterion (BIC) [24], the Lo–Mendell–Rubin test (LMRT) [25] and the Bootstrapped Likelihood Ratio test (BLRT) [26]. In addition to these fit statistics, in determining the number of classes we also considered the rule of parsimony and the substantive relevance of a class [27]. The identified classes were given descriptive labels based on the consensus of the authors after reviews of each class’s unique profile. During the validation phase of latent classes, each subject was assigned to their highest probability class using the ‘knownclasses’ algorithm.

After conducting separate LCAs for the two samples and for the total sample, we evaluated the classification agreement using the Cohen’s Kappa coefficient. The degree of agreement was interpreted according to the magnitude guidelines defined by Landis and Koch [28].

Relationship between classes and diagnostic profiles

In this second step of analysis, we used data only from the subjects who have entered the diagnostic phase. We analysed the distribution of diagnoses between classes and we checked for significant differences using the χ 2 statistics. Diagnoses were re-coded into major diagnostic categories as follows: Attention-deficit Hyperactivity Disorder, Behaviour Disorders (Oppositional Defiant Disorder, Conduct Disorder, and Disruptive Disorder NOS), Mood Disorder (Depressive Disorder, Dysthymic Disorder, and Depressive Disorder NOS), Anxiety Disorder (Generalized Anxiety Disorder, Specific Phobia, Panic Disorder, Social Phobia, Separation Anxiety, Obsessive–Compulsive Disorder, Post-Traumatic Stress Disorder, Mixed Anxiety Depressive Disorder, and other Anxiety Disorders NOS), and Other Diagnoses (all diagnostic conditions that are not an emotional or a behavioural disorder, such as Tic Disorder, Stuttering, Enuresis, and Selective Mutism).

In order better to evaluate the strength of the association between classes and diagnostic status, this was re-coded as 0 = absence of diagnosis, 1 = one diagnosis, and 2 = two or more diagnoses (i.e. comorbidity). We evaluated whether the classes were able to predict the absence of diagnosis with a backward logistic regression. Subsequently, we performed a backward multinomial logistic regression with diagnostic status as the dependent variable (with absence of diagnosis as reference category) and classes as predictors. Age, gender, and parents’ educational levels were entered as covariates.

The likelihood ratio Chi square was used to test the significance (p < 0.05) of all models, whereas the Wald statistic was used to test the significance (p < 0.05) of the independent variables. For each model, we also reported Nagelkerke pseudo-R 2 to show each model’s fit. We used the odd ratio (OR) as a measure of effect size and Monson’s classification of OR [29] to describe the strength of the association between the dependent variables and the predictors.

Results

Preliminary analysis

The PrISMA and Genesis samples differ for age (t = 43.317, p = 0.000), gender distribution (χ 2 = 272.940, p = 0.000), mothers’ and fathers’ educational levels (respectively, χ 2 = 113.221, p = 0.000; χ 2 = 125.368, p = 0.000), and the percentage of subjects in the clinical range (χ 2 from 15.778 to 765.010, p = 0.000), with the Genesis sample having younger subjects, a higher rate of male subjects, a higher percentage of subjects with a lower socio-economic status, and a higher percentage of subjects in the clinical range in all CBCL/6-18 scales.

Latent class analysis

Table 3 presents the model fit indices for 2- to 5-class solutions of the three LCAs. According to BLRT (and to MLRT for the Total sample), more classes resulted in better models fit, while LMRT (with the exception of Total sample) and BIC suggested the 4-class solutions as the best-fitting models. As the 4-class solution resulted in clearly distinct classes, and considering that a comparison of the 4-class ad 5-class solutions showed that the 5-class solution included an additional class with a profile that was not clearly different from that of the lowest scoring class, we choose the 4-class solution in all the samples. The four classes identified in the three LCAs had a very similar structure, with limited differences between the PrISMA and Genesis samples.

Table 3 Fit statistics for latent class models

The Cohen’s Kappa coefficient indicated a substantial agreement (κ = 0.766; 95% CI, 0.590 to 0.942, p < 0.0005) between subject classifications obtained by running separate LCAs on the original samples and on the total sample. In subsequent analyses, we used the classification obtained in the total sample.

The analysis of the features revealed important differences between classes (Fig. 1). The first class, labelled ‘Severe Dysregulated–DYS’ (7.82% of the sample), includes subjects with an elevated probability (>60%) of being in the clinical range for all CBCL scales, with the exception of Somatic Complaints and Rule-Breaking behaviour. The second class, called ‘Internalizing Problems–INT’ (15.68%), is characterized by a high probability of being in the clinical range only for the Anxious/depressed scale. The third class, ‘Attention/Hyperactivity–ADHD’ (10.19%), has an elevated probability of being in the clinical range for the Attention Problems scale. Finally, the fourth class, labelled ‘Low Problems–LOW’ (66.32%), includes those subjects with a low probability for each CBCL syndrome scale.

Fig. 1
figure 1

CBCL/6–18 profiles according to the 4-class solution in the total sample

Relationship between classes and diagnostic profiles

Table 4 shows the distribution of diagnostic categories in the four identified classes and related χ 2 indices. The results of the logistic regression analysis are reported in Table 5. All classes with the exception of ADHD significantly predicted the absence of diagnosis. More specifically, there is a strong association between the absence of diagnosis and the Low Problems class (OR = 8.17; 95% CI 5.61–11.91). There is also a moderate negative association between the absence of diagnosis and the Severe Dysregulated and Internalizing Classes (respectively, OR = 0.58; 95% CI 0.36–0.94; OR = 2.02; 95% CI 1.40–2.98).

Table 4 Clinical descriptions of the classes
Table 5 Significant OR (p < 0.05) in the logistic regression and multinomial logistic regression analysis with classes as predictors and age, gender, and parental education as covariates

The multinomial logistic regression revealed that the ‘One Diagnosis’ condition was significantly associated with the Severe Dysregulated, Internalizing, and Attention/Hyperactivity Classes (respectively, OR = 8.57; 95% CI 5.38–13.66; OR = 2.93; 95% CI 2.08–4.12; OR = 8.51; 95% CI 5.74–12.60 for one diagnosis vs. absence of diagnosis) with a moderate association in the second case and strong associations for the other classes. The ‘Comorbidity’ condition—defined as two or more diagnoses—is significantly associated with the severe dysregulated, internalizing, and Attention/Hyperactivity classes (respectively, OR = 27.69; 95% CI 16.78–45.70; OR = 6.63; 95% CI 4.43–9.94; OR = 7.27; 95% CI 4.54–11.65 for Comorbidity vs. Absence of Diagnosis) with a very strong association in the first case and strong associations for the other classes. The Nagelkerke pseudo-R 2 values concerning the two models are reported in Table 4.

The use of ‘most likely class membership’ as a variable for further analysis may be problematic when the entropy goes much lower than 0.8 because the precision in assigning class membership is less than optimal [30]. As in our model entropy was 0.77, we repeated analysis by directly introducing the categorical outcome (i.e. diagnostic status) in the LCA 4-classes model [31], and the risk of having two or more diagnoses was identified for each latent class. Results confirmed that the Comorbidity condition is more likely for subjects in the Severe Dysregulated class (64.3%), followed by Internalizing class (51.1%), Attention/Hyperactivity class (24.9%) and, finally, by Low Problems class (7.9%). Moreover, the probability of having two or more diagnoses with respect to one diagnosis is significantly higher for individuals in Severe Dysregulated class with respect to individuals in Attention/Hyperactivity and Low Problems classes (respectively, OR = 5.42; 95% CI 2.55–11.53; OR = 21.12; 95% CI 7.62–58.59). Instead, subjects in Internalizing class have a probability only moderately lower (but significant) than those in Severe Dysregulated class to have two diagnoses (OR = 0.58; 95% CI 0.21–1.635).

Discussion

In the present study, we examined whether different profiles of psychopathology could be identified using a person-centred statistical approach in a large and inclusive sample of Italian children and adolescents combining general-population and referred subjects. Moreover, we investigated the relationship between these profiles and DSM-IV diagnoses as well as the comorbidity of diagnoses.

Latent class analysis performed on CBCL/6–18 syndrome scales for our samples identified 4 classes. One class grouped subjects without a significant risk of elevation on any scales. A second class was characterized by children and adolescents with a high risk of being in the clinical range for Attention problems. The third class grouped subjects with a high risk of elevation on the Anxious/depressed scale. Finally, the last and more compromised class included subjects with an elevated probability of being in the clinical range for all CBCL scales, with the exception of Somatic complaints and Rule-breaking behaviour. These results are very similar to those presented by Connell et al. [11] and by Basten et al. [12]. Considering the differences between the version of the checklist used (1.5–5 vs. 6–18), the overlap between the macro-structure of our classes and the one identified by these authors appears clearly. Furthermore, observing the similarities between the profiles identified in early childhood and those identified in children and adolescents, we might guess that this way of grouping on the basis of psychopathological traits is so strong that it is independent of the developmental stage. It would be of interest to use the same approach on the Adult Behaviour Checklist 18–59 (ABCL/18–59) [32] to check whether these profiles emerge again. Finally, considering that sample features may influence the structure and the prevalence of identified classes [33], our results seem to be reliable as they were obtained from a large and heterogeneous sample, including both referred subjects and general-population subjects. Furthermore, these results are also supported by the observation that the same structure of classes has been obtained by performing separate LCAs on the two sub-samples, which yielded a substantial classification agreement.

The second significant result was the identification of a profile characterized by elevated levels of dysregulation, which was similar to previously published works. De Caluwé et al. [13] identified a higher number of classes (six), but it is worth noting that their ‘No symptoms’ class and ‘CBCL-DP’ class appear very similar to the classes identified in this work. Looking at the profile of dysregulation, we can note that in both cases it was primarily characterized by a very elevated probability of being in the clinical range for the Anxious/depressed, Attention problems, and Aggressive behaviour scales, and secondly in the other scales with the exception of Somatic complaints and, only in our sample, of Rule-breaking behaviour scale. We believe that our study confirms the existence of a dysregulated profile, with limited differences linked to the substantial differences in sample size.

The term Dysregulation Profile (DP) usually refers to the specific profile identified by Althoff [6, 34], which is characterized by the elevation of the three scales, Anxious/depressed, Attention problems, and Aggressive behaviour. In our study, we identified a larger profile of dysregulation that included the three scales used by Althoff as well as the Withdrawn/depressed, Social problems, and Thought problems scales. A possible explanation for this difference is that Althoff et al. identified the DP by performing an LCA specifically on the items of only these three scales, while our analysis was conducted on a broader spectrum of emotional and behavioural problems, including all scales of the CBCL/6–18. Our results were probably more realistic, as they were not based on an a priori hypothesis, but rather on empirical findings. Moreover, these results are not in contrast with those of Althoff. On the contrary, they confirm and extend Althoff’s results, particularly if we consider that our profile had a frequency of 7.82% in our sample. This was consistent with other studies that used LCAs and identified a prevalence of DP ranging from 4 to 8% [4, 6, 34]. Finally, there is no evidence that children with DP have elevations only in these three scales. On the contrary, several studies have claimed that these children show elevations in other scales [7, 3537]. In conclusion, we can say that our study provides further evidence of the replicability of DP in different countries, samples, and methodologies [38].

In the second step of our study, we highlighted the diagnostic sensibility of each class. For all diagnostic categories, there was a very low percentage of subjects in the LOW class (between 4 and 20%, approximately). In the INT class, the higher percentages of diagnosis were for Anxiety Disorders (42.8%) and Mood disorders (26.4%). In the ADHD class, about half of the subjects (49.0%) had a diagnosis of Attention-Deficit/Hyperactivity Disorder, but we also found that 23.8% of subjects had an Anxiety Disorder. This result is not surprising considering that Anxiety Disorders in both children and adults are among the disorders that most commonly co-occur with Attention-Deficit/Hyperactivity Disorder [39]. Finally, in the DYS class the highest percentages we found were for Anxiety Disorders (54.3%), Mood Disorders (44.5%), and Attention-Deficit/Hyperactivity Disorder (30.7%), underlining and confirming previous results suggesting a high heterogeneity of diagnoses assigned to individuals with emotional and behavioural dysregulation [8, 34, 40].

Finally, when we analysed how the four classes were able to predict three different diagnostic profiles (absence of diagnosis vs. one diagnosis vs. two or more diagnosis), we found that the LOW class better identified an absence of diagnosis, while all three other classes were able to predict the presence of comorbidity, with the DYS class being the significantly stronger predictor as reported by other studies [41, 42]. The same results were confirmed when analyses were repeated with a more conservative approach (i.e. by incorporating outcomes into the latent class model) to correctly account for uncertainty in class membership.

There are several limitations in this study. First, it is based only on parent reports (CBCL/6–18). An interesting future direction would be to consider the CBCL not only being completed by the parents but also the Youth Self Report (YSR/11–18) [1] completed by the child/adolescent or the Teacher’s Report Form (TRF/6–18) [1] filled out by teachers. Second, the incidence of certain diagnostic outcomes was low, necessitating the collapse of several diagnoses into combined categories. Third, although the results are comparable with those of other studies, the participants were recruited from an Italian sample, which potentially limits the replicability of the results in other countries. Fourth, since we used a cross-sectional design, our findings provide only a static view of the classes. Thus, they do not provide information on the onset, progress, or changes in the class types and their syndromes over time.

Conclusion

Using a person-centred statistical approaches, we were able to identify four different psychopathological profiles in a large sample including both referred and general-population children and adolescents. Membership in these groups appears to be related to different positive and negative outcomes in terms of psychopathological diagnoses. In particular, our results underline the presence of a profile characterized by severe emotional and behavioural dysregulation, which is mostly associated with the presence of multiple diagnoses. In conclusion, one of the main results of this work lies in the implementation of a bottom-up approach, thus using a non-a priori method, to provide further evidence of the replicability and clinical significance of Dysregulation Profile in different countries, with different methodologies and in a large and heterogeneous sample.