Abstract
Intolerance of Uncertainty (IU) is a transdiagnostic factor involved in several psychological disorders. Adolescence is characterized by elevated uncertainty and psychopathological vulnerability, but insufficient attention has been paid to IU at this age. This study aimed to investigate the factor structure and psychometric properties of the Intolerance of Uncertainty Scale-Revised (IUS-R) in Italian preadolescents and adolescents. 862 Italian students (57.3% girls) aged 11–17 (M = 14.8 ± 1.91) completed the IUS-R and measures of internalizing and externalizing symptoms, and psychological well-being. To test the factor structure of the IUS-R, one-factor, two-factor, and bifactor models were compared; measurement invariance, reliability, and validity were also addressed. Results showed that the bifactor model outperformed alternative factor models, and a general factor was needed to model the IUS-R. Bifactor model indices supported using the total score to assess IU reliably. Configural and metric invariance by age and sex were fully supported, while the IUS-R achieved partial scalar invariance. Significant correlations emerged for the IUS-R total score with psychopathological constructs, while no relationships with psychological well-being were found. Compared to adult normative data, higher total IUS-R scores were detected, suggesting that IU may be a phase-specific characteristic of adolescence. Our findings support using the IUS-R to measure IU across the lifespan. The recommended use of the total score and its associations with psychopathological dimensions highlight the transdiagnostic nature of IU in adolescence. Therefore, including IU when implementing interventions to prevent maladaptive outcomes in teenagers would be beneficial.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Intolerance of Uncertainty (IU) is a trait-like disposition reflecting “the tendency to be bothered or upset by the (as yet) unknown elements of a situation, whether the possible outcome is negative or not” (Freeston et al., 2020, p. 6). People high in IU struggle to tolerate and modulate the negative emotions elicited by uncertainty (i.e., uncertainty distress) and usually experience negative emotional, behavioral, and cognitive responses when dealing with uncertain situations (Freeston et al., 2020).
IU was originally conceptualized as a cognitive vulnerability factor for worry, the core feature of Generalized Anxiety Disorder (GAD; Dugas et al., 1998; Freeston et al., 1994). It is now widely recognized that, while IU remains central in GAD, it has broad applications across a wide range of psychopathologies, such as anxiety disorders, obsessive-compulsive disorder, depression, post-traumatic stress disorder, eating disorders, substance use disorders, and personality disorders (see Bottesi et al., 2018; 2021; Gentes & Ruscio, 2011; Shihata et al., 2016). Furthermore, recent evidence supports the role of IU as a transdiagnostic and trans-therapy change process (McEvoy et al., 2019a; McEvoy & Erceg-Hurn, 2016), and treatment protocols focusing on IU when targeting different psychological disorders have proved effective (e.g., Shapiro et al., 2020).
Nevertheless, the literature about the transdiagnostic nature of IU is mainly based on studies conducted in adult samples. Insufficient attention has been paid to the role of IU in youth (Osmanağaoğlu et al., 2018; Shihata et al., 2016), although most psychological disorders have their onset in adolescence (e.g., Polanczyk et al., 2015; Sanchez et al., 2017). This gap in the literature is questionable given that adolescents face novel, changeable, and uncontrollable events, scattered by lots of uncertainties in different areas (e.g., sexuality, education, identity, interpersonal relationships, relative independence from parents) (Casey et al., 2010). Moreover, adolescence is a stage of brain development characterized by the maturation of the neural pathways associated with inhibitory control (i.e., regulation of emotion and behavior) and cognitive beliefs about the future, uncertainty, and threat (Read et al., 2013). Therefore, exploring IU in adolescence is crucial since it may help increase knowledge about the developmental trajectories of psychopathologies that have their onset in this period of life, such as anxiety disorders, substance use disorders, and eating disorders (De Girolamo et al., 2012).
The Assessment of IU in Adolescence
Since 1994 a vast body of literature has focused on IU measurement, and most research has been conducted on undergraduate and adult samples (Bottesi et al., 2020). The Intolerance of Uncertainty Scale-12 (IUS-12; Carleton et al., 2007) is the shortened version of the original 27-item Intolerance of Uncertainty Scale (IUS-27; Freeston et al., 1994), and it is the most widely used self-report measure assessing IU in adulthood (Bottesi et al., 2019b; McEvoy et al., 2019a). Initial research addressing the factor structure of the IUS-12 suggested that it encompasses two separate dimensions: Prospective IU, referring to the predisposition for active information seeking to reduce uncertainty, and Inhibitory IU, expressing avoidance-oriented reactions to uncertainty (Birrell et al., 2011; Carleton et al., 2007; McEvoy & Mahoney, 2011). However, the most recent literature agrees that a general factor should be preferred to the two canonical factors to improve the adequacy of factor analysis models and support the use of the total score instead of two overly intercorrelated subscale scores (Bottesi et al., 2019b; Hale et al., 2016; Huntley et al., 2020; Lauriola et al., 2016; Shihata et al., 2018; Yao et al., 2021; Wilson et al., 2020).
The factor structure of the IUS-12 in a nonclinical sample of adolescents was first explored by Boelen et al. (2010). Data from participants aged 14–18 were analyzed, and a two-factor structure emerged from Principal Component Analysis. However, two of the seven items deemed to reflect the Prospective IU factor (i.e., #1 and #2) loaded higher on the Inhibitory IU factor, suggesting the need for an additional general factor, as found for adult samples. A Dutch study also investigated the factor structure, reliability, and validity of the IUS-12 in a sample of adolescents (age range: 13–17) (Dekkers et al., 2017). The two-factor model fitted the data better than the one-factor model, and the Prospective and Inhibitory IU factors were found to have a good internal consistency reliability. Furthermore, the two factors were partially invariant across sex and were positively associated with trait anxiety and negatively related to risk-taking in cognitive tasks.
The Intolerance of Uncertainty Scale for Children (IUSC)
The first attempt to develop a scale suitable for administration in children and adolescents is the Intolerance of Uncertainty Scale for Children (IUSC; Comer et al., 2009), a downward extension of the IUS-27 (Freeston et al., 1994) with simplified instructions and items to enhance child compatibility. The IUSC was psychometrically evaluated in a mixed sample of youth (nonclinical and with an anxiety disorder) aged 7–17. The total score showed an excellent internal consistency in nonclinical and clinical samples, large positive correlations with anxiety and worry, and a moderate correlation with reassurance-seeking behavior (Comer et al., 2009). More recently, Cornacchio et al. (2018) examined the factor structure of the IUSC and its abridged 12-item version (IUSC-12) in a youth sample aged 9–18 with and without anxiety disorders. Although the bifactor model fitted the data significantly better than the two-factor model, the study questioned the use of the total score in clinical research, given the marginally better performance of the Prospective and Inhibitory IU subscales in predicting anxiety and depression scores in concurrent validity analyses (Cornacchio et al., 2018). Recently, Osmanağaoğlu et al. (2021) tested both the IUSC versions in a nonclinical sample of children and preadolescents (age range: 7.58–11.81). The IUSC-12 was overall more appropriate than the IUSC for this age group. Unlike previous research, the study concluded that a one-dimensional model with only 11 items would be more parsimonious than a corresponding bifactor model. However, the bifactor model would not be inferior to the one-factor model in terms of absolute fit and parsimony without the atheoretical removal of item #10 (i.e., “One should always think ahead to avoid surprises”).
The Intolerance of Uncertainty Scale-Revised (IUS-R)
Almost contemporary to the IUSC is the Intolerance of Uncertainty Scale-Revised (IUS-R; Walker et al., 2010). The IUS-R is a refinement of the IUS-12 (Carleton et al., 2007), with a simplified language to be easily read by an average 11-year-old student (Walker et al., 2010). The IUS-R was designed to assess IU across the lifespan: using the same scale with people of different ages would make it easier to understand how IU evolves over the life course and aid in integrating findings from different studies (McEvoy et al., 2019b). The English version was used in healthy young people, children, and adolescents with diagnoses of Autism or Asperger’s syndrome (e.g., Boulter et al., 2014; Joyce et al., 2017; Wright et al., 2016). However, the factorial structure was not addressed in youth samples, except for preliminary findings from eight British and Spanish nonclinical groups (i.e., 6–8 years; 9–11 years; 12–14 years; undergraduate students) (Bottesi & Freeston, 2012). In these samples, the two-factor model sufficiently fitted the data; however, the bifactor model was not tested, as was usually the case in less recent studies of the IUS scales. Moreover, Bottesi and Freeston (2012) did not address the convergent/discriminant validity of the IUS-R. In a subsequent study, the two-factor model fitted the data better than the one-factor model in Italian undergraduates, and the IUS-R demonstrated good internal consistency values (Bottesi et al., 2015). Although the study supported the sex invariance of the IUS-R, the bifactor model was again not investigated. More recently, however, Bottesi et al. (2019b) explored the factor structure of the IUS-R in an Italian community sample, showing that a bifactor model outperformed the two-factor model in terms of model fit and achieved the standard of measurement invariance across sex, age, and over time.
The Current Study
Adolescence is a period characterized by high vulnerability to psychopathology, and IU is a transdiagnostic factor involved in several mental disorders emerging in this life stage. The existing scales for evaluating IU in this population are promising, but there are still some issues. For instance, the IUSC studies provided inconsistent findings regarding the factorial structure and used relatively small mixed samples of nonclinical and clinical children and adolescents (e.g., Comer et al., 2009; Cornacchio et al., 2018; Osmanağaoğlu et al., 2021). Instead, the IUS-R was found to have a robust factor structure in undergraduate and adult samples only, despite its intent to assess IU across the lifespan (Bottesi et al., 2019b). The current study was designed to fill these gaps, exploring the factor structure and psychometric properties of the IUS-R in a large sample of Italian preadolescents and adolescents (age range: 11–17).
Since the IUS-R is a refined and linguistically simplified version of the IUS-12, our research hypotheses were based on the extant literature on the original version of the scale in young-adult and community samples. First, we expected to confirm the bifactor model and support using the total score for assessment purposes. In addition to the bifactor model, we considered the one- and two-factor models for comparison, as these models were considered in the evaluation of IU in youth. Second, we sought to investigate the measurement invariance across sex and age groups (i.e., preadolescence, early adolescence, and middle adolescence), an issue rarely explored in the literature. Although measurement invariance is frequently assumed, it is also often overlooked, even though it is a prerequisite for comparing group means. If measurement invariance is attained, the IUS-R items have the same meaning for preadolescents, early and middle adolescents, or girls and boys; consequently, the construct can be measured with the same measurement unit, baseline level, and precision across age and sex groups. Lastly, we expected the IUS-R to show moderate-strong correlations with internalizing symptoms and weak negative or no significant correlations with measures of general psychological well-being (i.e., the Psychological Well-Being Scale and the Positivity Scale; see the “Measures section” for details). Specifically, the Psychological Well-Being Scale is a measure derived from the eudaimonic theory (Ryff & Keyes, 1995), which defines well-being as experiencing a sense of realization of personal potential. This definition is different from hedonic wellbeing, which is the presence of pleasurable, positively-valenced feelings, such as life satisfaction or happiness. Instead, the Positivity Scale assesses the disposition to evaluate life with a positive attitude. Therefore, we considered these two measures adequate to examine the divergent validity of the IUS-R.
Method
Participants
The sample was made up of 862 Italian youth (494 girls, 57.3%) aged 11 to 17 (M = 14.8 ± 1.91). Of these, 24.7% were recruited from lower secondary schools and 75.3% from upper secondary schools located in midsize cities in northern Italy. Specifically, with regard to the former, 30.5% attended the Italian first class (6th grade), 37.1% the second class (7th grade), and 32.4% the third class (8th grade). Among high school students, 14.6% attended the first class (9th grade), 22.7% the second class (10th grade), 31.4% the third class (11th grade), and 31.2% the fourth and fifth classes (12th grade). Participants were asked whether they had ever experienced psychological problems for which they requested professional help. Among those who responded (n = 808), 11% reported current or past psychological difficulties, such as anxiety, depression, eating disorders, learning difficulties (e.g., dyslexia), and family or school problems. The mean total score obtained by participants on the IUS-R was 31.8 (SD = 9.25), while the mean scores on the other administered questionnaires are presented in the Supplementary Information (Table S1).
Procedure
The present study is part of a broader longitudinal research project about the role of IU as a transdiagnostic risk factor for the onset of psychological disorders in adolescence. The study was approved by the Ethics Committee for Psychological Research of the University of Padova and was conducted in accordance with the Declaration of Helsinki.
The data considered in this work were collected from November 2018 to November 2019 at lower and upper secondary schools in northern Italy. The project was first presented to school directors to obtain their approval. Subsequently, all parents (or legal guardians) signed a written informed consent form, and students gave their assent. No incentives or rewards were offered for participating. There were no exclusion criteria. An ad hoc online survey – composed of a socio-demographic form and a battery of self-report tools (see list below) – was administered to the sample during regular school hours. Students filled in the survey in their school’s computer room, and it took approximately 45/50 minutes in each class. Confidentiality of data treatment was guaranteed by using an identification code created by each student at the beginning of the survey.
Measures
The online survey included the following questionnaires:
-
The Intolerance of Uncertainty Scale-Revised (IUS-R; Walker et al., 2010) comprises 12 items. Participants are asked to rate each item on a five-point Likert scale (1 = not at all agree, 5 = completely agree). The Italian version showed an excellent internal consistency (Cronbach’s α = 0.90, Bentler’s ω = 0.90, McDonald’s ωh = 0.90) and a good one-month test-retest reliability (r = 0.74) in undergraduate and adult samples (Bottesi et al., 2019b).
-
The Youth Self Report 11–18 (YSR; Achenbach & Rescorla, 2001) is a self-report questionnaire widely used to assess emotional and behavioral problems in young people aged 11 to 18. It comprises 112 items rated on a three-point Likert scale (0 = not true; 1 = sometimes true; 2 = very true). Problem behaviors are identified through eight syndrome scales: anxiety/depression, withdrawal/depression, somatization, social problems, thought-related problems, attention problems, aggressive behavior, and rule-breaking behavior. These scales can be grouped into problem areas like internalizing (i.e., anxiety, depression, withdrawal, and somatization) and externalizing (i.e., aggressive, and rule-breaking behavior). In the present study, Cronbach’s alpha coefficients for each scale ranged from 0.69 to 0.90, consistently with the original Italian version of the tool (Cronbach’s α ranging from 0.83 to 0.91) (Frigerio et al., 2004).
-
The Self-Administered Psychiatric Scales for Children and Adolescents – Anxiety Scale (SAFA-A; Cianchetti & Fancello, 2001) is an Italian self-report tool that measures anxiety symptoms in children and adolescents aged 8 to 18. The versions for preadolescents and adolescents consist of 50 items grouped into four subscales: generalized anxiety (composed of the tension/uneasiness and preoccupation-apprehension for the future subscales), social anxiety, separation/loss anxiety, and school-related anxiety. Three possible responses are provided for each item: true, partly true, and false. The original version of the tool showed good test-retest stability (r > 0.75) and internal consistency (Cronbach’s α > 0.85) (Cianchetti & Fancello, 2001); an adequate reliability of each subscale emerged in the present study, too (Cronbach’s α between 0.78 and 0.89).
-
The Positivity Scale (P Scale; Caprara et al., 2012) is a self-report questionnaire assessing positivity, a general disposition to evaluate life and experiences with a positive attitude. It comprises 8 items - rated on a five-point Likert scale (1 = strongly disagree, 5 = strongly agree). Although the P Scale evaluates different aspects of positivity (i.e., self-esteem, life satisfaction, positive expectation about the future, and confidence in receiving support from others), its unidimensionality has been supported in adolescent samples (Tian et al., 2018; Zuffianò et al., 2019). The psychometric properties of the Italian questionnaire are adequate, with good internal consistency (Cronbach’s α = 0.75) and test-retest reliability (r = 0.76) (Caprara et al., 2012). The tool achieved satisfactory reliability in the present study, with Cronbach’s α = 0.85.
-
The Psychological Well-Being Scales – 18 item version (PWB; Ryff & Keyes, 1995; Italian version by Ruini et al., 2003) is a self-rating questionnaire composed of 18 items assessing six dimensions of psychological well-being: self-acceptance, autonomy, environmental mastery, personal growth, purpose in life, and positive relations. Participants indicate their responses on a six-point Likert scale (1 = strongly disagree, 6 = strongly agree). The factorial structure of the PWB has been also supported with Italian adolescents, and the tool showed adequate psychometric properties (Cronbach’s α ranging from 0.60 to 0.70) (Sirigatti et al., 2009; Viola et al., 2016). Given the purpose of the present study, we only considered the PWB total score, which showed a good internal consistency (Cronbach’s α = 0.86).
Statistical Analyses
Factor models
We tested a one-factor model, a two-factor model with correlated factors, and a bifactor model with a general factor and two specific factors. The one-factor model assumed that each item reflected only a common latent IU factor, whereas item uniqueness reflected an unspecified mixture of random and systematic error variance. Such an assumption is often unrealistic because many systematic factors impact item responses in self-report scales. The two-factor model assumed that the IU domain could be divided into Prospective IU (items 1–7) and Inhibitory IU (items 8–12). Item responses are thought to reflect relatively independent common factors. As above, uniqueness reflected a mixture of random and systematic error variance. Most IUS-R research supported a bifactor model with three orthogonal factors: Inhibitory IU, Prospective IU, and General IU. The former two factors parse random error variance from the variance common to specific groups of items. The general IU factor reflects the common variance to all items and represents the trait underlying core IU beliefs above and beyond Prospective and Inhibitory IU.
Confirmatory factor analysis (CFA)
The “lavaan” and “semTools” packages for R were employed to estimate parameters and test hypotheses about CFA models (Jorgensen et al., 2018; Rosseel, 2012). All factor models were fitted using Maximum Likelihood Robust (MLR) estimators. The assessment of the model fit was based on the MLRχ2 and other recommended indices (i.e., CFI, TLI, RMSEA, and SRMR). CFI and TLI values > 0.95 indicate a good fit, while values > 0.90 are acceptable. An RMSEA of 0.06 or less is a good fit, while values < 0.08 are acceptable. The SRMR < 0.08 supports a good fit between the model and the data (Schermelleh-Engel et al., 2003). To find a baseline model for measurement invariance analyses, we compared the fit of the one-factor, two-factor, and bifactor models. For this purpose, a chi-square difference test can be performed if the models are nested. This condition is met for the one-factor and two-factor models, both nested in the bifactor model (Reise, 2012), and the two-factor model, which is nested in the one-factor model.
Bifactor Model Indices
The usefulness of a bifactor model for understanding the properties of a psychometric scale can be assessed using specific indices (see Rodriguez et al., 2016). The Percentage of Uncontaminated Correlations (PUC) measures the proportion of item correlations that reflects only the general factor variance (Rodriguez et al., 2016). The Explained Common Variance (ECV) assesses the proportion of variance in the items explained by the general factor relative to the total amount of shared variance explained. According to Rodriguez et al. (2016), when both PUC and ECV are greater than 0.70, the scale under investigation can be regarded as unidimensional, and the factor loadings for the one-factor model and the general factor in a bifactor model will not be substantially different. Other convenient indices are ω and ωh. The former measures the overall proportion of reliable variance in the IUS-R total score accounted for by the general and group factors. The latter only reflects the proportion of reliable variance in the IUS-R total score due to the general factor. Minor differences between reliability coefficients (ω and ωh) support using the IUS-R total score to measure IU in youth.
Measurement invariance
We tested the measurement invariance of the IUS-R by stages of adolescence and sex groups. First, we compared preadolescent (11–13 years), early adolescent (14 and 15 years), and middle adolescent (16 and 17 years) groups. Girls and boys were compared in a subsequent set of analyses. First, we tested whether the equality in factor structure is supported in other groups (Configural Invariance). Provided a good fit for the configural model, we tested whether the factor loadings were equal across groups (Metric Invariance). Then, we constrained both the factor loadings and item intercepts to be equal across groups (Scalar Invariance). Each level of invariance can be compared to the next using the chi-square difference test. Invariance is supported if the test turns out not statistically significant. However, because trivial differences might yield statistically significant differences, Chen (2007) recommended considering a difference in CFI ≤ 0.010, paired with differences in RMSEA and SRMR ≤ 0.015 as criteria to support the substantial equivalence of model fit.
Construct validity
Pearson’s r correlations were computed with the SAFA-A and YSR scales to test the convergent validity of the IUS-R. With regard to divergent validity, Pearson’s r correlations were calculated between the IUS-R and the PWB and P Scale. Following Cohen’s (1988) criteria, r = 0.10 indicates a small effect, r = 0.30 a moderate effect, and r = 0.50 a large effect. For ANOVA, the effect size was assessed using Cohen’s f, with 0.10, 0.25, and 0.40 representing small, medium, and large effect sizes, respectively (Cohen, 1988). The IUS-R score was also the dependent variable in three regression analyses with general psychological well-being, SAFA-A, and YSR scales as predictors. The R2 was the effect size measure used in these analyses, with 0.01, 0.09, and 0.25 representing small, medium, and large effects, respectively.
Results
Factor structure of the IUS-R
Table 1 reports the fit indices for different CFA models of the IUS-R. All fit indices were good. As expected, the one-factor model was a poor fit. The two-factor model significantly improved over the one-factor model, producing acceptable-to-good fit indices. However, the Prospective and Inhibitory IU factors were highly correlated (Φ = 0.83), casting doubts on the substantial independence of the two latent variables (Van Mierlo et al., 2009). The bifactor model significantly improved the model’s fit compared to the two-factor model. A non-significant RMSEA indicated a close fit for this model, and the other fit indices were excellent.
The standardized factor loading matrix is reported in Table 2. All items significantly loaded on the General factor, which explained 32% of the total variance. Except for item #3, all factor loadings for the General factor were in the 0.42 – 0.73 range. The Prospective and Inhibitory factors accounted for smaller fractions of the total variance (3% and 7%, respectively). Only three items out of seven significantly loaded the Prospective IU factor (λrange = 0.19 –0.54). Five items out of five loaded significantly on the Inhibitory IU factor (λrange = 0.13 –0.54). The ECV equal to 0.75 achieved Rodriguez et al. (2016) criterion (i.e., ECV > 0.70) for preferring the total score to subscale scores; however, the PUC = 0.53 recommended caution. In this case, an inspection of model-based reliability coefficients is needed to recommend using the total score instead of separate subscale scores. The ω and ωh for the general factor were close (0.88 and 0.80, respectively). For Prospective IU, the ωh was remarkably lower than the corresponding ω (0.77 and 0.04, respectively). Likewise, the ωh was lower than ω for Inhibitory IU (0.83 and 0.24, respectively). These findings showed that the Prospective and Inhibitory IU factors did not contribute substantially to the total score’s reliability. Conversely, the reliability of the subscales was mostly due to the General factor variance, especially for Prospective IU. Collectively, these findings show the IUS-R total score is viable and preferable to subscale scores.
The ANOVA of the IUS-R total score showed statistically significant differences by sex (F1,856 = 7.78; p < 0.01; Cohen’s f = 0.09) and age group (F2,856 = 5.10; p < 0.01; Cohen’s f = 0.09), whereas the interaction was not significant. Girls’ scores (M = 32.56; SD = 9.32) were significantly higher than boys’ scores (M = 30.66; SD = 9.07). Gabriel’s post hoc test (suitable for unequal sample sizes) showed that the preadolescent group (M = 33.26; SD = 9.30) obtained higher IUS-R scores than early (M = 30.75; SD = 8.85) and middle (M = 31.61; SD = 9.41) adolescents, although mean differences were only marginally significant in the second comparison (pGabriel = 0.009 and 0.097, respectively). No differences were found comparing the two adolescent groups (pGabriel = 0.565). The following measurement invariance section will address whether the observed differences reflect true differences in the latent variable or item-specific variance components unrelated to IU.
Measurement invariance of the IUS-R
The bifactor model was the baseline model in multigroup analyses (MGCFA) aimed at testing the measurement invariance of the IUS-R. Fit indices and hypothesis testing are reported in Table 3.
The configural and metric invariance models were excellent in MGCFA analyses by sex and age. The chi-square difference test between models was only marginally significant (p < 0.10) in the analysis by age, and the differences in other fit indices were below the thresholds for concluding no substantial loss of fit (Chen, 2007). In the analysis by sex, the chi-square difference test was not statistically significant. These results supported the metric invariance hypothesis. In contrast, the scalar invariance hypothesis was rejected because models that imposed the equality of item intercepts significantly lost fit compared to metric invariance models. Latent mean comparisons become equivocal when scalar invariance fails. A difference in the latent means could be due to a difference in the item intercepts rather than to a difference in the IU construct.
The inspection of the model modification indices revealed that the source of the misfit in the analysis by age was due to the non-invariance of a few item intercepts (i.e., #2, #5, and #12) between the preadolescent group and the two adolescent groups. Likewise, noninvariant item intercepts (i.e., #1, #7, #8, and #12) produced misfit in the analysis by sex. Allowing those intercepts to be freely estimated for the preadolescent and female groups supported the partial scalar invariance by age and sex (i.e., ∆CFI ≤ 0.010, ∆RMSEA and ∆SRMR ≤ 0.015).
Partial scalar invariance is deemed insufficient for interpreting latent mean differences without ambiguity (e.g., De Beuckelaer & Swinnen, 2018; Kuha & Moustaki, 2015). Nevertheless, because the intercepts of early and middle adolescents were invariant, we investigated how these age groups differed in the General IU factor to aid the interpretation of ANOVA results previously reported. A derivative of the partial scalar invariance model was tested, freeing the latent means of the preadolescent and early adolescent groups. Thus, the standardized parameter for each group is expressed as a Standardized Mean Difference from the middle adolescent group that serves as reference group. The derivative model fitted the data significantly better than the partial invariance model (∆χ2 = 10.31; df = 2; p < 0.001), but the latent mean of the early adolescent group did not differ from the reference group (SMD = − 0.14; z = -1.59; p = 0.112).
Construct validity of the IUS-R
The correlation matrix between the IUS-R and the other administered questionnaires is displayed in the Supplementary Information (Table S2). As regards convergent validity, moderate-to-high positive correlations emerged with all the SAFA-A scales (Pearson’s r ranging from 0.31 to 0.54) and with the YSR anxiety/depression, withdrawal/depression, social problems, thought-related problems, and internalizing problems scales (Pearson’s r ranging from 0.30 to 0.51). Low and positive correlations were detected with the YSR somatic complaints, aggressive behavior, attention problems, and externalizing problems scales (Pearson’s r ranging from 0.10 to 0.28), while the only non-significant correlation was observed with the rule-breaking behavior scale. Then, pertaining to divergent validity, no significant correlation emerged considering the PWB total score, while a small negative correlation was found with the P Scale. Regression analyses (Supplementary Table S3) showed that the SAFA-A and YSR scales accounted for 34% and 28% of the variance in IUS-R scores, respectively. The SAFA-A generalized anxiety and YSR anxiety/depression scores were the single best predictors of IU scores. The variables used to assess the divergent validity accounted for a minimal amount of the IUS-R variance (3%) and only the P Scale was significant. Thus, regression analyses confirmed the convergent and divergent validity of the IUS-R.
Discussion
The transdiagnostic nature of IU and its role in the onset of psychological disorders are well-established in adulthood (e.g., McEvoy et al., 2019a). In contrast, the IU construct has received insufficient attention during adolescence, although this period of life is fraught with uncertainty, and vulnerability to psychopathology is high (e.g., Bottesi, in press); unsolved issues about IU measurement also plague IU research in teenagers (Cornacchio et al., 2018; Shihata et al., 2016). Bearing all this in mind, the present study aimed to investigate the factorial structure and psychometric properties of the gold standard tool for measuring IU – namely, the IUS-R – in a sample of Italian youth. The study’s main findings confirmed the hypotheses and added to our understanding of the characteristics and evaluation of IU in adolescence as follows.
The correlated two-factor model showed acceptable fit indices. Nevertheless, the Prospective and Inhibitory IU factors were highly correlated, thus suggesting empirical overlap. The bifactor model significantly improved the fit, demonstrating that the IUS-R items are influenced by a broad general factor and two narrow group factors reflecting Prospective and Inhibitory IU. This broad factor accounted for 75% of the common variance, an amount consistent with previous studies conducted with adult samples, in which it ranged from 75 to 87% (Bottesi et al., 2019b; Hale et al., 2016; Huntley et al., 2020; Lauriola et al., 2016; Shihata et al., 2018; Wilson et al., 2020; Yao et al., 2021).
Recent studies have questioned the bifactor model’s validity in youth, recommending instead using the unidimensional model after the atheoretical removal of one item (Osmanağaoğlu et al., 2021), or the two-factor model, which performed better in concurrent validity analyses (Cornacchio et al., 2018). Nonetheless, since these studies used a different IUS scale (i.e., the IUSC), it is unclear whether negative findings regarding the bifactor model are due to that specific scale or whether the general factor is problematic to be found and measured at this age. Our results are consistent with the first interpretation, given that the bifactor model outperformed the competing models of the IUS-R without removing any items, and partly agreed with Osmanağaoğlu et al. (2021) regarding the use of the total score as a reliable assessment of the IU construct in adolescence.
Item loadings on the General factor are in line with findings obtained in nonclinical adult samples, being moderately high and statistically significant (Bottesi et al., 2019b; Hale et al., 2016; Huntley et al., 2020; Lauriola et al., 2016; Shihata et al., 2018). A notable exception was the factor loading of item #3, which was barely acceptable in magnitude, consistently with previous studies in Italian adult samples (Bottesi et al., 2019b; Lauriola et al., 2016). Our result may thereby constitute additional evidence of the occurrence of cross-cultural differences in interpreting uncertainty. Such an issue is still unexplored by the extant literature. However, it has been speculated that differences in how the cultures engage with uncertainty at the level of IU core beliefs may occur (Bottesi et al., 2019b; Lauriola et al., 2018) and that culturally different attitudes to metacognition may intervene in the interpretation of uncertainty (Bottesi et al., 2016). Studies in the field of economics and business sciences listed Italy among the “strong uncertainty avoidance cultures”, thus suggesting that Italians are more likely to react negatively to unfamiliar situations than individuals with a different cultural background (e.g., Stremersch & Tellis, 2004). Therefore, a cultural variation in response to items assessing coping with uncertainty through deliberative processes may reflect the role played by cultural values in defining the way individuals interpret and express their emotions.
Nonetheless, neurocognitive development in adolescence should be considered, too. Indeed, item #3 explicitly refers to the need to plan to avoid future unpleasant events (i.e., “People should always think about what will happen next. This will stop bad things from happening.”), so it seems to imply deliberative processes to cope with uncertainty. Frontal and prefrontal brain areas - responsible for planning complex cognitive behaviors, rational decision-making, and moderation of social conduct - are still underdeveloped during adolescence (Spear, 2000), thus reducing the teenagers’ ability to plan rationally. Therefore, adolescents’ peculiar neuropsychological and cognitive functioning may explain why they did not fully endorse item #3. This is further supported by the results of Osmanağaoğlu et al. (2021), who found that item #10 of the IUSC-12, concerning the need to look ahead to prevent surprises, was judged difficult to understand by a high proportion of participants, and the model fit was improved by removing it. Consequently, age-related factors may add to linguistic and cultural issues in accounting for the poor performance of items describing coping with uncertainty through deliberative processes. Future studies involving adolescents from different countries may be helpful to better clarify this aspect.
Item loadings on the group factors also align with previous research in adult samples. Our study showed that some IUS-R items failed to load significantly on the Prospective IU factor (i.e., #1, #2, #4, and #6), and the rest had small loadings (i.e., #3, #5). Similarly, all studies using a bifactor model to address the factor structure of the IUS scales in adulthood found that the Prospective IU domain was weak (Bottesi et al., 2019b; Hale et al., 2016; Huntley et al., 2020; Lauriola et al., 2016; Shihata et al., 2018; Yao et al., 2021). However, the only study using the IUS-R (Bottesi et al., 2019b) reported a slightly stronger Prospective IU factor than the other studies because all factor loadings were statistically significant, though only three items had values greater than 0.30. Therefore, although the IUS-R is intended to be used across the lifespan, our findings suggest that the Prospective IU factor is inconsistent in adolescents, even more so than in adults, at least in the Italian context. Further item refinement is perhaps needed to obtain a more reliable and theoretically sound Prospective IU factor in adults and young people.
The Inhibitory IU factor was robust, with only one item (i.e., #12) failing to yield a statistically significant loading. Nevertheless, in line with previous research, this factor only accounted for a small portion of variance, far less than the General factor (Bottesi et al., 2019b; Hale et al., 2016; Lauriola et al., 2016; Shihata et al., 2018). Recent studies have also shown that Inhibitory IU is unreliable in nonclinical (Huntley et al., 2020; Yao et al., 2021) and GAD (Wilson et al., 2020) adult samples. Therefore, the Inhibitory IU subscale should be used with caution when assessing IU in the adolescent population. Some of the abovementioned studies also detected item #12 as problematic (Bottesi et al., 2019b; Hale et al., 2016; Huntley et al., 2020; Lauriola et al., 2016; Shihata et al., 2018). This item is likely not fully represent the Inhibitory IU domain, neither in adults nor in adolescents. In fact, unlike the other items describing a “behavioral paralysis” in the face of uncertainty (Birrell et al., 2011), item #12 refers to an active attempt to escape from uncertain situations (“I must get away from all things I am unsure of”). Consequently, to strengthen the Inhibitory IU factor, item #12 should be revised by making its content more consistent with the scale’s overall meaning.
In keeping with the above-discussed findings, our study evidenced high ω reliability coefficients for all factors in the bifactor model. However, while we found a slight difference between the ω and ωh coefficients for the General factor, the same difference was remarkable for the Inhibitory and Prospective IU factors. These results prove that the two group factors do not contribute considerably to the reliability of the corresponding subscales, which, on the contrary, derive most of their reliable variance from the General factor. This pattern and the common variance accounted for by the general factor recommend using a total score instead of subscale scores (Rodriguez et al., 2016), a conclusion also reached by several studies on the adult population (Hale et al., 2016; Huntley et al., 2020; Shihata et al., 2018). In sum, group factors are needed to model the IU construct to account for imperfect items or systematic variance in IU side contents; however, they have little relevance for psychological assessment.
An application of the IUS-R should be to assess how IU develops from childhood to adulthood. Establishing measurement invariance is crucial for disentangling whether inferences based on the IUS-R scores reflect variability in the IU construct or item responses unrelated to IU. Our study supported the bifactor model’s configural and metric invariance in different age and sex groups. These findings ensure the unbiased comparison of correlations involving the IUS-R and other criteria instruments in preadolescents, early adolescents, middle adolescents, and samples of girls and boys. Unfortunately, the scalar invariance was not fully supported by age and sex. The former result suggests that mean differences in the IUS-R scores are unbiased only from 14 years old and up. The latter means that girls and boys may differ not necessarily in IU, but also in how they respond to specific items. We tested age and sex differences in the IUS-R total score, showing that the preadolescent group was significantly more intolerant of uncertainty than the two adolescent groups. At the same time, girls obtained higher scores than boys. In light of the partial scalar invariance, we cannot be sure that the mean differences between age groups correspond to a higher level of IU in preadolescents. Still, it may also stem from how the youngest participants interpreted items #2, #5, and #12. Likewise, gender differences may arise from different meanings that girls and boys attached to items #1, #7, #8, and #12. While we have already discussed item #12 as problematic from several perspectives, the contents of the remaining items need to be re-evaluated for their use under age 14 or to study sex differences during adolescence.
Some authors have argued that mean differences can be meaningful under partial scalar invariance, if most items in a scale are invariant (Steenkamp & Baumgartner, 1998; Steinmetz, 2013). Our findings suggest that IU may be decreasing from preadolescence to adulthood if these authors are correct. Indeed, preadolescents were significantly more intolerant of uncertainty than adolescents, who, in turn, obtained higher scores on the IUS-R compared to the Italian adult normative sample (see Bottesi et al., 2019b). In general, younger participants may be high in IU because they frequently cope with many new, changeable, and uncontrollable events, scattered by uncertainty (Casey et al., 2010; Read et al., 2013); therefore, IU may be a phase-specific feature of adolescence itself. The relatively high scores we found in preadolescents and adolescents are not frequently observed in normative adult samples, wherein such high scores indicate a risk of developing psychopathological symptoms. However, considering that our data were collected in the school setting, thus with a low prevalence of psychopathology, high scores assume a different meaning. Adolescents may perceive uncertainty and difficulties managing it as more “normal” than adults, thus experiencing emotional, behavioral, and cognitive responses to uncertainty as less negative. Consequently, high IU scores at younger ages may not necessarily reflect an increased risk of developing a mental disorder, further supported by the absence of significant direct associations between IU and general psychological well-being that emerged from correlational analyses. However, future research in clinical samples is needed to shed light on the relationship between IU and the onset of mental disorders in teenagers.
Finally, IU scales are expected to yield moderate-strong correlations with internalizing symptoms (e.g., Boelen et al., 2010; Bottesi et al., 2019b; Comer et al., 2009; Cornacchio et al., 2018; Osmanağaoğlu et al., 2021; Wright et al., 2016). Accordingly, we found moderately high correlations between the IUS-R total score and internalizing dimensions, namely anxiety, depression, social problems, and withdrawal; therefore, our study provides additional support to the well-established association between IU and internalizing problems in adolescents. With specific regard to anxiety-related dimensions, regression analyses showed that the generalized anxiety scale of the SAFA-A accounted for the largest unique amount of IUS-R variance, thus suggesting that IU may be a core feature of GAD in adults and adolescents. Although significant in regression analyses, social and school anxiety scores accounted for a limited amount of the IUS-R variance. This finding suggests that IU may be implicated in symptoms pertaining to all anxiety-based disorders, but not in equal measure in all. The relationship between IU and social, school, and separation anxiety symptoms in teenagers may be moderated by other cognitive, emotional, or social variables. For example, previous studies found that several vulnerability factors (e.g., looming cognitive style, fear of negative evaluation, anxiety sensitivity) are involved in the relationship between IU and anxiety-related problems (including social anxiety) in adults (e.g., Boelen & Reijntjes, 2009; Riskind et al., 2000). Similarly, together with IU, other factors may have a bearing on the onset and maintenance of social, separation, and school anxiety in adolescence.
Lastly, our findings supported an adequate divergent validity of the IUS-R. Although we expected negative correlations between scales assessing general psychological well-being and the IUS-R, the fact that we ascertained significance only with the P Scale and still modest in magnitude is reasonable. Indeed, the PWB scale does not measure the experience of positive vs. negative mood states, but an existential form of well-being associated with realizing personal potential (i.e., eudaimonic well-being). Accordingly, a recent cluster analysis study showed that hedonic and eudaimonic well-being could be dissociated (Pancheva et al., 2021). While low hedonic well-being is undoubtedly a feature that might characterize adolescents’ anxious or depressive states (i.e., anhedonia), of which IU might be the foundation, the same cannot be said for low eudemonic well-being. Therefore, the absence of association with the IUS-R may suggest that adolescents might not experience negative emotions towards the low realization of personal potential as adults may do. Furthermore, a small negative correlation between the IUS-R and the P Scale emerged. Again, this is in line with our hypothesis since a positive attitude towards life is rather uncommon in people with high IU, who instead tend to find everyday life uncertain situations as upsetting and undesirable.
Limitations and future directions
Some limitations characterize the present study. First, our results cannot be fully generalized to the Italian preadolescent and adolescent population despite the relatively large sample size. Indeed, participants were recruited exclusively in northern Italy; future studies may involve youth residing in central and southern regions to maximize the sample’s representativeness. Second, we cannot exclude that the length of the survey may have somewhat interfered with the reliability of the completion. For instance, boredom should be considered, given that adolescents are generally more prone to being bored (e.g., Caldwell et al., 1999). Then, we did not include a parent-report assessment of IU. We aimed to provide information about the factor structure and psychometric properties of the self-report version of the IUS-R. Still, we acknowledge that availing of a parent-report measure could have further informed our results. Last, our study lacks a clinical sample of adolescents and, consequently, present findings may not generalize to young people with full-blown psychopathologies. Future research examining the measurement invariance of the IUS-R factor model across nonclinical and clinical samples of adolescents is recommended.
Despite its limitations, our study supports using the IUS-R to measure IU across the lifespan. In addition, consistently with the extant literature, our findings pointed out several issues regarding the measurement of Prospective and Inhibitory IU. To note, previous research in adults and adolescents showed that the two IU components have distinct associations with different strategies used to manage uncertain situations, as well as with psychopathological constructs (e.g., Boelen et al., 2010; Bottesi et al., 2019a; Hong & Lee, 2015; Wright et al., 2016). Further revisions of both scales are thereby recommended to clarify the role of the IU components in influencing the performance of particular coping strategies to deal with uncertainty and the development of specific psychological problems. Specifically, aligned with recent recommendations, any future refinement of the IUS-R may be grounded on a theory-driven approach to adequately capture any group factors potentially underlying the general construct (Bottesi et al., 2019b).
Several clinical implications can be traced from the current results. A noteworthy aspect brought to light by the present study regards the transdiagnostic nature of IU, which was found to be significantly associated with thought-related issues and externalizing symptomatology (i.e., aggressive behavior and attention problems). In particular, the thought-related problems scale of the YSR encompasses a wide range of symptoms, such as self-harming behaviors, obsessive-compulsive symptoms, psychotic symptoms, and sleep problems. Overall, these results are consistent with the literature; in fact, although IU is notoriously a factor spanning internalizing symptoms (Carleton, 2016a, b), recent studies have suggested that IU may contribute to externalizing psychopathology as well (e.g., Bottesi et al., 2021). Therefore, our findings may indicate that IU may not be only associated with anxiety and other internalizing dimensions, but also with a broad spectrum of psychopathological symptoms and conditions. It is possible that, under certain individual and environmental conditions, IU poses a risk for the development of psychological disorders in teenagers. This issue is vital for future research, which should involve a clinical population to pinpoint any differences vis-à-vis the general adolescent population and clarify the link between IU, psychological well-being, and mental disorders. Moreover, potential protective factors should also be considered to study how they influence the path from IU to the onset of psychological disorders and include them in the implementation of preventive programs aimed at the adolescent population.
In conclusion, because the multidimensionality of the IUS-R does not appear to be substantial in adolescents, the present study recommends researchers to model the factorial structure of the IUS-R according to a bifactor approach and urges clinicians to use the total score instead of subscale scores when assessing adolescents. Since IU can be a defining characteristic of adolescents and simultaneously a transdiagnostic vulnerability factor, it seems crucial to rely on the IUS-R to determine its clinical levels and further investigate IU’s relationships with psychopathological constructs in this age group. In particular, IU is a well-known risk factor for the onset of anxiety disorders, which are the psychological problems with the highest prevalence rate among teenagers (e.g., De Girolamo et al., 2012). Consequently, it would be beneficial to widen knowledge on the relationship between IU and anxiety-based disorders and include the IUS-R as an outcome measure in treatment programs for adolescent anxiety. Lastly, taking a preventive approach, a thorough study of IU in teenagers would enable the design and development of early interventions to prevent maladaptive outcomes in such a vulnerable population; hence the importance of the IUS-R as a tool capable of reliably measuring IU in adolescents and a range of settings.
Data Availability
The data that support the findings of this study are available from the corresponding author, G.B., upon reasonable request.
References
Achenbach, T. M., & Rescorla, L. A. (2001). Manual for the ASEBA School-Age Forms & Profiles: An Integrated System of Multi-Informant Assessment. University of Vermont Research Center for Children, Youth, & Families
Birrell, L., Meares, K., Wilkinson, A., & Freeston, M. H. (2011). Toward a definition of intolerance of uncertainty: a review of factor analytical studies of the Intolerance of Uncertainty Scale. Clinical Psychology Review, 31(7), 1198–1208. https://doi.org/10.1016/j.cpr.2011.07.009
Boelen, P., Vrinssen, I., & Van Tulder, F. (2010). Intolerance of Uncertainty in Adolescents; correlations with worry, social anxiety, and depression. The Journal of Nervous and Mental Disease, 198(3). https://doi.org/10.1097/NMD.0b013e3181d143de
Bottesi, G. (in press). Vulnerabilità psicopatologica in adolescenza: l’intolleranza all’incertezza come fattore di rischio transdiagnostico. Psicologia clinica dello sviluppo.
Bottesi, G., Carraro, E., Martignon, A., Cerea, S., & Ghisi, M. (2019a). “I’m Uncertain: What Should I Do?“: an Investigation of Behavioral Responses to Everyday Life Uncertain Situations. International Journal of Cognitive Therapy, 12, 55–72. https://doi.org/10.1007/s41811-019-00040-y
Bottesi, G., & Freeston, M. H. (2012). An examination of construct of Intolerance of Uncertainty with groups of typically developing young people of different ages. In: M. H. Freeston (Convenor), Intolerance of Uncertainty, Worry, and Generalized Anxiety Disorder among young people. Symposium conducted at the 40th British Association for Behavioural and Cognitive Psychotherapies (BABCP) Annual Conference, Leeds, United Kingdom, 26–29 June. Congress proceedings, pp.54
Bottesi, G., Ghisi, M., Caggiu, I., & Lauriola, M. (2021). How is intolerance of uncertainty related to negative affect in individuals with Substance Use Disorders? The role of the inability to control behaviors when experiencing emotional distress. Addictive Behaviors, 115, 106785. https://doi.org/10.1016/j.addbeh.2020.106785
Bottesi, G., Ghisi, M., Carraro, E., Barclay, N., Payne, R., & Freeston, M. H. (2016). Revising the intolerance of uncertainty model of generalized anxiety disorder: evidence from UK and Italian undergraduate samples. Frontiers in Psychology, 7, 1723. https://doi.org/10.3389/fpsyg.2016.01723
Bottesi, G., Ghisi, M., Novara, C., Bertocchi, J., Boido, M., De Dominicis, I., & Freeston, M. H. (2015). Intolerance of Uncertainty Scale (IUS-27 e IUS-12): due studi preliminari. Psicoterapia Cognitiva e Comportamentale, 21(3), 345–365
Bottesi, G., Marchetti, I., Sica, C., & Ghisi, M. (2020). What is the internal structure of intolerance of uncertainty? A network analysis approach. Journal of Anxiety Disorders, 75, 102293. https://doi.org/10.1016/j.janxdis.2020.102293
Bottesi, G., Noventa, S., Freeston, M. H., & Ghisi, M. (2019b). Seeking certainty about Intolerance of Uncertainty: Addressing old and new issues through the Intolerance of Uncertainty Scale-Revised. PloS one, 14(2), e0211929. https://doi.org/10.1371/journal.pone.0211929
Bottesi, G., Tesini, V., Cerea, S., & Ghisi, M. (2018). Are Difficulties in Emotion Regulation and Intolerance of Uncertainty related to negative affect in Borderline Personality Disorder? Clinical Psychologist, 22(2), 137–147. https://doi.org/10.1111/cp.12163
Boelen, P. A., & Reijntjes, A. (2009). Intolerance of uncertainty and social anxiety. Journal of Anxiety Disorders, 23, 130–135. https://doi.org/10.1016/j.janxdis.2008.04.007
Boulter, C., Freeston, M., South, M., & Rodgers, J. (2014). Intolerance of uncertainty as a framework for understanding anxiety in children and adolescents with autism spectrum disorders. Journal of Autism and Developmental Disorders, 44, 1391–1402. https://doi.org/10.1007/s10803-013-2001-x
Caldwell, L. L., Darling, N., Payne, L. L., & Dowdy, B. (1999). “Why are you bored?“: An examination of psychological and social control causes of boredom among adolescents. Journal of leisure research, 31(2), 103–121. https://doi.org/10.1080/00222216.1999.11949853
Caprara, G. V., Alessandri, G., Eisenberg, N., Kupfer, A., Steca, P., Caprara, M. G., & Abela, J. (2012). The Positivity Scale. Psychological Assessment, 24(3), 701–712. https://doi.org/10.1037/a0026681
Carleton, R. N. (2016a). Fear of the unknown: One fear to rule them all? Journal of Anxiety Disorders, 41, 5–21. https://doi.org/10.1016/j.janxdis.2016.03.011
Carleton, R. N. (2016b). Into the unknown: A review and synthesis of contemporary models involving uncertainty. Journal of Anxiety Disorders, 39, 30–43. https://doi.org/10.1016/j.janxdis.2016.02.007
Carleton, R. N., Norton, M. A. P. J., & Asmundson, G. J. G. (2007). Fearing the unknown: a short version of the Intolerance of Uncertainty Scale. Journal of Anxiety Disorders, 21, 105–117. https://doi.org/10.1016/j.janxdis.2006.03.014
Casey, B. J., Duhoux, S., & Cohen, M. M. (2010). Adolescence: What Do Transmission, Transition, and Translation Have to Do with It? Neuron, 67, 749–760. https://doi.org/10.1016/j.neuron.2010.08.033
Chen, F. F. (2007). Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14(3), 464–504. https://doi.org/10.1080/10705510701301834
Cianchetti, C., & Fancello, G. S. (2001). SAFA: Scale Psichiatriche di Autosomministrazione per Fanciulli e Adolescenti: Manuale. Firenze: Giunti Psychometrics
Cohen, J. (1988). Statistical power analysis for the behavioral sciences. 2nd Edition. Hillsdale, NJ: Lawrence Erlbaum Associate, Publishers
Comer, J. S., Roy, A. K., Furr, J. M., Gotimer, K., Beidas, R. S., Dugas, M. J. … Kendall, P. C. (2009). The Intolerance of Uncertainty Scale for Children: A Psychometric Evaluation. Psychological Assessment, 21(3), 402–411. https://doi.org/10.1037/a0016719
Cornacchio, D., Sanchez, A. L., Coxe, S., Roy, A., Pincus, D. B., Read, K. L. … Comer, J. S. (2018). Factor structure of the intolerance of uncertainty scale for children. Journal of Anxiety Disorders, 53, 100–107. https://doi.org/10.1016/j.janxdis.2017.07.003
De Beuckelaer, A., & Swinnen, G. (2018). Biased latent variable mean comparisons due to measurement noninvariance: A simulation study. Cross-Cultural Analysis (pp. 127–156). Routledge
De Girolamo, G., Dagani, J., Purcell, R., Cocchi, A., & Mcgorry, P. D. (2012). Age of onset of mental disorders and use of mental health services: needs, opportunities and obstacles. Epidemiology and Psychiatric Sciences, 21, 47–57. https://doi.org/10.1017/S2045796011000746
Dekkers, L. M., Jansen, B. R., Salemink, E., & Huizenga, H. M. (2017). Intolerance of Uncertainty Scale: Measurement invariance among adolescent boys and girls and relationships with anxiety and risk taking. Journal of Behavior Therapy and Experimental Psychiatry, 55, 57–65. https://doi.org/10.1016/j.jbtep.2016.11.009
Dugas, M. J., Gagnon, F., Ladouceur, R., & Freeston, M. H. (1998). Generalized anxiety disorder: a preliminary test of a conceptual model. Behaviour Research and Therapy, 36(2), 215–226. https://doi.org/10.1016/S0005-7967(97)00070-3
Freeston, M. H., Rhéaume, J., Letarte, H., Dugas, M. J., & Ladouceur, R. (1994). Why do people worry? Personality and Individual Differences, 17(6), 791–802. https://doi.org/10.1016/0191-8869(94)90048-5
Freeston, M., Tiplady, A., Mawn, L., Bottesi, G., & Thwaites, S. (2020). Towards a model of uncertainty distress in the context of Coronavirus (COVID-19). The Cognitive Behaviour Therapist, 13, E31. https://doi.org/10.1017/S1754470X2000029X
Frigerio, A., Cattaneo, C., Cataldo, M., Schiatti, A., Molteni, M., & Battaglia, M. (2004). Behavioral and emotional problems among Italian children and adolescents aged 4 to 18 years as reported by parents and teachers. European Journal of Psychological Assessment, 20(2), 124–133. https://doi.org/10.1027/1015-5759.20.2.124
Gentes, E., L., & Ruscio, A. M. (2011). A meta-analysis of the relation of intolerance of uncertainty to symptoms of generalized anxiety disorder, major depressive disorder, and obsessive-compulsive disorder. Clinical Psychology Review, 31, 923–933. https://doi.org/10.1016/j.cpr.2011.05.001
Hale, W., Richmond, M., Bennett, J., Berzins, T., Fields, A., Weber, D. … Osman, A. (2016). Resolving Uncertainty About the Intolerance of Uncertainty Scale–12: Application of Modern Psychometric Strategies. Journal of Personality Assessment, 98, 200–208. https://doi.org/10.1080/00223891.2015.1070355
Hong, R. Y., & Lee, S. S. (2015). Further clarifying prospective and inhibitory intolerance of uncertainty: Factorial and construct validity of test scores from the Intolerance of Uncertainty Scale. Psychological Assessment, 27(2), 605. https://doi.org/10.1037/pas0000074
Huntley, C. D., Young, B., Smith, C. T., & Fisher, P. L. (2020). Uncertainty and test anxiety: Psychometric properties of the Intolerance of Uncertainty Scale–12 (IUS-12) among university students. International Journal of Educational Research, 104, 101672. https://doi.org/10.1016/j.ijer.2020.101672
Jorgensen, T. D., Pornprasertmanit, S., Schoemann, A. M., & Rosseel, Y. (2018). semTools: Useful tools for structural equation modeling. R package version 0.4-0. R Package Version 0.5-1. https://cran.r-project.org/package=semTools
Joyce, C., Honey, E., Leekam, S. R., Barrett, S. L., & Rodgers, J. (2017). Anxiety, Intolerance of Uncertainty and Restricted and Repetitive Behaviour: Insights Directly from Young People with ASD. Journal of Autism and Developmental Disorders, 1–14. https://doi.org/10.1007/s10803-017-3027-2
Kuha, J., & Moustaki, I. (2015). Nonequivalence of measurement in latent variable modeling of multigroup data: A sensitivity analysis. Psychological Methods, 20, 523–536. https://doi.org/10.1037/met0000031
Lauriola, M., Mosca, O., & Carleton, R. N. (2016). Hierarchical factor structure of the Intolerance of Uncertainty Scale short form (IUS-12) in the Italian version. TPM Testing Psychometrics Methodology in Applied Psychology, 23, 377–394. https://doi.org/10.4473/TPM23.3.8
Lauriola, M., Mosca, O., Trentini, C., Foschi, R., Tambelli, R., & Carleton, R. N. (2018). The intolerance of uncertainty inventory: validity and comparison of scoring methods to assess individuals screening positive for anxiety and depression. Frontiers in Psychology, 9, 388. https://doi.org/10.3389 /fpsyg.2018.00388
McEvoy, P. M., & Erceg-hurn, D. M. (2016). The search for universal transdiagnostic and trans-therapy change processes: Evidence for intolerance of uncertainty. Journal of Anxiety Disorders, 41, 96–107. https://doi.org/10.1016/j.janxdis.2016.02.002
McEvoy, P. M., Hyett, M. P., Shihata, S., Price, J. E., & Strachan, L. (2019a). The impact of methodological and measurement factors on transdiagnostic associations with intolerance of uncertainty: A meta-analysis. Clinical Psychology Review, 73, 101778. https://doi.org/10.1016/j.cpr.2019.101778
McEvoy, P. M., & Mahoney, A. E. (2011). Achieving certainty about the structure of intolerance of uncertainty in a treatment-seeking sample with anxiety and depression. Journal of Anxiety Disorders, 25, 112–122. https://doi.org/10.1016/j.janxdis.2010.08.010
McEvoy, P. M., Salmon, K., Hyett, M. P., Jose, P. E., Gutenbrunner, C., Bryson, K., & Dewhirst, M. (2019b). Repetitive negative thinking as a transdiagnostic predictor of depression and anxiety symptoms in adolescents. Assessment, 26(2), 324–335. https://doi.org/10.1177/1073191117693923
Osmanağaoğlu, N., Creswell, C., & Dodd, H. F. (2018). Intolerance of Uncertainty, anxiety, and worry in children and adolescents: A meta-analysis. Journal of Affective Disorders, 225, 80–90. https://doi.org/10.1016/j.jad.2017.07.035
Osmanağaoğlu, N., Creswell, C., Snuggs, S., Stuijfzand, S., & Dodd, H. F. (2021). Evaluating the psychometric properties of the intolerance of uncertainty scale for children in a preadolescent sample. Journal of Anxiety Disorders, 77, 102343. https://doi.org/10.1016/j.janxdis.2020.102343
Pancheva, M. G., Ryff, C. D., & Lucchini, M. (2021). An integrated look at well-being: Topological clustering of combinations and correlates of hedonia and eudaimonia. Journal of Happiness Studies, 22, 2275–2297. https://doi.org/10.1007/s10902-020-00325-6
Polanczyk, G. V., Salum, G. A., Sugaya, L. S., Caye, A., & Rohde, L. A. (2015). Annual research review: A meta-analysis of the worldwide prevalence of mental disorders in children and adolescents. Journal of Child Psychology and Psychiatry, 56, 345–365. https://doi.org/10.1111/jcpp.12381
Read, K. L., Comer, J. S., & Kendall, P. C. (2013). The Intolerance of Uncertainty Scale for Children (IUSC): Discriminating Principal Anxiety Diagnoses and Severity. Psychological Assessment, 25(3), 722–729. https://doi.org/10.1037/a0032392
Reise, S. P. (2012). The Rediscovery of Bifactor Measurement Models. Multivariate Behavioral Research, 47(5), 667–696. https://doi.org/10.1080/00273171.2012.715555
Riskind, J. H., Williams, N. L., Gessner, T. L., Chrosniak, L. D., & Cortina, J. M. (2000). The looming maladaptive style: Anxiety, danger, and schematic processing. Journal of Personality and Social Psychology, 79, 837–852. https://doi.org/10.1037//0022-3514.79.5.837
Rodriguez, A., Reise, S. P., & Haviland, M. G. (2016). Applying Bifactor Statistical Indices in the Evaluation of Psychological Measures. Journal of Personality Assessment, 98(3), 223–237. https://doi.org/10.1080/00223891.2015.1089249
Rosseel, Y. (2012). lavaan: An R Package for Structural Equation Modeling. Journal Of Statistical Software, 48(1), 1–36. https://doi.org/10.18637/jss.v048.i02
Ruini, C., Ottolini, F., Rafanelli, C., Ryff, C., & Fava, G. A. (2003). La validazione italiana delle Psychological Well-being Scales (PWB). Rivista Di Psichiatria, 38(3), 117–130
Ryff, C. D., & Keyes, C. L. M. (1995). The structure of psychological well-being revisited. Journal of personality and social psychology, 69(4), 719. https://doi.org/10.1037/0022-3514.69.4.719
Sanchez, A. L., Cornacchio, D., Chou, T., Leyfer, O., Coxe, S., Pincus, D. … Comer, J. S. (2017). Development of a scale to evaluate young children’s responses to uncertainty and low environmental structure. Journal of Anxiety Disorders, 45, 17–23. https://doi.org/10.1016/j.janxdis.2016.11.006
Schermelleh-Engel, K., Moosbrugger, H., & Müller, H. (2003). Evaluating the fit of structural equation models: Tests of significance and descriptive goodness-of-fit measures. Methods of Psychological Research Online, 8, 23–74
Shapiro, M. O., Short, N. A., Morabito, D., & Schmidt, N. B. (2020). Prospective associations between intolerance of uncertainty and psychopathology. Personality and Individual Differences, 166, 110210. https://doi.org/10.1016/j.paid.2020.110210
Shihata, S., McEvoy, P. M., & Mullan, B. A. (2018). A bifactor model of intolerance of uncertainty in undergraduate and clinical samples: Do we need to reconsider the two-factor model? Psychological Assessment, 30, 893–903. https://doi.org/10.1037/pas0000540
Shihata, S., McEvoy, P. M., Mullan, B. A., & Carleton, R. N. (2016). Intolerance of uncertainty in emotional disorders: What uncertainties remain? Journal of Anxiety Disorders, 41, 115–124. https://doi.org/10.1016/j.janxdis.2016.05.001
Sirigatti, S., Stefanile, C., Giannetti, E., Iani, L., Penzo, I., & Mazzeschi, A. (2009). Assessment of factor structure of Ryff’s Psychological Well-Being Scales in Italian adolescents. Bollettino di Psicologia Applicata, 259, 30–50
Spear, L. P. (2000). The adolescent brain and age-related behavioral manifestations. Neuroscience & biobehavioral reviews, 24(4), 417–463. https://doi.org/10.1016/S0149-7634(00)00014-2
Steenkamp, J. B. E. M., & Baumgartner, H. (1998). Assessing measurement invariance in cross-national consumer research. Journal of Consumer Research, 25, 78–90. https://doi.org/10.1086/209528
Steinmetz, H. (2013). Analyzing observed composite differences across groups. Methodology, 9, 1–12. https://doi.org/10.1027/1614-2241/a000049
Stremersch, S., & Tellis, G. J. (2004). Understanding and managing international growth of new products. International Journal of Research in Marketing, 21, 421–438. https://doi.org/10.1016/j. ijresmar.2004.07.001
Tian, L., Zhang, D., & Huebner, E. S. (2018). Psychometric properties of the positivity scale among Chinese adults and early adolescents. Frontiers in Psychology, 9, 197. https://doi.org/10.3389/fpsyg.2018.00197
Van Mierlo, H., Vermunt, J. K., & Rutte, C. G. (2009). Composing group-level constructs from individual-level survey data. Organizational Research Methods, 12, 368–392
Viola, M. M., Musso, P., Inguglia, C., & Lo Coco, A. (2016). Psychological well-being and career indecision in emerging adulthood: The moderating role of hardiness. The Career Development Quarterly, 64(4), 387–396. https://doi.org/10.1002/cdq.12073
Yao, N., Qian, M., Jiang, Y., & Elhai, J. D. (2021). The influence of intolerance of uncertainty on anxiety and depression symptoms in Chinese-speaking samples: Structure and validity of the Chinese translation of the Intolerance of Uncertainty Scale. Journal of Personality Assessment, 103(3), 406–415. https://doi.org/10.1080/00223891.2020.1739058
Walker, S., Birrell, J., Rogers, J., Leekam, S., & Freeston, M. H. (2010). Intolerance of Uncertainty Scale-Revised. Newcastle University. (unpublished document)
Wilson, E. J., Stapinski, L., Dueber, D. M., Rapee, R. M., Burton, A. L., & Abbott, M. J. (2020). Psychometric properties of the Intolerance of Uncertainty Scale-12 in generalized anxiety disorder: Assessment of factor structure, measurement properties and clinical utility. Journal of Anxiety Disorders, 76, 102309. https://doi.org/10.1016/j.janxdis.2020.102309
Wright, K. D., Lebell, M. A. A., & Carleton, R. N. (2016). Intolerance of uncertainty, anxiety sensitivity, health anxiety, and anxiety disorder symptoms in youth. Journal of Anxiety Disorders, 41, 35–42. https://doi.org/10.1016/j.janxdis.2016.04.011
Zuffianò, A., López-Pérez, B., Cirimele, F., Kvapilová, J., & Caprara, G. V. (2019). The positivity scale: Concurrent and factorial validity across late childhood and early adolescence. Frontiers in psychology, 10, 831. https://doi.org/10.3389/fpsyg.2019.00831
Acknowledgements
This work was carried out within the scope of the project “use-inspired basic research”, for which the Department of General Psychology of the University of Padova has been recognized as “Dipartimento di eccellenza” by the Ministry of University and Research.
Funding
No funding was received for conducting this study. Open access funding provided by Università degli Studi di Padova within the CRUI-CARE Agreement.
Author information
Authors and Affiliations
Contributions
Conceptualization: Gioia Bottesi; Methodology: Marco Lauriola; Formal analysis and investigation: Sara Iannattone, Eleonora Carraro, Marco Lauriola; Writing - original draft preparation: Gioia Bottesi, Sara Iannattone, Eleonora Carraro, Marco Lauriola; Writing - review and editing: Gioia Bottesi, Marco Lauriola; Supervision: Gioia Bottesi, Marco Lauriola. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Competing Interests
The authors have no competing interests to declare that are relevant to the content of this article.
Ethics approval
The study was approved by the Ethics Committee for Psychological Research of the University of Padova and was conducted in accordance with the Declaration of Helsinki.
Consent to participate
Written informed consent was obtained from the parents, and students gave their assent to participate in the study.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Bottesi, G., Iannattone, S., Carraro, E. et al. The assessment of Intolerance of uncertainty in youth: An examination of the Intolerance of Uncertainty Scale-Revised in Italian nonclinical boys and girls. Res Child Adolesc Psychopathol 51, 209–222 (2023). https://doi.org/10.1007/s10802-022-00944-y
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10802-022-00944-y