Abstract
There is a lack of valid instruments to measure empowerment in Spanish-speaking populations. This study aimed to adapt the Netherlands Empowerment List (NEL), a 40-item scale, into Spanish and to test its psychometric properties examining its dimensional structure, internal consistency, temporal stability, relationships with other variables, and differential item functioning by gender. Participants were 406 users of mental health community rehabilitation services (52.5% male), with a mean age of 47.8 years. Results confirmed a six first-order factor structure of the scale. Internal consistency was excellent for the total score and ranged from excellent to adequate for subscale scores. Temporal stability was excellent for four subscales and good for the remaining two. The analysis of relationships between the Spanish NEL with other variables (i.e., empowerment, recovery, hope, perceived social support) provided additional evidence of its validity. Although four items showed uniform differential item functioning by gender, the effect size was negligible. The Spanish NEL yields valid and reliable scores, and it may be used to assess empowerment in Spanish-speaking countries.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Empowerment is a core concept of the World Health Organization’s (WHO) perspective on health promotion, and it is one of the cross-cutting principles in their mental health strategic plan (World Health Organization, 2013, 2021). Promoting empowerment is therefore central to the person-centred, recovery-oriented, and rights-based paradigm (World Health Organization, 2021). Empowerment is also a component of the CHIME recovery framework (Leamy et al., 2011), that is, the current international consensus about the key components of the recovery process, which serves as the foundation for research and practical applications in the field of personal recovery. This framework emerged from a systematic review and narrative synthesis of 97 publications in which the concept was defined, identifying five key elements. These elements, represented by the acronym CHIME, are Connectedness, Hope, Identity, Meaning in life, and Empowerment.
Together with the promotion of mutual support and advocacy, empowerment is one of the original goals of the users and survivors of psychiatry movements (Chamberlin et al., 1989). Reflecting this, in the early 1980s the psychologist Julian Rappaport proposed empowerment as a key concept for a paradigm shift and as an approach to intervention that could move beyond paternalism (Rappaport, 1981). In the almost two decades since the WHO recognized empowerment as a key priority (WHO – Regional Office for Europe, 2005), many countries and regions have incorporated empowerment promotion as an objective in their strategic plans. This shift in public policy is gradually being reflected in practice, which is increasingly driven by an emphasis on promoting user empowerment to make informed decisions (Barr et al., 2015).
As a result of this shift, empowerment is now seen both as a strategy to promote mental health and recovery and as an outcome in itself (Pekonen et al., 2020; Wallerstein, 2006). This means that interventions aimed at empowering users need to be evaluated. Although interventions are frequently described as promoting user empowerment, it is often unclear whether programs that employ this concept offer demonstrable benefits over those that do not (Chamberlin, 1997). Furthermore, there is still relatively little research on tools for evaluating empowerment outcomes (Cyril et al., 2016). This is particularly notable in Spanish-speaking countries, where instruments specifically designed (or adapted) and validated for measuring empowerment in mental health are lacking.
Since the promotion of empowerment began to be included as a goal of mental health services, a number of assessment tools have been developed in English-speaking and northern European countries. Barr et al. (2015) conducted a scoping review aimed at identifying scales that evaluate patient empowerment. They found five scales specifically designed to assess empowerment for mental health users (López et al., 2010; Oades et al., 2011; Rogers et al., 1997; Segal et al., 1995; Svedberg et al., 2007), but all of them had important limitations due to the low methodological quality of their respective validation studies, which lacked comprehensive psychometric testing (Barr et al., 2015).
In light of these limitations, Boevink et al. (2017) designed the Netherlands Empowerment List (NEL), a 40-item scale encompassing six domains: self-management, social support, caring community, connectedness, confidence and purpose, and professional help. Unlike earlier instruments, the NEL was developed following the COSMIN criteria (Mokkink et al., 2010), and the authors examined a broader range of psychometric properties, obtaining satisfactory results. The NEL has since been used in studies involving users with chronic and treatment-resistant anxiety or depressive disorders (Zoun et al., 2019), people with psychotic disorders (Vogel et al., 2020), and users diagnosed with severe mental disorders engaged in assertive community treatment (Tjaden et al., 2021).
The aim of the present study was to translate and culturally adapt the NEL into Spanish and then to test its psychometric properties with Spanish-speaking users of mental health services. The psychometric validation included analysis of differential item functioning by gender. The overall goal is to provide users, healthcare providers and the scientific community with a measurement instrument that yields valid and reliable scores, and which may be used to assess empowerment in Spanish-speaking populations.
Method
Participants
Participants were adult (≥ 18 years) users of community mental health services with no relevant cognitive impairment or comprehension difficulties, nor a severe or decompensated somatic disease. Informed consent to participate was signed by 415 users, but nine were excluded due to missing data. The final sample therefore comprised 406 participants.
Measures
Netherlands Empowerment List (NEL) (Boevink et al., 2017). The NEL has 40 items distributed across six subscales: confidence and purpose (CaP), social support (ScS), caring community (CrC), connectedness (Cnn), self-management (S-M), and professional help (PrH). Items are rated using a 5-point Likert-type scale (1 = Completely disagree; 5 = Completely agree). In both samples of the study by Boevink et al. (2017), scores on the NEL showed excellent internal consistency (Cronbach’s α = .94 and .95) and were moderately correlated (rs = .66) with scores on the Empowerment Scale (Rogers et al., 1997).
In order to obtain validity evidence for the Spanish version of the NEL based on relationships with other variables, we administered a series of additional instruments to two subsamples of our 406 participants. Specifically, and in addition to the NEL, a subsample of 148 participants also responded to the Empowerment Scale (ES), while a subsample of 228 participants also completed the Maryland Assessment of Recovery Scale (MARS-12), the Dispositional Hope Scale (DHS) and the Multidimensional Scale of Perceived Social Support (MSPSS). These scales were selected for several reasons. Firstly, they assess recovery (i.e., MARS-12), which includes empowerment as a key element, or evaluate other components of the CHIME framework, such as hope (i.e., DHS) and social support (i.e., MSPSS), expected to correlate with empowerment. Secondly, these constructs— recovery, hope, and social support—have established associations with empowerment in the existing literature (Corrigan et al., 1999; Rogers et al., 2010). Lastly, social support constitutes one of the six dimensions within the NEL itself.
Empowerment Scale (ES) (Rogers et al., 1997, 2010). The ES is a 28-item scale comprising five factors: self-esteem/self-efficacy, power/powerlessness, community activism and autonomy, optimism/control over the future, and righteous anger. Items are rated using a 4-point Likert-type scale (1 = Totally disagree; 4 = Totally agree). Although a number of Spanish translations of the ES have been used in the literature, the scale has yet to be validated in a Spanish-speaking sample. For the present study, therefore, we developed a Spanish adaptation of the ES following the same procedure as used for the NEL and described in the Procedure section. In our sample (n = 148), scores on the ES showed good internal consistency (McDonald's ω = .83; Cronbach’s α = .82).
Maryland Assessment of Recovery Scale (MARS-12) (Drapalski et al., 2012, 2016; Medoff, 2015). The MARS-12 comprises 12 items that measure six components of personal recovery: self-direction/empowerment, holistic, non-linear, strengths-based, responsibility and hope. Items are rated using a 5-point Likert-type scale (1 = Not at all; 5 = Very much). The Spanish version of the MARS-12 has recently been validated, showing good psychometric properties (Balluerka et al., 2024). In our sample (n = 228), scores on this scale exhibited excellent internal consistency (McDonald's ω = .94; Cronbach’s α = .94).
Dispositional Hope Scale (DHS) (Snyder et al., 1991). The DHS is a 12-item scale comprising two domains: pathway and agency. Item responses are given using a 4-point Likert-type scale (1 = Definitely false; 4 = Definitely true). The DHS has been adapted into Spanish, with the authors providing evidence of adequate psychometric properties (Galiana et al., 2015). In our sample (n = 228), scores on the DHS showed excellent internal consistency (McDonald's ω = .91; Cronbach’s α = .91).
Multidimensional Scale of Perceived Social Support (MSPSS) (Zimet et al., 1988, 1990). The MSPSS is a 12-item scale with three factors corresponding to three sources of social support: family, friends and significant others. Items are rated using a 7-point Likert-type scale (1 = Very strongly disagree; 7 = Very strongly agree). This scale has been adapted into Spanish, evidencing good reliability and validity (Ruiz-Jiménez et al., 2017). In our sample (n = 228), scores on the MSPSS exhibited excellent internal consistency (McDonald's ω = .93; Cronbach’s α = .93).
For all the above scales, a total score is calculated by summing the item scores, and in each case, a higher score indicates a higher level of the variable evaluated.
Procedure
The NEL was developed and validated in Dutch, but its authors also report an English version (Boevink et al., 2017). Both languages were used as the basis for our translation. In accordance with International Test Commission guidelines (International Test Commission, 2018), the steps in translating and adapting the NEL were as follows:
-
(1)
We obtained permission from the authors of the NEL to adapt the scale into Spanish.
-
(2)
An official translation service translated the original Dutch version of the NEL into Spanish.
-
(3)
The English version of the NEL was also translated into Spanish by four independent bilingual psychologists using the parallel translation procedure.
-
(4)
All translations were compared to arrive at a consensus version, evaluating whether the instructions, response options and items maintained their original meaning.
-
(5)
A group of users of mental health services, considered experts due to their lived experience, was constituted (seven women and four men, with a mean age of 50.2 years [SD = 7.9, range 37–61]), whose task was to individually assess the clarity (wording and cultural appropriateness) of the instructions, response options and each item of the Spanish NEL. Ratings were given using a 4-point Likert-type scale (1 = Not at all clear; 4 = Perfectly clear). For each item rated below 4, the expert was asked to explain why and offer an alternative wording.
-
(6)
A multidisciplinary committee, including the four bilingual psychologists, members of the research team, and experts by lived experience, reviewed the results and reached a consensus version.
-
(7)
A Spanish language consultancy reviewed and refined the syntax, grammar and terminology of the instructions, response options and items of the Spanish version of the NEL.
-
(8)
An official translation service carried out a blind back-translation of the scale into English.
-
(9)
The first and second authors of the original scale were contacted and asked to rate the agreement between the original and the back-translated versions of the NEL. Ratings were given using a 4-point Likert scale (1 = Item does not capture the conceptual meaning of the original; 4 = Item completely captures the conceptual meaning of the original). Additionally, both authors were invited to include explanatory comments for all ratings below 4.
Participants were recruited through convenience sampling in 17 mental health community rehabilitation services (CRS) across Catalonia, Spain. All users of these services who met the aforementioned inclusion criteria were invited to the study, and 415 of them agreed to participate. They were informed about the study’s objectives by a professional from each CRS along with a research team member. Participation was voluntary and no financial compensation was offered.
Data collection spanned from January 24, 2022, to April 29, 2023. Participants responded to the battery of scales individually, and they were also requested to provide sociodemographic information (i.e., age, gender, diagnosis, marital status, living arrangement, education level, and employment status). This process occurred in the CRS settings, facilitated by a research team member and supported by a professional from each service.
Among the 17 CRS participating in our study, 12 agreed to facilitate a second data collection session for the retest. Subsequently, all individuals from these CRS who completed the initial NEL assessment were invited to participate in the retest, which was scheduled between one and two weeks after their first evaluation. Ultimately, 66 participants consented to and completed the retest.
The research was approved by the Bioethics Committee of the University of Barcelona (CBUB; Institutional Review Board Number: IRB00003099) and was conducted in accordance with the ethical standards of the Helsinki Declaration and its later amendments.
Statistical Analysis
Data distribution at the item level, frequency of responses for each category, and skewness and kurtosis were computed. When the absolute values of skewness were greater than 1, the distribution was considered highly skewed, and when the kurtosis was greater than 3 it was considered high (Bulmer, 1979). The distribution of NEL total scores was examined by calculating the mean and standard deviation and then applying the Shapiro-Wilk normality test. Multivariate normality was assessed using the Mardia test.
To provide validity evidence based on the internal structure of the NEL, we performed a confirmatory factor analysis (CFA) with the weighted least squares mean and variance adjusted (WLSMV) estimator. Two models were assessed: the six first-order factor model reported in the original validation study (Boevink et al., 2017), and a six first-order and one second-order factor model with Empowerment as a general factor. The fit of these models was assessed by calculating the chi-square statistic/degrees of freedom ratio, as well as the comparative fit index (CFI), the Tucker-Lewis index (TLI) and the root mean squared error of approximation (RMSEA). These indices were interpreted as follows: chi-square/degrees of freedom ratio (χ2/df) less than 2, CFI and TLI values ≥ .95 and RMSEA values ≤ .06 indicated excellent fit; χ2/df less than 3, CFI and TLI values ≥ .90 and RMSEA values ≤ .08 indicated acceptable fit (Hu & Bentler, 1999).
The presence of differential item functioning (DIF) by gender in the Spanish version of the NEL was explored using the ordinal logistic regression (OLR) method (Choi et al., 2011). This technique offers a flexible framework for detecting various types of DIF by integrating trait scores based on item response theory and an iterative process using group-specific item parameters. The total DIF effect, uniform DIF, and non-uniform DIF were assessed using a significance level of .05 and McFadden’s R2, following the guidelines of Jodoin and Gierl (2001) for measuring effect size.
Internal consistency was assessed by calculating McDonald’s omega (ω) and Cronbach’s alpha (α) for ordinal variables. These coefficients were interpreted as recommended by Kline (2016), and hence values over .90 were considered excellent, those over .80 as very good and values above .70 as adequate. Temporal stability was assessed by calculating the intraclass correlation coefficient (ICC) and interpreting the results as follows: above .90, excellent; .75 – .89, good; .50 – .74, moderate; and below .49, poor (Koo & Li, 2016). Internal consistency and temporal stability were calculated for both the total NEL score and subscale scores.
Finally, validity evidence based on relationships with other variables was obtained by calculating Spearman correlation coefficients between scores on the Spanish version of the NEL (both total and subscale scores) and total scores on the ES, the MARS-12, the DHS and the MPSS.
Statistical analyses were conducted using R 4.2.2 with the packages psych (Revelle, 2014), lavaan (Rosseel, 2012), likert (Bryer, 2022) and lordif (Choi et al., 2011).
Results
Spanish Adaptation of the NEL
All members of the group of users, considered as experts by lived experience, rated the clarity of the instructions and response options of the NEL as 4 (“Perfectly clear”), and hence no rewording was required. By contrast, six items were rated below 4 by at least one member of the committee and, in these cases, an alternative wording was proposed (see Supplemental Table 1 for more details). Following the committee's proposals, items 29 and 33 were reworded. However, no changes were made to items 6, 20, 26 and 30 because the proposed rewording modified the meaning of the original item. For example, for item 26, "I know what I am good at", the proposed wording in Spanish would have rendered it as "I know that I am a good person". The Spanish language consultancy also suggested minor changes to the wording of five items, all of which were incorporated. Finally, following the review of the back-translated version by the scale's authors, item 10 was modified slightly so as to capture better the tone of the original item, "I know what is good and what is not good for me" (the proposed Spanish version had implied a stronger imperative, "I know what I must do"). The final version of the Spanish NEL is shown in Supplemental Table 2.
Sample Description
The mean age of participants was 47.8 years (SD = 9.8; range 20 – 71). The majority were male (52.5%), single (50.74%) and in receipt of a disability pension (67.24%). The most common living arrangement was with their original family (39.90%), and the most frequent educational level was secondary (43.84%). The main self-reported diagnoses were depression (28.82%), schizophrenia (19.21%) and bipolar disorder (17.98%). For more details on the sociodemographic characteristics of the sample, see Table 1.
Item Analysis
As shown in Fig. 1, nearly one in three responses on the Spanish NEL fell into the Agree category (32.30%), followed by Neither Agree nor Disagree (24.50%) and Agree Strongly (21.63%). Few participants endorsed response options 1 or 2 (Strongly Disagree or Disagree, respectively).
Most items of the Spanish NEL showed a negatively skewed distribution, with items 1, 6, 12, 14, and 16 showing a significant degree of negative skewness. For further details, see Table 2.
According to the Shapiro-Wilk normality test, the distribution of total scores on the Spanish NEL deviated significantly from normality (W = .99, p < .028; M = 138.32, SD = 25.88). The Mardia test for multivariate normality also showed that the data were non-normally distributed (skewness = 24612.35, p < .001; kurtosis = 81.62, p < .001).
Internal Structure
The results of the CFA supported a six first-order factor structure for the Spanish NEL (χ2(725) = 1754.42, p < .001, χ2/df = 2.42, CFI = .943, TLI = .939, RMSEA = .059, CI 90% [.056, .063]). Although the CFA also supported the one-factor second-order model (χ2(734) = 1881.42, p < .001, χ2/df = 2.56, CFI = .937, TLI = .933, RMSEA = .062, CI 90% [.059, .066]), the fit of the six first-order factor model was better. Factor loadings were above .40 for all items and were all significant at p < .001. Correlations between factors ranged from .96 (CaP and S-M) to .47 (CrC and PrH), and they were all significant at p < .001. More details are shown in Fig. 2.
The OLR method detected differential item functioning by gender in four items, namely item 40 of the subscale CaP, items 5 and 17 of the subscale ScS, and item 6 of the subscale PrH. Figure 3 shows that although these items display uniform DIF, the effect size (measured by McFadden’s R2) was less than .035, and hence the DIF was negligible (Jodoin & Gierl, 2001).
Internal Consistency and Temporal Stability
Internal consistency was excellent for the Spanish NEL total score (ω = .98; α = .96) and for scores on two of its subscales: CaP (ω = .95, α = .92) and ScS (ω = .92, α = .91). It was very good for scores on a further two subscales, CrC (ω = .86, α = .88) and Cnn (ω = .81, α = .82), and adequate for the remaining two, S-M (ω = .78, α = .78) and PrH, (ω = .72, α = .78).
Temporal stability was excellent for the Spanish NEL total score (ICCTotal = .86), and for scores on four of its subscales (ICCS-M = .86; ICCCaP = .85; ICCScS = .84; ICCCnn = .83). The exceptions were scores on the PrH and CrC subscales, which showed good (ICCPrH = .75) and moderate (ICCCrC = .72) temporal stability, respectively. Table 3 shows more details regarding internal consistency and temporal stability.
Validity Evidence Based on Relationships with Other Variables
The Spanish NEL total score showed strong positive correlations with the ES, the MARS-12, the DHS, and the MSPSS. The subscales of the Spanish NEL also correlated strongly with scores on scales measuring a similar construct. Specifically, the CaP, S-M and Cnn subscales correlated strongly with the MARS-12, the DHS, and the ES; the ScS subscale was strongly correlated with the MSPSS scores, and the CrC subscale correlated strongly with the ES scores. The PrH subscale showed lower correlations with scores on the other scales. More details are shown in Table 4.
Discussion
This study aimed to develop a Spanish version of the NEL and to conduct a psychometric validation to determine its usefulness for assessing empowerment in Spanish-speaking populations.
The results obtained in the process of translating and culturally adapting the scale support its semantic, linguistic, and conceptual equivalence with respect to the original instrument and provide evidence of content validity for the Spanish version of the NEL. Although the model fit was good for both of the factor structures evaluated (i.e., a six first-order factor model and a six first-order and one second-order factor model), it was better for the six first-order factor model. This suggests that the Spanish NEL maintains the same factor structure as its original Dutch version (Boevink et al., 2017). However, the fact that the one-factor second-order model showed a good fit indicates that the Spanish NEL measures a single underlying construct, namely the level of empowerment. Accordingly, both its total score and the scores corresponding to its six dimensions may be used (Zoun et al., 2019).
The DIF analysis showed the presence of uniform DIF by gender in four items but with a negligible effect. The direction of DIF suggests that men tended to express greater agreement with the items "I am not afraid to rely on myself", and "The people around me accept me", while women expressed greater agreement with the items "I can obtain adequate support when I need it", and "My caregiver takes my abilities as a starting point, not my limitations". Although these results do not point unequivocally to the presence of DIF, they suggest that men and women may show a differential response pattern on these items. In a study examining gender invariance in the measurement of psychological empowerment, Boudrias et al. (2004) concluded that there were a few notable differences. Specifically, items written in the first person and reaffirming a personal dimension of empowerment might be more positive for men, while items that describe more of a social dimension of support could be more positive for women. Whatever the case, this was not a general trend affecting all items of the Spanish NEL, and as already mentioned, the associated effect size was negligible.
As in the original validation study by Boevink et al. (2017), we analysed internal consistency and temporal stability for both the total score and subscale scores of the Spanish NEL. Internal consistency and temporal stability were excellent for the NEL total score, with coefficients slightly higher than in the Dutch sample. The internal consistency and temporal stability of subscale scores on the Spanish NEL ranged from excellent to adequate.
Total scores on the Spanish NEL were strongly correlated with scores on all the other scales administered, which measured empowerment, personal recovery, hope and perceived social support. Importantly, the results provide evidence of convergent validity with the ES (Rogers et al., 1997), an instrument that measures the same construct (empowerment). Furthermore, the correlation between scores on the NEL and the ES was higher in our sample than in Boevink et al. (2017), who reported a moderate coefficient. The total score on the Spanish NEL was also strongly correlated with scores on the MARS-12 (Medoff, 2015), as well as with scores on the DHS (Snyder et al., 1991) and the MSPSS (Zimet et al., 1988), two scales that measure components of the CHIME model (Leamy et al., 2011), namely hope and community. These results support the idea that community, hope, and empowerment are key components of the recovery process, and as such they can be used as variables in assessing recovery-oriented interventions. Finally, as expected, the strongest correlations for NEL subscales were obtained with scales measuring related constructs (i.e., the ES, the MARS-12 and the DHS with CaP, S-M and Cnn, and the MSPSS with ScS). This further supports the validity of scores on the Spanish NEL.
The main limitation of this study stems from the use of convenience sampling, with all participants being users of community mental health services. Accordingly, none of them were in a state of clinical decompensation but they all required professional assistance to promote their autonomy, social functioning and/or community inclusion. This represents a specific profile within the population of users of mental health services. Future research should aim to validate the Spanish version of the NEL in samples of different characteristics. It is also worth noting that, although the proportion of participants who agreed to participate in the retest was small, the sample size was sufficient to evaluate the temporal stability of the NEL scores. Moreover, the present study did not examine the responsiveness of the Spanish-NEL. Subsequent studies are necessary to determine the scale's ability to detect empowerment changes resulting from interventions.
This research also has some strengths. The NEL was translated and adapted into Spanish in strict accordance with international guidelines for test adaptation (International Test Commission, 2018). Furthermore, the psychometric properties of the Spanish version were examined in a relatively large sample of users of mental health services. To our knowledge, this is the first validated scale in Spanish for assessing empowerment. In this respect, our study addresses an important gap in our socio-cultural context, which to date has lacked a valid and reliable instrument for evaluating programs or interventions that claim to promote the empowerment of users of mental health services. Furthermore, the availability of a validated instrument for assessing empowerment in mental health within our cultural context lays the groundwork for future cross-cultural research.
Conclusions
The Spanish version of the NEL yields valid and reliable scores and it may be used to assess empowerment among Spanish-speaking users of mental health services. It is therefore a useful tool for evaluating interventions aimed at promoting empowerment in this population.
Data Availability
The data that support the findings of this study are available from the corresponding author upon reasonable request.
References
Balluerka, N., Gorostiaga, A., Sampietro, H. M., González-Pinto, A., & Aliri, J. (2024). Cross-cultural adaptation and psychometric validation of a Spanish version of the Maryland Assessment of Recovery Scale (MARS-12). PLoS One, 19(2), e0298554. https://doi.org/10.1371/journal.pone.0298554
Barr, P. J., Scholl, I., Bravo, P., Faber, M. J., Elwyn, G., & McAllister, M. (2015). Assessment of patient empowerment: A systematic review of measures. PLoS One, 10(5), 1–24. https://doi.org/10.1371/journal.pone.0126553
Boevink, W., Kroon, H., Delespaul, P., & Van Os, J. (2017). Empowerment according to persons with severe mental illness: Development of the Netherlands Empowerment List and its psychometric properties. Open Journal of Psychiatry, 07(01), 18–30. https://doi.org/10.4236/ojpsych.2017.71002
Boudrias, J. S., Gaudreau, P., & Spence Laschinger, H. K. (2004). Testing the structure of psychological empowerment: Does gender make a difference? Educational and Psychological Measurement, 64(5), 861–877. https://doi.org/10.1177/0013164404264840
Bryer, J. (2022). likert: Analysis and visualization of Likert-based items (version 1.3.5) [R Package]. Retrieved: 15/11/2023 http://github.com/jbryer/likert
Bulmer, M. G. (1979). Principles of statistics. Dover Publications Inc..
Chamberlin, J. (1997). A working definition of empowerment. Psychiatric Rehabilitation Journal, 20(4), 43–46. https://doi.org/10.1163/9789401202831_005
Chamberlin, J., Rogers, J. A., & Sneed, C. S. (1989). Consumers, families, and community support systems. Psychosocial Rehabilitation Journal, 12(3), 93–106. https://doi.org/10.1037/h0099531
Choi, S. W., Gibbons, L. E., & Crane, P. K. (2011). lordif: An R package for detecting differential item functioning using iterative hybrid ordinal logistic regression/item response theory and Monte Carlo simulations. Journal of Statistical Software, 39(8), 1–30. https://doi.org/10.18637/jss.v039.i08
Corrigan, P. W., Faber, D., Rashid, F., & Leary, M. (1999). The construct validity of empowerment among consumers of mental health services. Schizophrenia Research, 38(1), 77–84. https://doi.org/10.1016/S0920-9964(98)00180-7
Cyril, S., Smith, B. J., & Renzaho, A. M. N. (2016). Systematic review of empowerment measures in health promotion. Health Promotion International, 31(4), 809–826. https://doi.org/10.1093/heapro/dav059
Drapalski, A. L., Medoff, D., Dixon, L., & Bellack, A. (2016). The reliability and validity of the Maryland Assessment of Recovery in Serious Mental Illness Scale. Psychiatry Research, 239, 259–264. https://doi.org/10.1016/j.psychres.2016.03.031
Drapalski, A. L., Medoff, D., Unick, G. J., Velligan, D. I., Dixon, L. B., & Bellack, A. S. (2012). Assessing recovery of people with serious mental illness: Development of a new scale. Psychiatric Services, 63(1), 48–53. https://doi.org/10.1176/appi.ps.201100109
Galiana, L., Oliver, A., Sancho, P., & Tomás, J. M. (2015). Dimensionality and validation of the Dispositional Hope Scale in a Spanish sample. Social Indicators Research, 120(1), 297–308. https://doi.org/10.1007/s11205-014-0582-1
Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modelling, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
International Test Commission. (2018). ITC Guidelines for translating and adapting tests (Second Edition). International Journal of Testing, 18(2), 101–134. https://doi.org/10.1080/15305058.2017.1398166
Jodoin, M. G., & Gierl, M. J. (2001). Evaluating Type I error and power rates using an effect size measure with the logistic regression procedure for DIF detection. Applied Measurement in Education, 14(4), 329–349. https://doi.org/10.1207/S15324818AME1404_2
Kline, R. B. (2016). Principles and practice of structural equation modeling (4th ed.). The Guilford Press.
Koo, T. K., & Li, M. Y. (2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155–163. https://doi.org/10.1016/j.jcm.2016.02.012
Leamy, M., Bird, V., Le Boutillier, C., Williams, J., & Slade, M. (2011). Conceptual framework for personal recovery in mental health: Systematic review and narrative synthesis. British Journal of Psychiatry, 199(6), 445–452. https://doi.org/10.1192/bjp.bp.110.083733
López, J. E., Orrell, M., Morgan, L., & Warner, J. (2010). Empowerment in older psychiatric inpatients: Development of the Empowerment Questionnaire for Inpatients (EQuIP). American Journal of Geriatric Psychiatry, 18(1), 21–32. https://doi.org/10.1097/JGP.0b013e3181b2090b
Medoff, D. (2015). Maryland Assessment of Recovery Scale — MARS-12. (Unpublished Research). Optum. Retrieved: 29/10/2021. https://www.providerexpress.com/content/dam/ope-provexpr/us/pdfs/clinResourcesMain/rrToolkit/rrMARS.pdf
Mokkink, L. B., Terwee, C. B., Patrick, D. L., Alonso, J., Stratford, P. W., Knol, D. L., Bouter, L. M., & de Vet, H. C. W. (2010). The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. Journal of Clinical Epidemiology, 63(7), 737–745. https://doi.org/10.1016/j.jclinepi.2010.02.006
Oades, L. G., Hons, B. A., Law, J., & Marshall, S. L. (2011). Development of a consumer-constructed scale to evaluate mental health service provision. Journal of Evaluation in Clinical Practice, 17(6), 1102–1107. https://doi.org/10.1111/j.1365-2753.2010.01474.x
Pekonen, A., Eloranta, S., Stolt, M., Virolainen, P., & Leino-Kilpi, H. (2020). Measuring patient empowerment: A systematic review. Patient Education and Counselling, 103(4), 777–787. https://doi.org/10.1016/j.pec.2019.10.019
Rappaport, J. (1981). In praise of paradox: A social policy of empowerment over prevention. American Journal of Community Psychology, 9(l), 1–25. https://doi.org/10.1007/BF00896357
Revelle, W. R. (2014). Psych: Procedures for personality and psychological research (R package version 1.4.2). Northwestern University. Retrieved: 15/11/2023. http://cran.r-project.org/web/packages/psych/
Rogers, E. S., Ralph, R. O., & Salzer, M. S. (2010). Validating the Empowerment Scale with a multisite sample of consumers of mental health services. Psychiatric Services, 61(9), 933–936. https://doi.org/10.1176/appi.ps.61.9.933
Rogers, S., Chamberlin, J., Ellison, M., & Crean, T. (1997). A consumer-constructed scale to measure empowerment among users of mental health services. Psychiatric Services, 48(8), 1042–1047.
Rosseel, Y. (2012). lavaan: An R package for structural equation modelling and more. Version 0.5-12 (BETA). Retrieved: 15/11/2023. http://cran.r-project.org/
Ruiz-Jiménez, M. T., Saiz Galdós, J., Montero Arredondo, M. T., & Navarro Bayond, D. (2017). Adaptación de la Escala Multidimensional de Apoyo Social Percibido en población con trastorno mental grave [Adaptation of the Multidimensional Scale of Perceived Social Support in a sample of people with severe mental disorder]. Revista de la Asociación Española de Neuropsiquiatría, 37(132), 415–437. https://doi.org/10.4321/s0211-57352017000200006
Segal, S. P., Silverman, C., & Temkin, T. (1995). Measuring empowerment in client-run self-help agencies. Community Mental Health Journal, 31(3), 215–227. https://doi.org/10.1007/BF02188748
Snyder, C. R., Harris, C., Anderson, J. R., Holleran, S. A., Irving, L. M., Sigmon, S. T., Yoshinobu, L., Gibb, J., Langelle, C., & Harney, P. (1991). The will and the ways: Development and validation of an individual-differences measure of hope. Journal of Personality and Social Psychology, 60(4), 570–585. https://doi.org/10.1037//0022-3514.60.4.570
Svedberg, P., Svensson, B., & Arvidsson, B. (2007). The construct validity of a self-report questionnaire focusing on health promotion interventions in mental health services. Journal of Psychiatric and Mental Health Nursing, 14(6), 566–572. https://doi.org/10.1111/j.1365-2850.2007.01129.x
Tjaden, C., Mulder, C. L., den Hollander, W., Castelein, S., Delespaul, P., Keet, R., VanWeeghel, J., & Kroon, H. (2021). Effectiveness of resource groups for improving empowerment, quality of life, and functioning of people with severe mental illness: A randomized clinical trial. JAMA Psychiatry, 78(12), 1309–1318. https://doi.org/10.1001/jamapsychiatry.2021.2880
Vogel, J. S., Bruins, J., De Jong, S., Van Der Gaag, M., Halbersma, L., Lieben, R. J., & Castelein, S. (2020). Measuring personal recovery in people with a psychotic disorder based on CHIME: A comparison of three validated measures. International Journal of Mental Health Nursing, 29, 808–819. https://doi.org/10.1111/inm.12711
Wallerstein, N. (2006). What is the evidence on effectiveness of empowerment to improve health (Health Evidence Network report). World Health Organization – Regional Office for Europe. Retrieved: 16/10/2023. http://www.euro.who.int/Document/E88086.pdf
World Health Organization. (2013). Mental Health Action Plan 2013-2020. World Health Organization. Retrieved: 17/10/2023. https://www.who.int/publications/i/item/9789241506021
World Health Organization. (2021). Guidance on community mental health services: Promoting person-centred and rights-based approaches. World Health Organization. Retrieved: 16/10/2023. https://www.who.int/publications/i/item/9789240025707
World Health Organization – Regional Office for Europe. (2005). Mental health: Facing the challenges, building solutions. Report from the WHO European Ministerial Conference. WHO – Regional Office for Europe. Retrieved: 17/10/2023. https://apps.who.int/iris/handle/10665/326566
Zimet, G., Dahlem, N., Zimet, S., & Farley, G. (1988). The Multidimensional Scale of Perceived Social Support. Journal of Personality Assessment, 52(1), 30–41. https://doi.org/10.1207/s15327752jpa5201_2
Zimet, G. D., Powell, S. S., Farley, G. K., Werkman, S., & Berkoff, K. A. (1990). Psychometric characteristics of the Multidimensional Scale of Perceived Social Support. Journal of Personality Assessment, 55(3–4), 610–617. https://doi.org/10.1080/00223891.1990.9674095
Zoun, M. H. H., Koekkoek, B., Sinnema, H., Van Der Feltz-cornelis, C. M., Van Balkom, A. J. L. M., Schene, A. H., Smit, F., & Spijker, J. (2019). Effectiveness of a self-management training for patients with chronic and treatment resistant anxiety or depressive disorders on quality of life, symptoms, and empowerment: Results of a randomized controlled trial. BMC Psychiatry, 19(46), 1–16. https://doi.org/10.1186/s12888-019-2013-y
Acknowledgements
This study was possible thanks to the collaboration of the following institutions: Benito Menni – CASM; Fundació Althaia; Gestió de Serveis Sanitaris – Lleida; Grup CHM Salut Mental; Grup Pere Mata; Parc de Salut MAR; Parc Sanitari Sant Joan de Déu. We also acknowledge the following community mental health professionals who helped collect the data: Marc Garcés, Ignaci García, Miriam Atienza, Lucía Martínez, Sergio Guzmán, Carme Sarret, Anna Bové, Fàtima Blanch, Ana Aznar, Gemma Cuberas, María José Esquerrè, Raquel Rubio, Sonia Valero, Ana Muñoz, Júlia Grau, and Eva Cardona. Laura Sicilia assisted with the translation and adaptation process.
Funding
Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This study was supported by the Spanish Ministry of Science and Innovation – MCIN/AEI/10.13039/501100011033 [grant PID2019-109887GB-I00], and the Agency for the Management of University and Research Grants of the Government of Catalonia [grant 2021SGR01071].
Author information
Authors and Affiliations
Contributions
Conceptualization, H.M.S., G.G., M.B., J.E.R., and J.G-B.; methodology, H.M.S., G.G., A.I.B., M.B., and J.G-B.; data recruitment, H.M.S.; software, H.M.S., G.G., A.I.B., and M.B.; validation, G.G., M.B., J.E.R., W.B., H.K. and J.G-B.; formal analysis, H.M.S., G.G., A.I.B, M.B., J.E.R., and J.G-B.; data curation, H.M.S., G.G., A.I.B, M.B., and J.G-B.; writing—original draft preparation, H.M.S., G.G., A.I.B, M.B., and J.G-B.; writing—review and editing, H.M.S., G.G., A.I.B., M.B., J.E.R., W.B., H.K. and J.G-B.; supervision, G.G., M.B., J.E.R., W.B., H.K., and J.G-B; project administration, J.G.-B., G.G., and M.B; funding acquisition, J.G.-B., G.G., and M.B. All authors have read and agreed to the published version of the manuscript.
Corresponding author
Ethics declarations
Informed Consent
All procedures followed were in accordance with the ethical standards of the responsible committee on human experimentation (institutional and national) and with the Helsinki Declaration of 1975, as revised in 2000. Informed consent was obtained from all patients included in the study.
Conflict of Interest
The authors declare no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
ESM 1
(DOCX 37 kb)
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Sampietro, H.M., Guilera, G., Berrío, Á.I. et al. Spanish Version of the Netherlands Empowerment List: Adaptation, Psychometric Validation, and Gender Differential Item Functioning Analysis. Int J Ment Health Addiction (2024). https://doi.org/10.1007/s11469-024-01321-0
Accepted:
Published:
DOI: https://doi.org/10.1007/s11469-024-01321-0