Abstract
The Depression Anxiety and Stress Scale (DASS-21) is a self-report screening tool of psychological symptoms used in many countries and translated in different languages. The DASS-21 was translated into Ilokano, one of the major languages in the Philippines spoken by over 9 million people all over the world. The translation process involved independent translations by multilingual clinical psychologists, reviews by two multilingual mental health professionals, and pilot testing. The translation was then validated in a study with 668 Ilokano speakers mainly from three regions of the Philippines where Ilokano was a native language or a lingua franca. A confirmatory factor analysis indicated a good fit of the three-factor model compared to a one-factor model. The three subscales showed good internal consistency were also positively correlated with other measures of depression, anxiety, and negative affect, and negatively correlated with measures of positive affect and flourishing. Using a stringent test of criterion validity, the results also show that DASS-Depression was more strongly correlated with a criterion measure of depression, compared to with measures of anxiety and negative affect, and that DASS-Anxiety was more strongly correlated with a criterion measure of anxiety compare to a measure of negative affect. The results provide good initial evidence for the validity and viability of the DASS-21 in Ilokano, which should be a useful tool in mental health programs in parts of the Philippine community, particularly in identifying individuals who may need attention of mental health professionals.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
The increase in anxiety and depressions across different countries is an ongoing global concern, and the COVID-19 pandemic has intensified this concern (Vahratian et al., 2021). The prevalence of depression has increased threefold in some countries during the COVID-19 pandemic (Ettman et al., 2020). In the Philippines, various studies recorded increased rates of symptoms of anxiety and depression during the COVID-19 pandemic (Mendoza et al., 2021; Tee et al., 2020); the increase being attributed to risk factors such as exposure to the virus, loss of income, among others (Galanza et al., 2021). In this regard, the availability of valid psychological instruments for screening symptoms anxiety and depression, which can be used in different populations is important for identifying individuals who may need attention of mental health professionals. There are some self-report screening tools that are currently available and the analysis of the psychometric properties and validity of such tools make them suitable for use in non-clinical settings (e.g., schools, community health centers, and workplaces) and also in research (Gilbody et al., 2001). The translation and validation of such screening tools in different languages is essential in efforts to address the rising mental health concerns in all parts of the world (Kirmayer & Swartz, 2013). One screening tool that has been validated and translated into different languages is the Depression, Anxiety, and Stress Scale (Lovibond & Lovibond, 1995). In this study, we translated the scale into Ilokano, a language spoken by over 9 million persons in the Philippines. We provided initial validation for the Ilocano translation by studying the scale’s structural validity, internal consistency, and criterion validity of its subscales.
Depression, Anxiety and Stress Scale (DASS-21)
Lovibond and Lovibond (1995) developed the Depression, Anxiety and Stress Scale (DASS-21), which measures negative emotional states, particularly depression (DASS-D), anxiety (DASS-A) and stress or tension (DASS-S); it is the short form of the original 42-item measure that improved the administration time from the original. The DASS-21 has been widely used in clinical samples to screen for symptoms related to these constructs (Lovibond & Lovibond, 1995). It is considered more suitable for screening in clinical care (Henry & Crawford, 2005) and for evaluating improvement in treatment outcomes in psychiatric hospitals (Ng et al., 2007). Given its usefulness in clinical samples, the DASS-21 likewise provides insight into developing symptoms of distress in non-clinical samples.
The DASS-21 subscales are assumed to measure the important components of the tripartite model for distinguishing depression from anxiety (Clark & Watson, 1991): low positive affectivity (DASS-Depression), physiological hyperarousal (DASS-Anxiety), and negative affectivity (DASS-Stress) (Brown et al., 1997). Note that other researchers have suggested the DASS-Stress does not assess negative affectivity, but a stress component that is related to negative affectivity (Clara et al., 2001; Henry & Crawford, 2005), however, these suggestions still support a three-factor structure for the DASS-21.
DASS-21: Factor Structure and Translations
There has been much empirical support for the three-factor structure of the DASS-21 among English-speaking samples from North America and the UK (Crawford et al., 2009; Norton, 2007; Sinclair et al., 2012). The three-factor structure has also been validated in numerous translations of the DASS-21, including translations in Turkish (Yildirim et al., 2018), Chinese (Chan & Bernardo, 2017), Bahasa Malay (Musa et al., 2007), Persian (Ashgari et al., 2008), and Australian, Chinese, Chilean and Malaysian (Mellor et al., 2015), among others. Other studies (Henry & Crawford, 2005, using the English DASS-21; Alfonsson et al., 2017, using the Swedish DASS-21; Lee & Kim, 2020, using the Korean DASS-21; Ruiz, et al., 2017, using the Spanish DASS-21) have found support for a bifactor (also referred to as a quadripartite) model, where, in addition to the three factors, there is a general distress factor that is indicated by all the items in the scale. But these translations also demonstrated good fit with the original three-factor model. In other translations, some items were dropped because of difficulties in translating particular items. For example, translations of the DASS for Indonesia, Malaysia, Singapore, Sri Lanka, Thailand and Taiwan were all found to support the three-factor model, but after removing items that included words and phrases that were difficult to translate into the different local languages (e.g., “used a lot of nervous energy”) (Oei et al., 2013).
DASS-21 translations also show good internal psychometric properties beyond the structural validity of the three-factor model. The DASS-21 Korean translation showed good internal consistency and measurement consistency over a one-week interval (Deokhoon et al., 2018). The Chinese version showed evidence of convergent and divergent validity using other established measures: Patient Health Questionnaire (PHQ-9), Generalized Anxiety Disorder (GAD-7) and the Positive and Negative Affect Schedule (Chan & Bernardo, 2017). The Turkish version showed good convergent validity with the Beck Depression Inventory, Beck Anxiety Inventory, Dissociative Experiences Scale, Somatoform Dissociation Questionnaire, and Toronto Alexithymia Scale (Yildirim et al., 2018).
DASS-21 translations also predicted non-clinical related factors. For example, DASS-21 scales were positively correlated with occupational stress in Korean employees with white-collar jobs, (Park et al., 2008) and Malaysian employees (Edimansyah et al., 2007). The DASS-21 subscales were also strongly associated with perceived stress in Chinese individuals living with HIV/AIDS (Su et al., 2008), disordered eating in Malaysian university students (Gan et al., 2008), and impaired sleep quality in pregnant women (Reshedat et al., 2018). The DASS Korean subscales were also negatively associated with the level of life satisfaction (Deokhoon et al., 2018). Thus, valid translations of the DASS-21 should also be significantly associated with relevant criterion variables.
We note, however, that there are some studies that do not find support for DASS-21’s three-factor structure. For example, there is evidence for a two-factor model, where the stress and anxiety items are incorporated into only one factor. Evidence for the two-factor model come from studies that used the original English DASS-21 (Duffy et al., 2005; Osman et al., 2012; Shea et al., 2009; Tully et al., 2009; Willemsen et al., 2011), the Italian (Bottesi et al., 2015) and the Spanish DASS-21 (Daza et al., 2002). Thus, it is necessary to validate the three-factor model of the DASS-21 in any translation of the scale, instead of just assuming that translations have a valid three-factor structure.
The Current Study
The DASS-21 has not been translated into Philippine languages; instead, the English version has been used in studies that involve educated Filipino samples (e.g., Montano & Acebes, 2020; Tee et al., 2020). Educated Filipinos tend to be at least bilingual, with English as their second language (Bernardo, 2007), and the assumption seems to be that using English language psychological tools would be valid for these Filipinos. While this assumption has found support in the case of some psychological scales (e.g., Ganotice et al., 2013; Nalipay et al., 2019; Simon, 2020), this is not always the case as the factor structure of some English language scales are not validated among educated Filipino samples (e.g., Bernardo, 2008; Datu et al., 2016). The validity of English language scales has been difficult to establish with less academically proficient samples who may not be fluent in English (Zhang & Bernardo, 2000). Thus, the validity of scales like the DASS-21 among Filipinos cannot be assumed.
In the present study, we translated DASS-21 into Ilokano, the third most widely spoken language in the Philippines (Eberhard et al., 2020). Ilokano is used as the first language by more than 6 million individuals based on a 2010 census and is also the lingua franca of more than 9 million people in Northern Philippines (Rubino, 2000). It is the most widely spoken language in the provinces in the Ilocos Region and the Cordillera Region, and is a language used in legal documents and proceedings of various people in these regions in the northern Philippines. Though originally confined to the provinces of Ilocos Norte, Ilocos Sur, and La Union (all in the Ilocos Region), the Ilokano people, being migratory, brought along the language as they now predominate in other provinces in the Ilocos Region (Pangasinan, Tarlac), in the Cordillera Regions (Abra, Benguet). Ilokano is also widely spoken as a second language in provinces in the Cagayan Valley Region, and is spoken by many Ilokano migrants in the southern regions in the Philippines. Moreover, because of the Filipino diaspora, Ilokano is now spoken in sizable Filipino migrant communities in Brunei, Singapore, Hong Kong, Saudi Arabia, Kuwait and in the USA (Rubino, 2000). The 2015 census estimated 85,800 Ilokano speakers in the USA, while the 2016 census estimated 25,300 Ilokano speakers in Canada. Given the widespread use of the language within the Philippines and other Filipino communities in different countries, translating and validating an Ilokano version of the DASS-21 is a useful undertaking, as the translated tool could help screen common psychological symptoms among Ilokano speakers.
In this manuscript, we first describe the processes undertaken to develop an Ilokano translation of the DASS-21. Then we report the results of our initial validation of the translation. While there is a preponderance of evidence supporting the three-factor structure and the criterion validity of the DASS-21 translations, we noted that there are cases when there was no evidence for three-factor structure in some translations (e.g., Bottesi et al., 2015; Daza et al., 2002). Thus, our first aim was to test the three-factor structure of the translated test (Lovibond & Lovibond, 1995) using a sample of Ilokano-speaking Filipinos, and to establish the internal consistency of the three subscales of the translation. We also sought to establish some evidence for the criterion validity of the translation by looking at the scales’ associations with the Patient Health Questionnaire (PHQ-9), General Anxiety scale (GAD-7), Scale of Positive and Negative Emotions (SPANE) and the Flourishing Scale (FS).
Method
Development of the Ilokano Translation
There were three main phases in the development of the Ilokano translation of the DASS-21: (a) independent initial translations, (b) independent review/audit, and (c) pilot testing with interviews. As noted earlier, Ilokano is spoken in several provinces in Ilocos Region, Cordillera Region, and Cagayan Valley Region in northern Philippines and other parts of the country, as well. As such, there are some differences in the versions of the Ilokano language spoken across the regions. In consideration of these variations, we sought to involve Ilokano speakers from different regions of the country in the different phases of the translation process and we note this in the subsections below.
The first phase involved two multilingual researchers who are proficient in Ilokano, Filipino and English, and who are trained clinical psychologists with extensive experience in psychological assessment. Both grew up in the largest city in the Cordillera Region and thus spoke the same variant of Ilokano. The two researchers first independently translated the English items into Ilokano with the goal of capturing the meaning of the psychological symptoms represented in each of the items. The goal was not necessarily to develop literal Ilokano translation of the English statements. After the researchers completed their translations independently, they met to review and form a consensus on the initial Ilocano translation for the items in all the scales. While there were some differences in the specific terms and phrasings proposed by the two researchers, these were minor variations, and it was easy to form a consensus on the initial translation. In their deliberations, the two researchers noted some difficulties in translating particular English phrases that involved idioms and metaphors in the English language (e.g., to wind down, downhearted and blue, nervous energy). But they found and agreed on appropriate idioms and phrases in Ilokano as appropriate translations for such terms.
The second phase of the translation process involved two consultants who were sought to review and audit the initial translation. Both consultants are also multilingual speakers of Ilokano, Filipino, and English, and are also trained psychology professionals with graduate degrees in psychology and experience in psychological assessment and psychological interventions. One of the consultants was from the Cordillera Region and the other was from the Ilocos Region. The two consultants were shown the Ilokano translation and the original English items, and were tasked to provide feedback on whether the Ilokano translations were equivalent to the original English items. They were also asked to comment on whether the specific words and phrases in the Ilokano translation could be understood by Ilokano speakers of different variants or dialects of Ilokano from their region, and by individuals of different educational attainment. Based on the consultants’ suggestions, a few changes were made to revise and improve the translations by the original translators.
The third phase of the translation process was a pilot administration of the revised Ilokano translation. Ten university students who were fluent in Ilokano and English were recruited to participate in individual interviews; the students were recruited specifically so that they come from different provinces in Northern Philippines that made use of the Ilocano language. Four of the students came from the Cordillera Region, three from the Ilocos Region and the remaining three from the Cagayan Valley Region. All ten students were first informed about the nature of the research study and were assured complete confidentiality about their responses. They were told that they could withdraw from the study at any time without any consequence. After sharing this background information, all students provided their informed consent to participate in the pilot study, which involved individual interviews. During the interview, the students were asked to answer the Ilokano version of the DASS-21, followed by the original English version. They were then asked about whether they found the Ilokano items comprehensible, and whether they thought the Ilokano and English items were equivalent. They were also asked to share any other comments they had about the translated scale. After obtaining feedback from the pilot study, the original two translators met to finalize the translations and made a few minor changes.
Validation of the Ilokano Translation
Participants and Procedures
Ilokano-speaking adults were recruited through various online platforms. An invitation in the Ilokano language briefly explained the purpose of the study and provided a link to an online survey. A total of 700 individuals responded to the invitation and provided their informed consent to participate in the study. We excluded data from participants who were younger than 18 years old, those who answered the survey twice, and those who had incomplete responses. The final sample was 668 Ilokano-speaking adults (76.20% were women and 23.80% were men), with the average age of 23.6 years (SD = 7.64). To help ensure that the participants are representative of the different Ilocano-speaking regions and provinces in the Philippines, they were recruited by sharing the survey link to key persons in universities in the three regions where individuals predominantly speak or use the Ilokano language. In the final sample, 274 (41%) participants came from the Cordillera Region, 260 (39%) from the Ilocos Region, 119 (18%) from the Cagayan Valley Region, and the remaining 15 (2%) participants came from other regions in the Philippines.
Participants were given debriefing information after they completed the survey. As some of the survey items pertained to concepts depicting psychological distress, the participants were given information about agencies, professionals and other resources that could address concerns that the participants were currently experiencing or may have been elicited by answering the survey form. The participants were then given the option to obtain a summary of the results from the different tests. Those who chose this option were given a general description of what symptoms they reported, with some suggestions of how they might cope with such symptoms. Participants who reported severe or extremely severe levels in any of the subscales were encouraged to contact mental health professionals and contact information of different centers were provided. Finally, participants were also given the option to join a raffle, where some participants were randomly picked to receive free load in their mobile phones.
Measures
Depression, Anxiety and Stress Scale-Ilokano (DASS-21-Ilokano) The DASS-21 Ilokano was the translation of the original scale designed to measure emotional distress in three subcategories (Lovibond & Lovibond, 1995) of depression, anxiety, and stress, with seven items for each category. Each item described a symptom and participants were asked to self-report whether each of the items (in the form of statements) applied to them over the past week, using a scale from 0 (did not apply to me at all) to 3 (applied to me very much or most of the time). For each subscale, the responses were summed and multiplied by two, and the higher scores indicated more severe levels of emotional distress.
Patient Health Questionnaire (PHQ-9) The PHQ-9 is the 9-item depression module of the full Patient Health Questionnaire (Kroenke et al., 2001), which originally measured eight diagnoses based on the Diagnostic and Statistical Manual, Fourth Edition (DSM-IV), including major depressive disorder, panic disorder, other anxiety disorder, bulimia nervosa, other depressive disorder, probable alcohol abuse/dependence, somatoform and binge eating disorder. The current PHQ-9 version is a self-administered questionnaire consisting of nine items that scores the 9 DSM-IV criteria for major depressive disorder in a scale from 0 (not at all) to 3 (nearly every day); total scores range from 0 to 27. An Ilokano translation of the scale was used, which had an internal consistency of Cronbach’s α = 0.93 computed from the current sample.
General Anxiety Scale (GAD-7) The GAD-7 (Spitzer et al., 2006) is a 7-item scale that screens for generalized anxiety disorder and assesses its severity in clinical practice, based on the DSM-IV. The items of the test are measured using a scale from 0 (not at all) to 3 (nearly every day); the total scores range from 0 to 21. An Ilokano translation of the scale was used, which had a Cronbach’s α = 0.91 computed from the current sample.
Scale of Positive and Negative Experience (SPANE) This SPANE (Diener et al., 2009) is a 12-item scale, with six items pertaining to positive experiences and six items to negative experiences. It assesses the full range of positive and negative experiences, including specific feelings that may have unique labels in particular cultures. It also reflects other states such as interest, flow, positive engagement, and physical pleasure. Each item is scored on a scale from 1 (very rarely or never) to 5 (very often or always). The positive and negative scales are scored separately because of the separability of the two types of feelings. The scores on both the positive scale (SPANE-P) negative scale (SPANE-N) can range from 6 to 30. The Cronbach’s α for SPANE-P and SPANE-N were 0.83 and 0.84, respectively.
Flourishing Scale (FS) The FS (Diener et al., 2009) is an 8-item summary measure of self-perceived success in important areas such as relationships, self-esteem, purpose, and optimism; it provides a single psychological well-being score. Items, which are phrased in a positive direction, are answered on a scale from 1 (strongly disagree) to 7 (strongly agree). Scores range from 8 to 56, and higher scores signify a higher view of the self in positive areas of functioning. The items were translated into Ilokano, and the computed Cronbach’s α = 0.94.
Results
Structural Validity of the DASS-21-Ilokano
To test the structural validity of the Ilokano translation of the DASS-21, we conducted confirmatory factor analysis using Statistical Package for the Social Sciences -Analysis of a Moment Structures (SPSS AMOS, v. 26). We tested three models: (a) a one-factor model where all 21 items indicated one general distress factor, (b) the three-factor model proposed by Lovibond and Lovibond (1995), with three factors correlated with each other, and (c) the same three-factor model, but with correlated errors suggested by the modification indexes. We hypothesized that two three-factor models would have better fit with the data than the one-factor model. Multiple indices were used to assess model fit: Comparative Fit Index (CFI > 0.90) (Bentler, 1990), the Tucker–Lewis Index (TLI > 0.90) (Tucker & Lewis, 1973), root mean square of approximation (RMSEA < 0.08) (Steiger, 2000), and Chi-square statistics (χ2/df < 5.0) (Bentler & Chou, 1987); the coefficients were also examined to check whether they were significant indicators of the hypothesized factor.
Table 1 summarizes the fit statistics for the three models, and the standardized coefficients for each of the 21 items for each model are shown in Table 2. The one-factor model showed poor fit; although many items significantly indicated the one factor, a few were not significant. The hypothesized three-factor models both had adequate fit, and all the standardized coefficients were higher than those in the one-factor model, and more importantly, they significantly indicated their hypothesized factors. However, the third model (with correlated errors) showed the best set of fit indexes. Figure 1 summarizes the coefficients and covariances among the different subscales for the third model.
Internal Consistency of DASS-21-Ilokano Subscales
Having established the three-factor structure of the Ilokano translation of DASS-21, we then proceeded to examine the internal consistency of the subscales. All subscales had good internal consistency: DASS-Depression, α = 0.88, for DASS-Anxiety, α = 0.86, and for DASS-Stress, α = 0.87.
Criterion Validity of the DASS-21 Ilokano
We attempted to establish some initiation criterion validity of the Ilokano translation of DASS-21 by examining correlations of the subscales with different related scales. For this purpose it is worth considering some descriptive statistics of the three subscales. As summarized in Table 3, the means are generally low, but the scores represent the full range of possible scores, which was important for examining the correlations. The correlations are summarized in Table 4, and all the correlations are significant and in the expected direction. That is, the DASS subscales were all positively correlated with PHQ-9, GAD-7, and the negative subscale of SPANE, and negatively correlated with FS and the positive subscale of SPANE.
We undertook further tests to see whether the DASS-21-Ilokano subscales correlated differently with the criterion variables. That is, DASS-Depression should be more strongly correlated with the other measure of depression symptoms (PHQ-9) and DASS-Anxiety should be more strongly correlated with the other measure of generalized anxiety symptoms (GAD-7) compared to all other correlations. This is a stringent test because variables that relate to anxiety are also known to relate to depression. For these tests, we used a software (Lee & Preacher, 2013, using the equations of Steiger, 1980) to compute the z-score to test the difference between two dependent correlations with one variable in common.
First, DASS-Depression should be more strongly correlated with PHQ-9 than with GAD-7 and SPANE-N. This is because DASS-Depression and PHQ-9 are both screening for depression symptoms, while the GAD-7 and SPANE-N are measuring anxiety and negative affect, respectively. The results are consistent with this expectation. The correlation between DASS-Depression and PHQ-9 stronger compared to DASS-Depression’s correlation with GAD-7 [0.74 vs. 0.69; z = 1.89, p = 0.029, one-tailed test] and to DASS-Depression’s correlation with SPANE-N [0.74 vs. 0.61; z = 4.27, p < 0.001, one-tailed test]. We further assume that DASS-Depression’s correlation with PHQ-9 would be stronger compared to its negative correlations with SPANE-P [0.74 vs. − 0.38; z = 9.52, p < 0.001, one-tailed test] and with FS [0.74 vs. − 0.50; z = 6.94, p < 0.001, one-tailed test], and these were all verified by the analysis.
Second, DASS-Anxiety should be more strongly correlated with GAD-7, than with PHQ-9 and SPANE-N. Again, this is because DASS-Anxiety and GAD-7 are both screening for anxiety symptoms, whereas PHQ-9 and SPANE-N are screening for depression symptoms and negative affect. The correction between DASS-Anxiety and GAD-7 was higher compared to DASS-Anxiety’s correlation with SPANE-N [0.74 vs. 0.59; z = 4.79, p < 0.001, one-tailed test], but not to DASS-Anxiety’s correlation with PHQ-9 [0.74 vs. 0.71; z = 119, p = 0.117, one-tailed test]. The latter result suggests that DASS-Anxiety subscale scores seem to be equally correlated with other measures of both anxiety and depression. But also, as expected, DASS-Anxiety’s correlation with GAD-7 was stronger compared to its negative correlation with SPANE-P [0.74 vs. − 0.29; z = 11.36, p < 0.001, one-tailed test] and with FS [0.74 vs. − 0.41; z = 8.89, p < 0.001, one-tailed test].
Finally, the DASS-Stress scale is supposed to measure stress and tension symptoms associated with generalized anxiety (Brown et al., 1997; Lovibond & Lovibond, 1995) and as such is expected to be more strongly related to GAD-7 and less so with PHQ-9 and SPANE-N. The analyses support these propositions. DASS-Stress’ correlations with GAD-7 was statistically higher than its correlation with PHQ [0.79 vs. 0.73; z = 3.02, p = 0.001, one-tailed test] and with SPANE-N [0.79 vs. 0.65; z = 5.56, p < 0.001, one-tailed test]. And as expected, DASS-Stress’ correlation with GAD-7 was stronger compared to its negative correlation with SPANE-P [0.79 vs. -0.27; z = 13.86, p < 0.001, one-tailed test] and with FS [0.79 vs. − 0.38; z = 11.63, p < 0.001, one-tailed test].
Overall, the above results provide evidence for the criterion validity of the DASS-21 Ilokano version. The three DASS subscales are positive correlated with other measures of psychological symptoms and negative affect and are negatively correlated with measures of positive affect and flourishing. Generally, the subscales also correlate more strongly with other scales that measure the same set of symptoms, except for the DASS-Anxiety subscale being equally strongly correlated with measures of anxiety and depression.
Discussion
We developed an Ilokano translation of the DASS-21 following a careful multistage process that involved various bilingual and multilingual Ilokano speakers in vetting the translated items. In the main study, we validated the three-factor model (Lovibond & Lovibond, 1995) of the DASS-21 Ilokano version of the DASS-21 and confirmatory factor analysis revealed indicated a good fit between the data from the Ilokano version and the hypothesized three-factor model compared to a one-factor model. The three subscales representing the three factors also showed good internal consistency. These results are consistent with findings of other DASS-21 translations (e.g., Ashgari et al., 2008; Mellor et al., 2015; Musa et al., 2007; Yildirim et al., 2018).
We provided further evidence for the validity of the scale by showing that the DASS-Depression, DASS-Anxiety and DASS-Stress subscales positively correlated with validated tests that measured depression and anxiety similar to previous studies (e.g., Alfonsson et al., 2017; Chan & Bernardo, 2017; Deokhoon et al., 2018; Lee & Kim, 2020; Sinclair et al., 2012). The subscales also had moderate positive correlations with tests that measure negative affect, similar to other studies (Henry & Crawford, 2005; Oei et al., 2013). The findings also converged with previous studies (Deokhoon et al., 2018; Henry & Crawford, 2005; Kyriazos et al., 2018) that indicated weak to moderate negative correlations with tests that measure positive affect, flourishing and other indicators of positive well-being. Moreover, using a stringent test, DASS-Depression was more strongly associated with another depression measure compared to anxiety and negative affect measures, and DASS-Anxiety was more strongly associated with another measured of anxiety compared to a negative affect measure. These results find further evidence for the criterion validity of the DASS-21 Ilokano version.
As we noted in the Introduction, the DASS-21 has been validated in many other languages; as such, some might think that this translation and validation does not contribute much to the global research literature. However, to our knowledge, the only previously validated translations of DASS-21 into Austronesian languages involved translations into Bahasa Malay and Bahasa Indonesia (Musa et al., 2007; Oei et al., 2013), and this is the first attempt to translate the scale in Ilokano, an Austronesian language spoken by over 9 million in the Philippines and in diasporic Filipino communities in different continents. Similar to what was observed by Oei and colleagues, some words in the English version of DASS-21 could not be easily translated into Ilokano. For the English words that were idiomatic or metaphorical (e.g., to wind down, downhearted and blue), the Ilokano translation referred to the Ilokano idioms and metaphors, without direct translating the English words. However, some terms such as “relax” were used in English as there was no Ilokano translation that would fit in the context referred to in the screening tool. Indeed, words such as “relax” seem to be integrated into the lexicon of Ilokano and other Philippine languages as the word is sometimes spelled using the local orthography (e.g., relaks) and seems to be understood by most Filipinos and even those who primarily use Ilokano. As a result of these adaptations, all 21 items were translated and showed good psychometric properties.
As we noted earlier, there are regional variations in how Ilokano is spoken in different parts of the Philippines. The variations were noted in the pilot study where individual interviews were conducted to ask the participants to evaluate the different translations of items. Those that came from provinces in and/or closer to the Ilocos region recognized some of the translated words and phrases as typical Ilocano terms. On the other hand, those that came from the Cordillera region found those same translations less familiar, but still understandable in context. So while the results of the validation study involved participants from different regions of the Philippines, we did not validate the results separately based on the origin of the participants. Further research might inquire into differential items functioning depending on the region of the person answering the DASS-21 Ilokano version.
The preceding point relates to a limitation of our initial validation study. Although our sample was drawn from the three Philippine regions where there are high number of native speakers and second language speakers of Ilokano, we cannot claim to have had a representative sample. The online data-gathering inevitably biased the sample for those who are younger adults, who are more educated, and who had easy access to the internet and computers. Another limitation of this study is that it did not differentiate native Ilokano speakers from those who use Ilokano as their second or passive language. We also mentioned the Ilokano speakers in the diasporic Filipino communities, but the study did not deliberately sample such individuals in the validation study. So our validation results should be seen as preliminary evidence for the structural validity, internal consistency, and criterion validity of the Ilokano version of the DASS-21. More validation studies should be undertaken to establish the validity of the Ilokano DASS-21 with more diverse Ilokano-speaking samples, particularly less educated individuals who may also need to be assessed using oral administration of the screening tool. As the initial validation study was undertaken with a non-clinical sample, it is also important to establish the validity of the Ilokano DASS-21 by comparing non-clinical samples with samples diagnosed with depression and different anxiety disorders. Future research could also inquire into other psychometric properties of the translation such as test–retest reliability, invariance across sex, and whether different norms need to be established using the Ilokano DASS-21.
Even as we note limitations in the scope of the current translation and validation study, we undertook a careful and systematic approach to the translation and adaptation process and to the initial structural validation and construct validation of this translation in the Ilokano language. This language that is the third most widely spoken language in a very populous country and is spoken by a diasporic community across the globe but that has never been used systematically in psychological assessment. Given the initial evidence for the three-factor structure, the good reliability, and criterion validity of the Ilocano version of the DASS-21, it appears to be an adequate tool in assessing aspects of depression, anxiety, stress and general distress for Ilokano-speaking individuals. The availability of a viable and valid tool should help screen individuals with distress who come from regions and province of the Philippines where mostly communicate using their native Ilokano, instead of the official languages of English or Filipino.
Even as there are already several studies that translated and validated the DASS-21, we should underscore the need to continuously translate and validate the screening tool in languages used in communities that are not served by psychologists and other mental health professionals, whose assessment tools are in foreign unfamiliar languages. If psychology seeks to be a truly global science and profession, its tools and approaches need to be adapted and validated in as many different cultures and social groups as possible. We believe that our study has taken a small but important step in making psychological services a bit more responsive to one of the ethnolinguistic communities that might be currently underserved.
Availability of Data and Materials
The dataset analyzed in the current study are available from the corresponding author on reasonable request
Code Availability
Not applicable.
Abbreviations
- CFI:
-
Comparative Fit Index
- COVID-19:
-
Coronavirus disease 19
- DASS-21:
-
Depression Anxiety and Stress Scale
- DSM-IV:
-
Diagnostic and Statistical Manual, Fourth Edition
- FS:
-
Flourishing Scale
- GAD-7:
-
General Anxiety Disorder-7
- SPANE:
-
Scale of Positive and Negative Experiences
- SPSS AMOS:
-
Statistical Package for the Social Sciences—Analysis of a Moment Structure
- PHQ-9:
-
Patient Health Questionnaire-9
- RMSEA:
-
Root Mean Square Error of Approximation
- TLI:
-
Tucker–Lewis Index
References
Alfonsson, S., Wallin, E., & Maathz, P. (2017). Factor structure and validity of the Depression, Anxiety and Stress Scale-21 in Swedish translation. Journal of Psychiatric and Mental Health Nursing, 2017(24), 154–162. https://doi.org/10.1111/jpm.12363
Asghari, A., Saed, F., & Dibajnia, P. (2008). Psychometric properties of the Depression Anxiety Stress Scales-21 (DASS-21) in a non-clinical Iranian sample. International Journal of Psychology, 2(2), 82–102.
Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107(2), 238–246. https://doi.org/10.1037/0033-2909.107.2.238
Bentler, P. M., & Chou, C. P. (1987). Practical issues in structural modeling. Sociological Methods & Research, 16, 78–117. https://doi.org/10.1177/0049124187016001004
Bernardo, A. B. I. (2007). Language in Philippine education: Rethinking old fallacies, exploring new alternatives amidst globalization. In T. R. F. Tupas (Ed.), (Re)making society: The politics of language, discourse and identity in the Philippines (pp. 1–26). University of the Philippines Press.
Bernardo, A. B. I. (2008). Exploring epistemological beliefs of bilingual Filipino preservice teachers in the Filipino and English languages. Journal of Psychology: Interdisciplinary and Applied, 142, 193–208. https://doi.org/10.3200/JRLP.142.2.193-208
Bottesi, G., Ghisi, M., Altoè, G., Conforti, E., Melli, G., & Sica, C. (2015). The Italian version of the Depression Anxiety Stress Scales-21: Factor structure and psychometric properties on community and clinical samples. Comprehensive Psychiatry, 60, 170–181. https://doi.org/10.1016/j.comppsych.2015.04.005
Brown, T. A., Chorpita, B. F., Korotitsch, W., & Barlow, D. H. (1997). Psychometric properties of the Depression Anxiety Stress Scales (DASS) in clinical samples. Behaviour Research and Therapy, 35(1), 79–89. https://doi.org/10.1016/S0005-7967(96)00068-X
Chan, H. K., & Bernardo, A. B. I. (2017). Measuring depression, anxiety and stress in Macau university students. Asia-Pacific Psychiatry, 9(3), e12275. https://doi.org/10.1111/appy.12275
Clara, I. P., Cox, B. J., & Enns, M. W. (2001). Confirmatory factor analysis of the depression-Anxiety-Stress Scales in depressed and anxious patients. Journal of Psychopathology and Behavioral Assessment, 23(1), 61–67. https://doi.org/10.1023/A:1011095624717
Clark, L. A., & Watson, D. (1991). Tripartite model of anxiety and depression: Psychometric evidence and taxonomic implications. Journal of Abnormal Psychology, 100, 316–336. https://doi.org/10.1037/0021-843X.100.3.316
Crawford, J. R., Garthwaite, P. H., Lawrie, C. J., Henry, J. D., MacDonald, M. A., Sutherland, J., & Sinha, P. (2009). A convenient method of obtaining percentile norms and accompanying interval estimates for self-report mood scales (DASS, DASS 21, HADS, PANAS, and SAD). British Journal of Clinical Psychology, 48, 163–180. https://doi.org/10.1348/014466508X377757
Datu, J. A. D., Valdez, J. P. M., & King, R. B. (2016). Perseverance counts but consistency does not! Validating the short grit scale in a collectivist setting. Current Psychology, 35(1), 121–130. https://doi.org/10.1007/s12144-015-9374-2
Daza, P., Novy, D. M., Stanley, M. A., & Averill, P. (2002). The Depression Anxiety Stress Scale-21: Spanish translation and validation with a Hispanic sample. Journal of Psychopathology and Behavioral Assessment, 24(3), 195–205. https://doi.org/10.1023/A:1016014818163
Deokhoon, J., Venerina, J., Jun-Mo, K., & Shaun, O. L. (2018). Cross-cultural adaptation and validation of the Depression, Anxiety and Stress Scale-21 (DASS-21) in the Korean working population. Work, 59, 93–102. https://doi.org/10.3233/WOR-172661
Diener, E., Wirtz, D., Tov, W., Kim-Prieto, C., Choi, D., Oishi, S., & Biswas-Diener, R. (2009). New measures of well-being: Flourishing and positive and negative feelings. Social Indicators Research, 39, 247–266.
Duffy, C. J., Cunningham, E. G., & Moore, S. M. (2005). Brief report: The factor structure of mood states in an early adolescent sample. Journal of Adolescence, 28(5), 677–680. https://doi.org/10.1016/j.adolescence.2005.08.013
Eberhard, D. M., Simons, G. F., & Fennig, C. D. (Eds.). (2020). Ethnologue: Languages of the world (23rd ed.). SIL International. Online version: http://www.ethnologue.com.
Edimansyah, B. A., Rusli, B. N., & Naing, L. (2007). Reliability and construct validity of the Malay version of the Depression Anxiety Stress Scales (DASS) in automotive assembly workers in Malaysia. Malaysian Journal of Public Health Medicine, 7(1), 25–30.
Ettman, C. K., Abdalla, S. M., Cohen, G. H., Sampson, L., Vivier, P. M., & Galea, S. (2020). Prevalence of depression symptoms in US adults before and during the COVID-19 Pandemic. JAMA Network Open, 3(9), e2019686. https://doi.org/10.1001/jamanetworkopen.2020.19686
Galanza, M. A. M. C., Aruta, J. J. B., Mateo, N. J., Resurreccion, R. R., & Bernardo, A. B. I. (2021). Mental health of Filipino university students during the COVID-19 pandemic: The distinct influences of fear of COVID-19 and financial difficulties. Advanced online publication. https://doi.org/10.1080/20590776.2021.1999168
Gan, W., Nasir, M. T. M., Zalilah, M., & Hazizi, A. (2008). Disordered eating behaviors, depression, anxiety and stress among Malaysian university students. AIDS Patient Care and STDs, 22, 989–998. https://doi.org/10.1016/j.appet.2012.08.002
Ganotice, F. A., Bernardo, A. B. I., & King, R. B. (2013). Adapting the Facilitating Conditions Questionnaire (FCQ) for bilingual Filipino adolescents: Validating English and Filipino versions. Child Indicators Research, 6, 237–256. https://doi.org/10.1007/s12187-012-9167-1
Gilbody, S. M., House, A. O., & Sheldon, T. A. (2001). Routinely administered questionnaires for depression and anxiety: Systematic review. BMJ, 322(7283), 406–409. https://doi.org/10.1136/bmj.322.7283.406
Henry, J. D., & Crawford, J. R. (2005). The short- form version of the Depression Anxiety Stress Scales (DASS-21): Construct validity and normative data in a large non-clinical sample. British Journal of Clinical Psychology, 44, 227–239. https://doi.org/10.1348/014466505X29657
Kirmayer, L. J., & Swartz, L. (2013). Culture and global mental health. In V. Patel, H. Minas, A. Cohen, & M. Prince (Eds.), Global mental health: Principles and practice (pp. 41–62). Oxford University Press. https://doi.org/10.1093/med/9780199920181.003.0003
Kroenke, K., Spitzer, R. L., & Williams, J. B. (2001). The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine, 16(9), 606–613. https://doi.org/10.1046/j.1525-1497.2001.016009606.x
Kyriazos, T. A., Stalikas, A., Prassa, K., & Yotsidi, V. (2018). Can the Depression Anxiety Stress Scales-Short be shorter? Factor structure and measurement invariance of DASS-21 and DASS-9 in a Greek, non-clinical sample. Psychology, 9, 1095–1127. https://doi.org/10.4236/psych.2018.95069
Lee, I. A., & Preacher, K. J. (2013). Calculation for the test of the difference between two dependent correlations with one variable in common [Computer software]. Available from http://quantpsy.org. Accessed 22 June 2021.
Lee, B., & Kim, Y. E. (2020). Validity of the depression, anxiety, and stress scale (DASS-21) in a sample of Korean university students. Current Psychology. https://doi.org/10.1007/s12144-020-00914-x
Lovibond, P. F., & Lovibond, S. H. (1995). The structure of negative emotional states: Comparison of the Depression Anxiety Stress Scales (DASS) with the beck depression and anxiety inventories. Behaviour Research and Therapy, 33, 335–343. https://doi.org/10.1016/0005-7967(94)00075-u
Mellor, D., Vinet, E. V., Xu, X. Y., Mamat, N. H. B., Richardson, B., & Roman, F. (2015). Factorial invariance of the DASS-21 among adolescents in four countries. European Journal of Psychological Assessment, 31(2), 138–142. https://doi.org/10.1027/1015-5759/a000218
Mendoza, N. B., Bernardo, A. B. I., & Dizon, J. I. W. T. (2021). Unattended mental health needs: Adult students in the Philippines during the early months of the COVID-19 pandemic. Transactions of the National Academy of Science and Technology-Philippines, 43. https://transactions.nast.ph/?p=1135
Montano, R. L. T., & Acebes, K. M. L. (2020). Covid stress predicts depression, anxiety and stress symptoms of Filipino respondents. International Journal of Research in Business and Social Science, 9(4), 78–103.
Musa, R., Fadzil, M. A., & Zain, Z. (2007). Translation, validation and psychometric properties of Bahasa Malaysia version of the Depression Anxiety and Stress Scales (DASS). ASEAN Journal of Psychiatry, 8, 82–89.
Nalipay, M. J. N., Bernardo, A. B. I., Tarroja, M. C. H., & Bautista, M. L. C. (2019). The factor structure of the English CBCL DSM-oriented scales in Filipino school children as reported by bilingual caregivers. International Journal of School and Educational Psychology, 7, 102–110. https://doi.org/10.1080/21683603.2018.1509036
Ng, F., Trauer, T., Dodd, S., Callaly, T., Campbell, S., & Berk, M. (2007). The validity of the 21-item version of the Depression Anxiety Stress Scales as a routine clinical outcome measure. Acta Neuropsychiatrica, 19, 304–310. https://doi.org/10.1111/j.1601-5215.2007.00217.x
Norton, P. J. (2007). Depression Anxiety and Stress Scales (DASS-21): Psychometric analysis across four racial groups. Anxiety, Stress & Coping, 20, 253–265. https://doi.org/10.1080/10615800701309279
Oei, T. P. S., Sawang, S., Goh, Y. W., & Mukhtar, F. (2013). Using the Depression Anxiety Stress Scale 21 (DASS-21) across cultures. International Journal of Psychology, 48(6), 1018–1029. https://doi.org/10.1080/00207594.2012.755535
Osman, A., Wong, J. L., Bagge, C. L., Freedenthal, S., Gutierrez, P. M., & Lozano, G. (2012). The Depression Anxiety Stress Scales-21 (DASS-21): Further examination of dimensions, scale reliability, and correlates. Journal of Clinical Psychology, 68(12), 1322–1338. https://doi.org/10.1002/jclp.21908
Park, K. C., Lee, K. J., Park, J. B., Min, K. B., & Lee, K. W. (2008). Association between occupational stress and depression, anxiety, and stress symptoms among white-collar male workers in an automotive company. Korean Journal of Occupational and Environmental Medicine, 20, 215–224. https://doi.org/10.35371/aoem.2020.32.e13
Reshadat, S., Zakiei, A., Karami, J., & Ahmadi, E. (2018). A study of the psychological and family factors associated with sleep quality among pregnant women. Sleep and Hypnosis, 20(1), 17–24. https://doi.org/10.5350/Sleep.Hypn.2016.18.0130
Rubino, C. R. G. (2000). Ilocano Dictionary and Grammar: Ilocano-English. University of Hawaii Press.
Ruiz, F. J., García-Martín, M. B., Suárez-Falcón, J. C., & Odriozola-González, P. (2017). The hierarchical factor structure of the Spanish version of Depression Anxiety and Stress Scale-21. International Journal of Psychology & Psychological Therapy, 17, 93–101.
Shea, T. L., Tennant, A., & Pallant, J. F. (2009). Rasch model analysis of the Depression, Anxiety and Stress Scales (DASS). BMC Psychiatry, 9, 21–31. https://doi.org/10.1186/1471-244X-9-21
Simon, P. D. P. (2020). Factor structure and longitudinal measurement invariance of the Frost Multidimensional Perfectionism Scale-Brief on a Filipino sample. International Journal of School & Educational Psychology. https://doi.org/10.1080/21683603.2020.1837702
Sinclair, S. J., Siefert, C. J., Slavin-Mulford, J. M., Stein, M. B., Renna, M., & Blais, M. A. (2012). Psychometric evaluation and normative data for the Depression, Anxiety, and Stress Scales-21 (DASS-21) in a nonclinical sample of U.S. adults. Evaluation and the Health Professions, 35(3), 259–279. https://doi.org/10.1177/0163278711424282
Spitzer, R. L., Kroenke, K., Williams, J. B., & Löwe, B. (2006). A brief measure for assessing generalized anxiety disorder: The GAD-7. Archives of Internal Medicine, 166(10), 1092–1097. https://doi.org/10.1001/archinte.166.10.1092
Steiger, J. H. (1980). Tests for comparing elements of a correlation matrix. Psychological Bulletin, 87(2), 245–251.
Steiger, J. H. (2000). Point estimation, hypothesis testing, and interval estimation using the RMSEA: Some comments and a reply to Hayduk and Glaser. Structural Equation Modeling: A Multidisciplinary Journal, 7(2), 149–162. https://doi.org/10.1207/S15328007sem0702_1
Su, X., Lau, J. T. F., Mak, W. W. S., Chen, L., Feng, T., Chen, X., Liu, C., Liu, J., Liu, D., & Cheng, J. (2008). Development of the Perceived Stress Scale for people living with HIV/AIDS in China. AIDS Patient Care and STDs, 22, 989–998. https://doi.org/10.1089/apc.2008.0095
Tee, M. L., Tee, C. A., Anlacan, J. P., Aligam, K. J. G., Reyes, P. W. C., Kurchittham, V., & Ho, R. C. (2020). Psychological impact of COVID-19 pandemic in the Philippines. Journal of Affective Disorders. https://doi.org/10.1016/j.jad.2020.08.043
Tucker, L. R., & Lewis, C. (1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38(1), 1–10.
Tully, P. J., Zajac, I. T., & Venning, A. J. (2009). The structure of anxiety and depression in a normative sample of younger and older Australian adolescents. Journal of Abnormal Child Psychology, 37(5), 717–726. https://doi.org/10.1007/s10802-009-9306-4
Vahratian, A., Blumberg, S. J., Terlizzi, E. P., & Schiller, J. S. (2021). Symptoms of anxiety ordepressive disorder and use of mental health care among adults during the COVID-19 pandemic — United States, August 2020–February 2021. Morbidity and Mortality Weekly Report, 70(13), 490–494. https://doi.org/10.15585/mmwr.mm7013e2
Willemsen, J., Markey, S., Declercq, F., & Vanheule, S. (2011). Negative emotionality in a large community sample of adolescents: The factor structure and measurement invariance of the short version of the Depression Anxiety Stress Scales (DASS-21). Stress and Health, 27(3), E120–E128. https://doi.org/10.1002/smi.1342
Yıldırım, A., Boysan, M., & Kefeli, M. C. (2018). Psychometric properties of the Turkish version of the Depression Anxiety Stress Scale-21 (DASS-21). British Journal of Guidance & Counselling, 46(5), 582–595. https://doi.org/10.1080/03069885.2018.1442558
Zhang, L. F., & Bernardo, A. B. I. (2000). Validity of the learning process questionnaire with students of lower academic attainment. Psychological Reports, 87, 284–290. https://doi.org/10.2466/pr0.2000.87.1.284
Funding
This research was supported by a Research Fellowship Grant to the second author given by the National Academy of Science and Technology, Department of Science and Technology, Republic of the Philippines.
Author information
Authors and Affiliations
Contributions
Basic conceptualization was contributed by ABB; detailed conceptualization was contributed by PDB and SIM; translation methodology was contributed by PDB and SIM; translation audit and pilot were contributed by PDB and SIM; validation methodology was contributed by PDB and SIM; plan for formal analysis was contributed by ABB; data curation was contributed by PDB; main formal analysis was contributed by PDB; additional analysis was contributed by ABB; writing—original draft was contributed by PDB and ABB; writing—review, editing, and revision was contributed by PDB, MIB and ABB; supervision was contributed by ABB; project administration was contributed by PDB and MIB; funding acquisition was contributed by ABB. All authors have read and agreed to the published version of the manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare no conflict of interest or any competing interests.
Consent to participate
All participants in the study provided their written informed consent to participate in the study.
Consent for publication
Not applicable.
Ethical approval
The research procedures in the comply with ethical principles for research with human participants consistent with the 1964 Helsinki Declaration and its later amendments and comparable ethical standards. Informed consent was obtained from all participants in the pilot study and validation study, no information that can indicate the identity of the participants was encoded or recorded.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Bengwasan, P.D., Bernardo, A.B.I. & Maximo, S.I. Translation and Initial Validation of the Depression Anxiety and Stress Scale (DASS-21) in Ilokano. Psychol Stud 67, 594–604 (2022). https://doi.org/10.1007/s12646-022-00696-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12646-022-00696-1