Skip to main content
Log in

Depression symptoms across cultures: an IRT analysis of standard depression symptoms using data from eight countries

  • Original Paper
  • Published:
Social Psychiatry and Psychiatric Epidemiology Aims and scope Submit manuscript

Abstract

Purpose

Prevalence estimates of depression vary between countries, possibly due to differential functioning of items between settings. This study compared the performance of the widely used Hopkins symptom checklist 15-item depression scale (HSCL-15) across multiple settings using item response theory analyses. Data came from adult populations in the low and middle income countries (LMIC) of Colombia, Indonesia, Kurdistan Iraq, Rwanda, Iraq, Thailand (Burmese refugees), and Uganda (N = 4732).

Methods

Item parameters based on a graded response model were compared across LMIC settings. Differential item functioning (DIF) by setting was evaluated using multiple indicators multiple causes (MIMIC) models.

Results

Most items performed well across settings except items related to suicidal ideation and “loss of sexual interest or pleasure,” which had low discrimination parameters (suicide: a = 0.31 in Thailand to a = 2.49 in Indonesia; sexual interest: a = 0.74 in Rwanda to a = 1.26 in one region of Kurdistan). Most items showed some degree of DIF, but DIF only impacted aggregate scale-level scores in Indonesia.

Conclusions

Thirteen of the 15 HSCL depression items performed well across diverse settings, with most items showing a strong relationship to the underlying trait of depression. The results support the cross-cultural applicability of most of these depression symptoms across LMIC settings. DIF impacted aggregate depression scores in one setting illustrating a possible source of measurement invariance in prevalence estimates.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Whiteford HA et al (2015) The global burden of mental, neurological and substance use disorders: an analysis from the global burden of disease study 2010. PLoS One 10(2):e0116820

    Article  PubMed  PubMed Central  Google Scholar 

  2. Moussavi S et al (2007) Depression, chronic diseases, and decrements in health: results from the World Health Surveys. Lancet 370(9590):851–858

    Article  PubMed  Google Scholar 

  3. Steel Z et al (2009) Association of torture and other potentially traumatic events with mental health outcomes among populations exposed to mass conflict and displacement: a systematic review and meta-analysis. JAMA 302(5):537–549

    Article  CAS  PubMed  Google Scholar 

  4. Kohrt BA et al (2011) Validation of cross-cultural child mental health and psychosocial research instruments: adapting the depression self-rating scale and child PTSD symptom scale in Nepal. BMC Psychiatry 11:127–144

    Article  PubMed  PubMed Central  Google Scholar 

  5. Wessells MG (2009) Do no harm: toward contextually appropriate psychosocial support in international emergencies. Am Psychol 64(8):842–854

    Article  PubMed  Google Scholar 

  6. Bass JK, Bolton PA, Murray LK (2007) Do not forget culture when studying mental health. Lancet 370(9591):918–919

    Article  PubMed  Google Scholar 

  7. Hambleton RK, Waminathan H, Rogers HJ (1991) Fundamentals of item response theory, vol 1st. Sage Publications Inc., California

    Google Scholar 

  8. Bares C et al (2011) Differential item functioning due to gender between depression and anxiety items among Chilean adolescents. Int J Soc Psychiatry 58(4):386–392

    Article  PubMed  PubMed Central  Google Scholar 

  9. Hambrick JP et al (2010) Cross-ethnic measurement equivalence of measures of depression, social anxiety, and worry. Assessment 17(2):155–171

    Article  PubMed  Google Scholar 

  10. Kim G, Chiriboga DA, Jang Y (2009) Cultural equivalence in depressive symptoms in older white, black, and Mexican–American adults. J Am Geriatr Soc 57(5):790–796

    Article  PubMed  PubMed Central  Google Scholar 

  11. Bjorner JB et al (2014) Difference in method of administration did not significantly impact item response: an IRT-based analysis from the patient-reported outcomes measurement information system (PROMIS) initiative. Qual Life Res 23(1):217–227

    Article  PubMed  Google Scholar 

  12. Paz SH et al (2013) Evaluation of the patient-reported outcomes information system (PROMIS®) Spanish-language physical functioning items. Qual Life Res 22(7):1819–1830

    Article  PubMed  Google Scholar 

  13. Nuevo R et al (2009) Cross-cultural equivalence of the Beck depression inventory: a five-country analysis from the ODIN study. J Affect Disord 114(1):156–162

    Article  PubMed  Google Scholar 

  14. Canel-Çınarbaş D, Cui Y, Lauridsen E (2011) Cross-cultural validation of the Beck depression inventory–II across US and Turkish samples. Meas Eval Couns Dev 44(2):77–91

    Article  Google Scholar 

  15. Mollica RF et al (2004) Measuring trauma, measuring torture. Harvard University, Cambridge

    Google Scholar 

  16. Bass J et al (2012) A controlled trial of problem-solving counseling for war-affected adults in Aceh, Indonesia. Soc Psychiatry Psychiatr Epidemiol 47(2):279–291

    Article  PubMed  Google Scholar 

  17. Bolton P et al (2014) a transdiagnostic community-based mental health treatment for comorbid disorders: development and outcomes of a randomized controlled trial among Burmese refugees in Thailand. PLoS Med 11(11):e1001757

    Article  PubMed  PubMed Central  Google Scholar 

  18. Haroz EE et al (2014) Adaptation and testing of psychosocial assessment instruments for cross-cultural use: an example from the Thailand Burma border. BMC Psychol 2(1):31–40

    Article  PubMed  PubMed Central  Google Scholar 

  19. Bolton P et al (2014) A randomized controlled trial of mental health interventions for survivors of systematic violence in Kurdistan, Northern Iraq. BMC Psychiatry 14(1):360–375

    Article  PubMed  PubMed Central  Google Scholar 

  20. Bolton P, Neugebauer R, Ndogoni L (2002) Prevalence of depression in rural Rwanda based on symptom and functional criteria. J Nerv Ment Dis 190(9):631–637

    Article  PubMed  Google Scholar 

  21. Weiss W, Bolton P (2010) Assessment of torture survivors in Southern Iraq: development and testing of a locally-adapted assessment instrument. United States Agency for International Development, Washington, DC

    Google Scholar 

  22. Bolton P, Wilk CM, Ndogoni L (2004) Assessment of depression prevalence in rural Uganda using symptom and function criteria. Soc Psychiatry Psychiatr Epidemiol 39(6):442–447

    Article  PubMed  Google Scholar 

  23. Derogatis LR et al (1974) The Hopkins Symptom Checklist (HSCL): a self-report symptom inventory. Behav Sci 19(1):1–15

    Article  CAS  PubMed  Google Scholar 

  24. Hesbacher PT et al (1980) Psychiatric illness in family practice. J Clin Psychiatry 41:6–10

    CAS  PubMed  Google Scholar 

  25. Khuon F, Lavelle J (1987) Indochinese versions of the Hopkins symptom checklist-25: a screening instrument for the psychiatric care of refugees. Am J Psychiatry 144(4):497–500

    Article  PubMed  Google Scholar 

  26. Bland JM, Altman DG (1997) Cronbach’s alpha. Br Med J 314(7080):572

    Article  CAS  Google Scholar 

  27. Muthén LK, Muthén BO, Mplus User’s Guide (2012) The comprehensive modelling program for applied researchers: user’s guide, 7th edn. Muthén & Muthén, Los Angeles

    Google Scholar 

  28. Hu L-T, Bentler PM (1998) Fit indices in covariance structure modeling: sensitivity to underparameterized model misspecification. Psychol Methods 3(4):424–453

    Article  Google Scholar 

  29. Samejima F (1997) Graded response model. Handbook of modern item response theory. Springer, New YorK, pp 85–100

    Chapter  Google Scholar 

  30. Baker FB (2001) The basics of item response theory. ERIC Clearing House on Assessment and Education, Washington, DC

    Google Scholar 

  31. Cai L, Du Toit SHC, Thissen D (2011) IRTPRO: Flexible, multidimensional, multiple categorical IRT modeling. Scientific Software International, Chicago

    Google Scholar 

  32. Crane PK, Belle GV, Larson EB (2004) Test bias in a cognitive test: differential item functioning in the CASI. Stat Med 23(2):241–256

    Article  PubMed  Google Scholar 

  33. Kojima M et al (2002) Cross-cultural validation of the Beck depression inventory-II in Japan. Psychiatry Res 110(3):291–299

    Article  PubMed  Google Scholar 

  34. Fabre LF, Smith LC (2012) The effect of major depression on sexual function in women. J Sex Med 9(1):231–239

    Article  PubMed  Google Scholar 

  35. Kennedy SH, Rizvi S (2009) Sexual dysfunction, depression, and the impact of antidepressants. J Clin Psychopharmacol 29(2):157–164

    Article  CAS  PubMed  Google Scholar 

  36. Kitamura T et al (2004) Factor structure of the Zung self-rating depression scale in first-year university students in Japan. Psychiatry Res 128(3):281–287

    Article  PubMed  Google Scholar 

  37. Nock MK et al (2008) Cross-national prevalence and risk factors for suicidal ideation, plans and attempts. Br J Psychiatry 192(2):98–105

    Article  PubMed  PubMed Central  Google Scholar 

  38. Kessler RC, Bromet EJ (2013) The epidemiology of depression across cultures. Annu Rev Public Health 34:119–138

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to E. E. Haroz.

Ethics declarations

Conflict of interest

On behalf of all authors, the corresponding author states that there is no conflict of interest.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary material 1 (DOCX 294 kb)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Haroz, E.E., Bolton, P., Gross, A. et al. Depression symptoms across cultures: an IRT analysis of standard depression symptoms using data from eight countries. Soc Psychiatry Psychiatr Epidemiol 51, 981–991 (2016). https://doi.org/10.1007/s00127-016-1218-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00127-016-1218-3

Keywords

Navigation