Skip to main content

A comparison of depression prevalence estimates measured by the Patient Health Questionnaire with two administration modes: computer-assisted telephone interviewing versus computer-assisted personal interviewing

International Journal of Public Health volume 57, pages 225–233 (2012)Cite this article

Abstract

Objective

To compare depression prevalence estimates measured by the 8-item Patient Health Questionnaire (PHQ-8) with two administration modes in two national surveys.

Methods

Data on adults aged 18 years and older who participated in the 2006 Behavioral Risk Factor Surveillance System (BRFSS) (n = 198,678) and those who participated in the 2005–2006 National Health and Nutrition Examination Survey (NHANES) (n = 4,800) were analyzed.

Results

The crude PHQ-8 depression prevalence estimate using the diagnostic algorithm was higher in BRFSS with computer-assisted telephone interviewing (CATI) (9.16%, SE 0.15) than in NHANES with computer-assisted personal interviewing (CAPI) (6.28%, SE 0.59) (P < 0.001). After adjustment for demographic characteristics, the difference in the prevalence estimates remained (9.68% in BRFSS vs. 6.13% in NHANES, P < 0.001). Similar differences in the depression prevalence estimates using the PHQ-8 cutoff score ≥10 were detected (9.22% in BRFSS vs. 5.15% in NHANES, P < 0.001). Significant differences in the depression prevalence persisted in subgroups stratified by demographic characteristics and major health risk factors and outcomes.

Conclusions

The PHQ-8 administered by CATI yielded about 3.5% higher depression prevalence estimate than that by CAPI.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

43,34 €

Price includes VAT (Finland)
Tax calculation will be finalised during checkout.

Fig. 1
Fig. 2

References

  • American Psychiatric Association (1994) Diagnostic and statistical manual of mental disorders, 4th edn. American Psychiatric Association, Washington

    Google Scholar 

  • Anderson RJ, Freedland KE, Clouse RE, Lustman PJ (2001) The prevalence of comorbid depression in adults with diabetes: a meta-analysis. Diabetes Care 24:1069–1078

    PubMed  Article  CAS  Google Scholar 

  • Bowling A (2005) Mode of questionnaire administration can have serious effects on data quality. J Public Health (Oxf) 27:281–291

    Article  Google Scholar 

  • Centers for Disease Control and Prevention (12-18-2007) NHANES 2005–2006. http://www.cdc.gov/nchs/about/major/nhanes/nhanes2005-2006/nhanes05_06.htm

  • Centers for Disease Control and Prevention (CDC) (2007) Behavioral Risk Factor Surveillance System technical information and 2006 survey data. http://www.cdc.gov/brfss/technical_infodata/surveydata/2006.htm

  • Corrigan PW, Watson AC (2002) Understanding the impact of stigma on people with mental illness. World Psychiatry 1:16–20

    PubMed  Google Scholar 

  • Durant LE, Carey MP (2000) Self-administered questionnaires versus face-to-face interviews in assessing sexual behavior in young women. Arch Sex Behav 29:309–322

    PubMed  Article  CAS  Google Scholar 

  • Evans M, Kessler D, Lewis G, Peters TJ, Sharp D (2004) Assessing mental health in primary care research using standardized scales: can it be carried out over the telephone? Psychol Med 34:157–162

    PubMed  Article  CAS  Google Scholar 

  • First MB, Spitzer RL, Gibbon M, Williams JBW (2002) Structured clinical interview for DSM-IV-TR axis I disorders, research version. Biometrics Research, New York State Psychiatric Institute, New York

    Google Scholar 

  • Graubard BI, Korn EL (1999) Predictive margins with survey data. Biometrics 55:652–659

    PubMed  Article  CAS  Google Scholar 

  • Hanmer J, Hays RD, Fryback DG (2007) Mode of administration is important in US national estimates of health-related quality of life. Med Care 45:1171–1179

    PubMed  Article  Google Scholar 

  • Hays RD, Kim S, Spritzer KL, Kaplan RM, Tally S, Feeny D et al (2009) Effects of mode and order of administration on generic health-related quality of life scores. Value Health 12:1035–1039

    PubMed  Article  Google Scholar 

  • Huang FY, Chung H, Kroenke K, Delucchi KL, Spitzer RL (2006) Using the Patient Health Questionnaire-9 to measure depression among racially and ethnically diverse primary care patients. J Gen Intern Med 21:547–552

    PubMed  Article  CAS  Google Scholar 

  • Keeter S, Miller C, Kohut A, Groves RM, Presser S (2000) Consequences of reducing nonresponse in a national telephone survey. Public Opin Q 64:125–148

    PubMed  Article  CAS  Google Scholar 

  • Kroenke K, Spitzer RL (2002) The PHQ-9: a new depression diagnostic and severity measure. Psychiatr Ann 32:1–7

    Google Scholar 

  • Kroenke K, Strine TW, Spitzer RL, Williams JB, Berry JT, Mokdad AH (2009) The PHQ-8 as a measure of current depression in the general population. J Affect Disord 114:163–173

    PubMed  Article  Google Scholar 

  • Li C, Ford ES, Strine TW, Mokdad AH (2008) Prevalence of depression among U.S. adults with diabetes: findings from the 2006 behavioral risk factor surveillance system. Diabetes Care 31:105–107

    PubMed  Article  Google Scholar 

  • Link BG, Struening EL, Rahav M, Phelan JC, Nuttbrock L (1997) On stigma and its consequences: evidence from a longitudinal study of men with dual diagnoses of mental illness and substance abuse. J Health Soc Behav 38:177–190

    PubMed  Article  CAS  Google Scholar 

  • Martin A, Rief W, Klaiberg A, Braehler E (2006) Validity of the Brief Patient Health Questionnaire Mood Scale (PHQ-9) in the general population. Gen Hosp Psychiatry 28:71–77

    PubMed  Article  Google Scholar 

  • Mokdad AH, Stroup DF, Giles WH (2003) Public health surveillance for behavioral risk factors in a changing environment. Recommendations from the Behavioral Risk Factor Surveillance Team. MMWR Recomm Rep 52:1–12

    PubMed  Google Scholar 

  • Nelson DE, Powell-Griner E, Town M, Kovar MG (2003) A comparison of national estimates from the National Health Interview Survey and the Behavioral Risk Factor Surveillance System. Am J Public Health 93:1335–1341

    PubMed  Article  Google Scholar 

  • Newman JC, Des J, Turner CF, Gribble J, Cooley P, Paone D (2002) The differential effects of face-to-face and computer interview modes. Am J Public Health 92:294–297

    PubMed  Article  Google Scholar 

  • Pinto-Meza A, Serrano-Blanco A, Penarrubia MT, Blanco E, Haro JM (2005) Assessing depression in primary care with the PHQ-9: can it be carried out over the telephone? J Gen Intern Med 20:738–742

    PubMed  Article  Google Scholar 

  • Plan and operation of the Third National Health and Nutrition Examination Survey 1988–94 (1994) National Center for Health Statistics, Hyattsville. Vital Health Stat 1(32)

  • Pressler SJ, Subramanian U, Perkins SM, Gradus-Pizlo I, Kareken D, Kim J et al (2010) Measuring depressive symptoms in heart failure: validity and reliability of the Patient Health Questionnaire-8. Am J Crit Care

  • Salomon JA, Nordhagen S, Oza S, Murray CJ (2009) Are Americans feeling less healthy? The puzzle of trends in self-rated health. Am J Epidemiol 170:343–351

    PubMed  Article  Google Scholar 

  • Smith A, Lyons A, Pitts M, Croy S, Ryall R, Garland S et al (2009) Assessing knowledge of human papillomavirus and collecting data on sexual behavior: computer assisted telephone versus face to face interviews. BMC Public Health 9:429

    PubMed  Article  Google Scholar 

  • Spitzer RL, Kroenke K, Williams JB (1999) Validation and utility of a self-report version of PRIME-MD: the PHQ primary care study. Primary Care Evaluation of Mental Disorders. Patient Health Questionnaire. JAMA 282:1737–1744

    PubMed  Article  CAS  Google Scholar 

  • Sykes W, Collins M (1988) Effects of mode of interview: experiments in the UK. In: Groves RM, Biemer PP, Lyberg LE, Massey JT, Nicholls WLI, Waksberg J (eds) Telephone survey methodology. Wiley, New York, pp 301–320

    Google Scholar 

  • Tourangeau R, Smith TW (1996) Asking sensitive questions: the impact of data collection mode, question format, and question context. Public Opin Q 60:275–304

    Article  Google Scholar 

  • US Department of Health and Human Services (1999) Mental health: a report of the surgeon general. US Department of Health and Human Services, Substance Abuse and Mental Health Services Administration, Center for Mental Health Services, National Institutes of Health, National Institute of Mental Health, Rockville, MD

Download references

Acknowledgments

The authors would like to acknowledge Dr. William C Reeves of the CDC for his critical reviews and contribution to this manuscript.

Conflict of interest

The authors declare that they have no competing interests.

Author information

Affiliations

  1. Division of Behavioral Surveillance, Office of Surveillance, Epidemiology, and Laboratory Services, Centers for Disease Control and Prevention, 1600 Clifton Road, NE, MS E-97, Atlanta, GA, 30333, USA

    Chaoyang Li & Lina S. Balluz

  2. Division of Adult and Community Health, National Center for Chronic Disease Prevention and Health Promotion, Centers for Disease Control and Prevention, Atlanta, GA, USA

    Earl S. Ford & Guixiang Zhao

  3. Division of Blood Disorders, National Center on Birth Defects and Developmental Disabilities, Centers for Disease Control and Prevention, Atlanta, GA, USA

    James Tsai

Authors
  1. Chaoyang Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Earl S. Ford
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Guixiang Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. James Tsai
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Lina S. Balluz
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chaoyang Li.

Additional information

The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the Centers for Disease Control and Prevention.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Li, C., Ford, E.S., Zhao, G. et al. A comparison of depression prevalence estimates measured by the Patient Health Questionnaire with two administration modes: computer-assisted telephone interviewing versus computer-assisted personal interviewing. Int J Public Health 57, 225–233 (2012). https://doi.org/10.1007/s00038-011-0253-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00038-011-0253-9

Keywords

  • Depression
  • Patient Health Questionnaire
  • Mode of administration
  • Computer-assisted telephone interviewing
  • Computer-assisted personal interviewing