Sources of Response Bias in Older Ethnic Minorities: A Case of Korean American Elderly
The present study was undertaken to investigate potential sources of response bias in empirical research involving older ethnic minorities and to identify prudent strategies to reduce those biases, using Korean American elderly (KAE) as an example. Data were obtained from three independent studies of KAE (N = 1,297; age ≥60) in three states (Florida, New York, and Maryland) from 2000 to 2008. Two common measures, Pearlin’s Mastery Scale and the CES-D scale, were selected for a series of psychometric tests based on classical measurement theory. Survey items were analyzed in depth, using psychometric properties generated from both exploratory factor analysis and confirmatory factor analysis as well as correlational analysis. Two types of potential sources of bias were identified as the most significant contributors to increases in error variances for these psychological instruments. Error variances were most prominent when (1) items were not presented in a manner that was culturally or contextually congruent with respect to the target population and/or (2) the response anchors for items were mixed (e.g., positive vs. negative). The systemic patterns and magnitudes of the biases were also cross-validated for the three studies. The results demonstrate sources and impacts of measurement biases in studies of older ethnic minorities. The identified response biases highlight the need for re-evaluation of current measurement practices, which are based on traditional recommendations that response anchors should be mixed or that the original wording of instruments should be rigidly followed. Specifically, systematic guidelines for accommodating cultural and contextual backgrounds into instrument design are warranted.
KeywordsCultural bias Ethnic minority elderly Response bias
This study used data obtained from three studies of Korean American elderly in three states (Florida, New York, and Maryland) from 2000 to 2008. Funding sources for data collection include the National Institute of Mental Health (R21 MH081094), the Advanced Research Institute in Geriatric Mental Health (R25 MH068502), and the Agency for Healthcare Research and Quality (R01 HS13160).
The manuscript has not been and will not be submitted elsewhere for publication and the contents of this manuscript are not now under consideration for publication elsewhere. There are no directly related manuscripts or abstracts, published or unpublished, by any authors of this paper. All authors have reviewed and approved the complete manuscript (including tables and figures).
- Andresen, E. M., Malmgren, J. A., Carter, W. B., & Patrick, D. L. (1994). Screening for depression in well older adults—evaluation of a short-form of the CES-D (center for epidemiologic studies depression scale). American Journal of Preventive Medicine, 10(2), 77–84.Google Scholar
- Arbuckle, J. L. (2006). Amos (version 7.0) [computer program]. Chicago: SPSS.Google Scholar
- Bengtsson-Tops, A. (2004). Mastery in patients with schizophrenia living in the community: relationship to sociodemographic and clinical characteristics, needs for care and support, and social network. Journal of Psychiatric and Mental Health Nursing, 11(3), 298–304. doi: 10.1111/j.1365.CrossRefGoogle Scholar
- Bollen, K. A., & Long, J. S. (1993). Testing structural equating models. Newbury Park: Sage.Google Scholar
- Census Bureau, U. S. (2012). The Asian population: 2010. Washington: U.S. Department of Commerce.Google Scholar
- Dillman, D. A. (2000). Mail and internet surveys: The tailored design method (Vol. 2). New York: Wiley.Google Scholar
- Hair, J. F., Jr., Anderson, R. E., Tatham, R. L., & Black, W. C. (1995). Multivariate data analysis (4th ed.). Upper Saddle River: Prentice-Hall.Google Scholar
- IBM Corp. (2013). IBM SPSS Statistics for Windows, Version 22.0. Armonk, NY: Author.Google Scholar
- Kim, M. T. (1995). Cultural influences of depression experiences among Korean Americans. Journal of Psychosocial Nursing, 33(2), 13–18.Google Scholar
- Kleinman, A., & Good, B. (1985). Culture and depression: Studies in the anthropology and cross-cultural psychiatry of affect and disorder. Berkeley and Los Angeles: University of California Press.Google Scholar
- Matsumoto, D. (1994). Cultural influences on research methods and statistics. Pacific Grove: Brooks/Cole.Google Scholar
- Nunnally, J. C. (1970). Introduction to psychological measurement. New York: McGraw-Hill.Google Scholar
- Pang, K. M. (1984). Everyday life, health, and illness of the elderly Korean immigrants: Cultural construction of illness (Unpublished doctoral dissertation). Catholic University of America, Washington, DC.Google Scholar
- Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariate statistics. Boston: Pearson Education.Google Scholar