Advertisement

Prevention Science

, Volume 7, Issue 4, pp 359–368 | Cite as

Examining Equivalence of Concepts and Measures in Diverse Samples

  • Tracy W. HarachiEmail author
  • Yoonsun Choi
  • Robert D. Abbott
  • Richard F. Catalano
  • Siri L. Bliesner
Original paper

Abstract

While there is growing awareness for the need to examine the etiology of problem behaviors across cultural, racial, socioeconomic, and gender groups, much research tends to assume that constructs are equivalent and that the measures developed within one group equally assess constructs across groups. The meaning of constructs, however, may differ across groups or, if similar in meaning, measures developed for a given construct in one particular group may not be assessing the same construct or may not be assessing the construct in the same manner in other groups. The aims of this paper were to demonstrate a process of testing several forms of equivalence including conceptual, functional, item, and scalar using different methods. Data were from the Cross-Cultural Families Project, a study examining factors that promote the healthy development and adjustment of children among immigrant Cambodian and Vietnamese families. The process described in this paper can be implemented in other prevention studies interested in diverse groups. Demonstrating equivalence of constructs and measures prior to group comparisons is necessary in order to lend support of our interpretation of issues such as ethnic group differences and similarities.

Keywords

Equivalence Comparative research 

Notes

Acknowledgement

This investigation was supported by a grant from the Prevention Research Center at the School of Social Work (MH56599) and by a grant from the National Institute on Drug Abuse (DA012038). An earlier version of this article was presented at the Annual Meeting of the Society for Prevention Research in Montreal, Quebec, June 2000.

References

  1. Bentler, P. M. (1990). Comparative fix indexes in structural models. Psychological Bulletin, 107, 238–246.CrossRefPubMedGoogle Scholar
  2. Bentler, P. M. (1993). EQS: Structural equations program manual. Los Angeles, CA: BMDP Statistical Software.Google Scholar
  3. Byrne, B. M. (1994). Structural equation modeling with EQS and EQS-Windows: Basic concepts, applications, and programming. Thousand Oaks, CA: Sage Publications.Google Scholar
  4. Byrne, B. M., Shavelson, R. J., & Muthen, B. (1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105, 456–466.CrossRefGoogle Scholar
  5. Cahn, D., & Stansell, J. (Eds.). (2005). From Refugee to Deportee: How U.S. Immigration Law Failed the Cambodian Community: K. H. Barrett, & W. H. George (Eds.). (2005). Race, culture, psychology, and law. (pp. 237–254). xvii, 478 pp. Thousand Oaks, CA, US: Sage Publications, Inc.Google Scholar
  6. Catalano, R. F., Hawkins, J. D., Krenz, C., Gillmore, M., Morrison, D., Wells, E., et al. (1993). Using research to guide culturally appropriate drug abuse prevention. Journal of Consulting and Clinical Psychology, 61, 804–811.CrossRefPubMedGoogle Scholar
  7. Cauce, A. M., Coronado, N., & Watson, J. (1998). Conceptual, methodological, and statistical issues in culturally competent research. In M. Hernandez & R. Isaacs (Eds.), Promoting cultural competence in children's mental health services. (pp. 305–329). Baltimore, MD: Paul H. Brookes.Google Scholar
  8. Forsyth, B. H., Lessler, J. T., & Hubbard, M. L. (1992). Cognitive evaluation of the questionnaire. In C. F. Turner, J. T. Lessler, & J. C. Gfroerer (Eds.), Survey measurement of drug use: Methodological studies (DHHS Publication No. ADM 921929, pp. 1352). Rockville, MD: National Institute on Drug Abuse.Google Scholar
  9. Fuller, T. D., Edwards, J. N., Vorakitphokatorn, S., & Sermsri, S. (1993). Using focus groups to adapt survey instruments to new populations: Experience from a developing country. In D. L. Morgan (Ed.) Successful focus groups: Advancing the state of the art (Vol. 156, pp. 89–104). Thousand Oaks, CA: Sage Publications.Google Scholar
  10. Gottfredson, D. C., & Koper, C. S. (1997). Race and sex differences in the measurement of risk for drug use. Journal of Quantitative Criminology, 13, 325–347.CrossRefGoogle Scholar
  11. Griffin, K. W., Scheier, L. M., Botvin, G. J., Diaz, T., & Miller, N. (1999). Interpersonal aggression in urban minority youth: Mediators of perceived neighbhorhood, peer, and parental influcences. Journal of Community Psychology, 27, 281– 298.CrossRefGoogle Scholar
  12. Harkness, J. A., Mohler, P. Ph., & Van de Vijver, F. J. R. (2003). Comparative research. In J. A. Harkness, F. J. R. Van de Vijver, & P. Ph. Mohler (Eds.). Cross-cultural survey methods (pp. 3–16). Hoboken, NJ: John Wiley & Sons.Google Scholar
  13. Harkness, J. A., Van De Vijver, F. J. R., & Mohler, P. P. H. (2003). Cross-cultural survey methods. Hoboken, NJ: John Wiley & Sons.Google Scholar
  14. Hobbs, F., & Stoops, N. (2002). Demographic trends in the 20th century: Census 2000 special reports (Series CENSR-4). Washington, DC: U.S. Government Printing Office.Google Scholar
  15. Horn, J. L., & McArdle, J. J. (1992). A practical and theoretical guide to measurement invariance in aging research. Experimental Aging Research, 18, 117–144.PubMedGoogle Scholar
  16. Hu, L., & Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3, 424–453.CrossRefGoogle Scholar
  17. Huebner, A., & Howell, L. W. (2003). Examining the relationship between adolescent sexual risk-taking and perceptions of monitoring, communication, and parenting styles. Journal of Adolescent Health, 33, 71–78.CrossRefPubMedGoogle Scholar
  18. Hui, C. H., & Triandis, H. C. (1985). Measurement in cross-cultural psychology—a review and comparison of strategies. Journal of Cross-Cultural Psychology, 16, 131–152.Google Scholar
  19. Jobe, J. B., & Mingay, D. J. (1990). Cognitive laboratory approach to designing questionnaires for surveys of the elderly. Public Health Reports, 105, 518–524.PubMedGoogle Scholar
  20. Kline, R. B. (1998). Principles and practice of structural equation modeling. NY: Guilford Press.Google Scholar
  21. Knight, G. P., & Hill, N. E. (1998). Measurement equivalence in research involving minority adolescents. In V. C. McLoyd & L. Steinberg (Eds.), Studying minority adolescents: Conceptual, methodological, and theoretical issues (pp. 183–210). Mahwah, NJ: Erlbaum.Google Scholar
  22. Knight, G. P., Tein, J. Y., Shell, R., & Roosa, M. (1992). The cross-ethnic equivalence of parenting and family interaction measures among Hispanic and Anglo-American families. Child Development, 63, 1392–1403.CrossRefPubMedGoogle Scholar
  23. MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1, 130–149.CrossRefGoogle Scholar
  24. Marshall, G. N., Schell, T. L., Elliott, M. N., Berthold, S. M., & Chun, C.-A. (2005). Mental health of Cambodian refugees 2 decades after resettlement in the United States. JAMA: Journal of the American Medical Association, 294, 571–579.CrossRefPubMedGoogle Scholar
  25. McLoyd, V. C., & Steinberg, L. (Eds.) (1998). Studying minority adolescents. Mahwah, NJ: Lawrence Erlbaum AssociatesGoogle Scholar
  26. McLoyd, V. C. (1998). Changing demographics in the American population: Implications for research on minority children and adolescents. In V. C. McLoyd & L. Steinberg (Eds.), Studying minority adolescents: Conceptual, methodological, and theoretical issues (pp. 3–28). Mahwah, NJ: Erlbaum.Google Scholar
  27. Olson, D. H., Portner, J., & Bell, R. (1982). Family adaptability and cohesion evaluation scales. St. Paul: University of Minnesota Press.Google Scholar
  28. O’Neil, R., Parke, R. D., & McDowell, D. J. (2001). Objective and subjective features of children's neighborhoods: Relations to parental regulatory strategies and children's social competence. Applied Developmental Psychology, 22, 135–155.CrossRefGoogle Scholar
  29. Pons, D. A., F.L., Balaguer, I., & Garcia Merita, M. L. (2000). Satisfaction with Life Scale: Analysis of factorial invariance for adolescents and elderly persons. Perceptual and Motor Skills, 91, 62– 68.PubMedGoogle Scholar
  30. Robinson, C. C., Mandleco, B. F., Olsen, S., & Hart, C. H. (1995). Authoritative, authoritarian, and permissive parenting practices: Development of a new measure. Psychological Reports, 77, 819–830.Google Scholar
  31. Rosay, A. B., Gottfredson, D. C., Armstrong, T. A., & Harmon, M. A. (2000). Invariance of measures of prevention program effectiveness: A replication. Journal of Quantitative Criminology, 16, 341–367.CrossRefGoogle Scholar
  32. Steenkamp, J.-B. E. M., & Baumgartner, H. (1998). Assessing measurement invariance in cross-national consumer research. Journal of Consumer Research, 25, 78–90.CrossRefGoogle Scholar
  33. Steiger, J. H., & Lind, J. (1980). Statistically based tests for the number of common factors. Paper presented at the annual meeting of the Psychometric Society, Iowa City, IA.Google Scholar
  34. Triandis, H. C. (1993). Collectivism and individualism as cultural syndromes. Cross-Cultural Psychology, 27, 155–180.Google Scholar
  35. U. S. Department of Education. (2002). Inside No Child Left Behind. Title IV21st Century Schools, Part ASafe and Drug-Free Schools and Communities. Retrieved the World Wide Web: http://www.ed.gov/legislation/ESEA02/pg51.html.Google Scholar
  36. Van de Vijver, F. J. R., & Leung, K. (1997). Methods and data analysis for cross-cultural research. Newbury Park, CA: Sage Publications.Google Scholar
  37. Vandenberg, R. J. (2002). Toward a further understanding of and improvement in measurement invariance methods and procedures. Organizational Research Methods, 5, 139– 158.Google Scholar
  38. Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3, 4–69.Google Scholar
  39. Wu, P., Robinson, C. C., Yang, C., Hart, C. H., Olsen, S. F., Porter, C. L., Jin, S., Wo, J., & Wu, X. (2002). Similarities and differences in mothers’ parenting of preschoolers in China and the United States. International Journal of Behavioral Development, 26, 481–491.CrossRefGoogle Scholar
  40. Yu, E. S. H. (1985). Studying Vietnamese refugees: Methodological lessons in transcultural research. In T. C. Owan (Ed.) Southeast Asian mental health: Treatment, prevention, services, training and research (DHHS Publication No. ADM 851399, pp. 517541). Washington, DC: U.S. Government Printing Office.Google Scholar

Copyright information

© Society of Prevention Research 2006

Authors and Affiliations

  • Tracy W. Harachi
    • 1
    Email author
  • Yoonsun Choi
    • 2
  • Robert D. Abbott
    • 3
  • Richard F. Catalano
    • 4
  • Siri L. Bliesner
    • 5
  1. 1.Social Development Research GroupUniversity of WashingtonSeattleUSA
  2. 2.School of Social Service AdministrationUniversity of ChicagoChicagoUSA
  3. 3.College of EducationUniversity of WashingtonSeattleUSA
  4. 4.Social Development Research Group, School of Social WorkUniversity of WashingtonSeattleUSA
  5. 5.SeattleUSA

Personalised recommendations