Skip to main content

Attitudes Towards Gender Roles in Cross-Cultural Surveys: Content Validity and Cross-Cultural Measurement Invariance

Abstract

Measuring attitudes towards gender roles in comparative research is a challenging task. This paper aims at assessing the content validity and cross-cultural measurement invariance of the scales measuring attitudes towards gender roles in two large-scale comparative surveys, the International Social Survey Program 2002 and the World Values Survey 2005. The two scales are widely used in cross-cultural studies, they complement each other in measuring the complex concept of attitudes towards gender roles, and they cover an extensive number of European and non-European countries, allowing for the assessment of measurement invariance in different cultural settings. We assess the content by confronting the items included in the two surveys with the theoretical definitions employed by the literature, and we test for the cross-cultural measurement invariance by multigroup confirmatory factor analysis. According to our results, these scales are only partially valid in measuring the complex concept of attitudes towards gender roles. Moreover, the two scales are configural and metric invariant in all countries included in our analysis, but they are not scalar invariant. The two scales are suitable for testing relations between attitudes towards gender roles and other theoretically relevant concepts, but they are not useful for comparing the level of support for gender equality across countries.

This is a preview of subscription content, access via your institution.

We’re sorry, something doesn't seem to be working properly.

Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.

Fig. 1
Fig. 2

Notes

  1. 1.

    http://www.issp.org.

  2. 2.

    http://www.worldvaluessurvey.org.

References

  1. Alesina, A., Giuliano, P., & Nunn, N. (2011). On the origins of gender roles: Women and the Plough. IZA Discussion Paper No. 5735.

  2. Alwin, D. (2005). Attitudes, beliefs, and childbearing. In A. Booth & A. C. Crouter (Eds.), The new population problem: Why families in developed countries are shrinking and what it means (pp. 115–126). Mahwah, NJ: Erlbaum.

    Google Scholar 

  3. Alwin, D., Scott, J., et al. (1994). Sex-role attitude change in the United States, Britain, and Germany. Bielefeld, Germany: World Congress of Sociology.

    Google Scholar 

  4. Baxter, J., Hewitt, B. et al. (2004). Transitions Through the Life Course and Time Spent on Housework 99th Annual Meeting of the American Sociological Association. San Francisco.

  5. Baxter, J., & Kane, Emily W. (1995). Dependence and independence: A cross-national analysis of gender inequality and gender attitudes. Gender and Society, 9, 193–215.

    Article  Google Scholar 

  6. Beere, C. A., King, D. W., Beere, D. B., & King, L. A. (1984). The sex-role egalitarianism scale: a measure of attitudes toward equality between the sexes. Sex Roles, 10, 563–576.

    Article  Google Scholar 

  7. Behr, D., Braun, M., Kaczmirek, L., & Bandilla, W. (2013). Testing the validity of gender ideology items by implementing probing questions in web surveys. Field Methods, 25(2), 124–141.

    Article  Google Scholar 

  8. Bergh, J. (2006). Gender attitudes and modernization processes. International Journal of Public Opinion Research, 19, 5–23.

    Article  Google Scholar 

  9. Bollen, K. A. (1989). Structural equations with latent variables. New York: Wiley.

    Book  Google Scholar 

  10. Braun, M. (2008). Using egalitarian items to measure men's and women's family roles. Sex Roles, 59, 644–656.

  11. Cunningham, M., et al. (2005). Reciprocal relationship between attitudes about gender and social context during young adulthood. Social Science Research, 34(4), 862–892.

    Article  Google Scholar 

  12. Davidov, E. (2010). Testing for comparability of human values across countries and time with the third round of the European Social Survey. International Journal of Comparative Sociology, 51(3), 171–191.

    Article  Google Scholar 

  13. Duncan, S. (1994). Theorizing difference in patriarchy. Environment and Planning A, 26, 1177–1194.

    Article  Google Scholar 

  14. Halman, L., Sieben, I., & van Zundert, M. (2011). Atlas of European values. Brill: Trends and Traditions at the turn of the Century. Leiden.

    Google Scholar 

  15. Horn, J. L., & McArdle, J. J. (1992). A practical and theoretical guide to measurement invariance in aging research. Experimental Aging Research, 18, 117–144.

    Article  Google Scholar 

  16. Hui, C. H., & Triandis, H. C. (1985). Measurement in cross-cultural psychology. A review and comparison of strategies. Journal of Cross-Cultural Psychology, 16, 131–152.

    Article  Google Scholar 

  17. Inglehart, R., & Norris, P. (2003). Rising tide. gender equality and cultural change around the world. Cambridge, New York: Cambridge University Press.

    Book  Google Scholar 

  18. Inglehart, R., Norris, P., & Welzel, C. (2002). Gender equality and democracy. Comparative Sociology, 1(3–4), 321–345.

    Article  Google Scholar 

  19. Jakobsson, N., & Kotsadam, A. (2010). Do attitudes toward gender equality really differ between Norway and Sweden? Journal of European Social Policy, 20(2), 142–159.

    Article  Google Scholar 

  20. Jelen, T. (1988). The effect of gender role stereotypes on political attitudes. Social Science Journal, 25(3), 353–365.

    Article  Google Scholar 

  21. Joreskog, K. G. (1971). Simultaneous factor analysis in several populations. Psychometrika, 36, 409–426.

    Article  Google Scholar 

  22. Kalmijn, M. (2005). Attitude alignment in marriage and cohabitation: The case of sex-role attitudes. Personal Relationships, 12, 521–535.  

  23. Kankaraš, M., Moors, G., & Vermunt, J. (2010). Testing for measurement invariance with latent class analysis. In E. Davidov, P. Schmidt, & J. Billiet (Eds.), Cross-cultural analysis: methods and applications (pp. 359–384). London: Routledge Academic.

    Google Scholar 

  24. Kroska, A., & Elman, C. (2009). Change in attitudes about employed mothers: Exposure, interests, and gender ideology discrepancies. Social Science Research, 38, 366–382.

    Article  Google Scholar 

  25. Larsen, K. S., & Long, E. (1988). Attitudes toward sex-roles: traditional or egalitarian? Sex Roles, 19, 1–12.

    Article  Google Scholar 

  26. Lu, Y. H. (1993). Sex-roles attitudes and the employment of married women—a detroit area study. Journal of Women and Gender Studies, 4, 137–174.

    Google Scholar 

  27. McInnes, J. (1998). Analyzing patriarchy capitalism and women’s employment in Europe. Innovation: The European Journal of Social Science Research, 11(2), 227–248.

    Google Scholar 

  28. Motiejunaite, A., & Kravchenko, Z. (2008). Family policy, employment and gender-role attitudes: a comparative analysis of Russia and Sweden. Journal of European Social Policy, 18(1), 38–49.

    Article  Google Scholar 

  29. Panayatova, E., & Brayfield, A. (1997). National context and gender ideology: Attitudes towards women’s employment in Hungary and the United States. Gender & Society, 11, 627–655.

    Article  Google Scholar 

  30. Pfau-Effinger, B. (1993). Modernization, culture part-time employment: The example of Finland and West Germany. Work, Employment & Society, 7(3), 383–410.

    Article  Google Scholar 

  31. Pfau-Effinger, B. (2004). Development of culture, welfare states and women’s employment in Europe. Aldershot: Ashgate.

    Google Scholar 

  32. Poortinga, Y. H. (1989). Equivalence of cross cultural data: an overview of basic issues. International Journal of Psychology, 24, 737–756.

    Article  Google Scholar 

  33. Poortinga, Y. H., & van de Vijver, F. J. R. (1987). Cultural bias and the interpretation of test scores. In C. Schwarzer & B. Seipp (Eds.), Trends in European educational research (pp. 13–21). Braunschweig: Blankenstein.

    Google Scholar 

  34. Schutz Lee, K., Tufis, P., & Alwin, D. (2010). Separate Sphere or Increasing Equality? Changing gender Beliefs in Postwar Japan. Journal of Marriage and Family, 72(1), 184–201.

    Article  Google Scholar 

  35. Scott, J., & Braun, M. (2009). Changing public views of gender roles in seven nations 1988–2002. In M. Haller, R. Jowell, & T. Smith (Eds.), Charting the globe. The International Social Survey Programme 1984–2009. London: Routledge.

    Google Scholar 

  36. Sjöberg, O. (2004). the role of family policy institutions in explaining gender-role attitudes: A comparative multilevel analysis of thirteen industrialized countries. Journal of European Social Policy, 14(2), 107–123.

    Article  Google Scholar 

  37. Sjöberg, O. (2010). Ambivalent attitudes, contradictory institutions: ambivalence in gender-role attitudes in comparative perspective. International Journal of Comparative Sociology, 51(1–2), 33–57.

    Article  Google Scholar 

  38. Steenkamp, J. E. M., & Baumgartner, H. (1998). Assessing measurement invariance in cross-national consumer research. Journal of Consumer Research, 25(1), 78–107. doi:10.1086/209528.

    Article  Google Scholar 

  39. Van de Vijver, F. J. R. (1998). Towards a theory of Bias and equivalence. ZUMA-Nachrichten Spezial, 3, 41–65.

  40. Van de Vijver, F. J. R., & Poortinga, Y. H. (1982). Cross-cultural generalization and universality. Journal of Cross-Cultural Psychology, 13(4), 387–408.

    Article  Google Scholar 

  41. Walby, S. (1994). Methodological and theoretical issues in the comparative analysis of gender relations in Western Europe. Environment and Planning A26(9), 1339–1354.

  42. Wilcox, C., & Jelen, T. (1991). The Effect of Employment and religion on Women’s feminist Attitudes. International Journal for the Psychology of Religion, 1(3), 161–171.

    Article  Google Scholar 

  43. Wrigley, J. (2005). Education and gender equality. London: Taylor & Francis.

    Google Scholar 

  44. Yuchtman-Yaar, E., & Alkalay, Y. (2007). Religious zones, economic development and modern value orientations: Individual versus contextual effects. Social Science Research, 36, 789–807.

    Article  Google Scholar 

  45. Zvonkovic, A. M., et al. (1996). The martial construction of gender through work and family decisions: A qualitative analysis. Journal of Marriage and Family, 58(1), 91–100.

    Article  Google Scholar 

Download references

Acknowledgments

An earlier version of this article was presented at The Second International Sociological Association Forum of Sociology, Buenos Aires, 01-04.08 2012. We are indebted to Professor Hans-Jürgen Andreß, Paula Tufiş, Bogdan Voicu, and to the Social Indicators Research’s anonymous reviewers for helpful comments on this paper. Both authors have equally contributed to this paper.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Andreea Constantin.

Additional information

Andreea Constantin and Malina Voicu have contributed equally to this work.

Appendix

Appendix

See Tables 6, 7, and 8.

Table 6 Descriptive statistics for the items measuring attitudes towards gender roles in ISSP 2002 and WVS 2005
Table 7 Descriptive statistics of factor loadings of Exploratory Factor Analysis – WVS 2005
Table 8 Descriptive statistics of factor loadings of Exploratory Factor Analysis – ISSP 2002

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Constantin, A., Voicu, M. Attitudes Towards Gender Roles in Cross-Cultural Surveys: Content Validity and Cross-Cultural Measurement Invariance. Soc Indic Res 123, 733–751 (2015). https://doi.org/10.1007/s11205-014-0758-8

Download citation

Keywords

  • Gender roles
  • Social attitudes
  • Content validity
  • Multigroup confirmatory factor analysis
  • International social survey program (ISSP)
  • World values survey (WVS)