Skip to main content
SpringerLink
Log in

Testing the Comparability of Different Types of Social Indicators Across Groups

  • Published:
Social Indicators Research Aims and scope Submit manuscript

Abstract

The social indicator movement has realized a considerable increase in importance during the last 50 years. This happened not the least by the publications in the journal Social Indicators Research. Social indicators have been developed for many aspects of life. The scores on these indicators often are compared through time and across groups. An essential requirement for such research is that the measures used are comparable through time and across groups. The comparability through time is not such a big problem but the comparability of measures across groups is not so obvious. This requires harmonization of indicators based on objective variables and invariance testing for indicators based on subjective and objective variables. In this paper we discuss how the comparability of different types of social indicators based on subjective and objective variables can be tested using invariance testing. This is a relevant issue because the existing testing procedure is designed for only one type of social indicators and this test is not directly applicable on the other types of social indicators.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

Notes

  1. The 1 in the square in Figs. 4, 5 and 6 represent a “variable” with a value 1 in all cases that makes the representation of the intercepts in this model possible. Given that this variable always has the value 1 this variable can be ignored in the Eqs. 2a−c.

References

  • Adcock, R., & Collier, D. (2001). Measement validity: a shared standard for qualitative and quantitative research. American Political Science Review, 95(3), 529–546.

    Article  Google Scholar 

  • Almond, G., & Verba, S. (1963). The civic culture: political attitudes and democracy in five nations. Princeton: Princeton University Press.

    Book  Google Scholar 

  • Anbrews, F. M. (1980). Comparative studies of life quality: comments on the current state of the art and some issues for future research. In A. Szalai & F. M. Andrews (Eds.), The quality of life (pp. 273–286). London: Sage Publications.

    Google Scholar 

  • Anderson, R. B. W. (1967). On the comparability of meaningful stimuli in cross cultural research. Sociometry, 30(2), 124–136.

    Article  Google Scholar 

  • Blalock, H. M., Jr. (1990). Auxilary measurement theories revisited. In J. J. Hox & J. de Jong-Gierveld (Eds.), Operationalization and research strategy (pp. 33–49). Amsterdam: Swets and Zeitlinger.

    Google Scholar 

  • Bollen, K., & Paxton, P. (1998). Detection and determinants of bias in subjective measures. American Sociological Review, 63, 465–478.

    Article  Google Scholar 

  • Byrne, B. M., Shavelson, R. J., & Muthén, B. (1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105(3), 456.

    Article  Google Scholar 

  • Coromina, L., Saris, W. E., Oberski, D. (2008). The Quality of the measurement of interest in the political issues in the media in the ESS. Ask. Research and Methods, 17(1), 7–37.

    Google Scholar 

  • Coromina, L., Saris, W., & Lilileoja L. (2012). Measurement of concepts based on the media module of the ESS. RECSM Working Paper 25.

  • Davidov, E. (2009). Meausurement equivalence of nationalism and constructive patriotism in the ISSP. 34 countries in comparative perspective. Political Analysis, 17(1), 64–82.

    Article  Google Scholar 

  • Davidov, E., Meuleman, B., Billiet, J., & Schmidt, P. (2008). Values and support for immigration: A cross-country comparison. European Sociological Review, 24, 58–99.

    Article  Google Scholar 

  • Harkness, J. (2005). ISSP Translation Work Group Report to the ISSP General Assembly. http://www.gesis.org/fileadmin/upload/dienstleistung/daten/umfragedaten/issp/ISSP_translation_report_05.pdf (Online 6 May 2009).

  • Harkness, J. A. (2008). Comparative survey research: Goal and challenges. In E. D. de Leeuw, J. J. Hox, & D. A. Dillman (Eds.), International handbook of survey methodology (pp. 56–77). New York: L. Erlbaum Associates.

    Google Scholar 

  • Harkness, J. A., & Schoua-Glusberg, A. (1998). Questionnaires in Translation. ZUMA-Nachrichten Spezial, 3, 87–126.

    Google Scholar 

  • Horn, J. L., McArdle, J., & Mason, R. (1983). When is invariance not invariant: A practical scientist’s look at the ethereal concept of factor invariance. The Southern Psychologist, 1, 179–188.

    Google Scholar 

  • Jöreskog, K. G. (1971). Simultaneous factor analysis in several populations. Psychometrika, 34, 409–426.

    Article  Google Scholar 

  • Jöreskog, K. G., & van Thillo, M. (1973). LISREL-A general computer program for estimating a linear structural equation system involving unmeasured variables (Research Report No. 73–5). Uppsala, Swed: University of Uppsala.

  • King, G., Murray, C. J. J., Solomon, J. A., & Tandon, A. (2004). Enhancing the validity and cross-cultural comparability in survey research. American Political Science Review, 98(1), 191–207.

    Article  Google Scholar 

  • Lawley, D. N., & Maxwell, A. E. (1971). Factor analysis as a statistical method. London: Butterworth.

    Google Scholar 

  • Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58, 525–543.

    Article  Google Scholar 

  • Northrop, F. S. C. (1947). The logic of the sciences and the humanities. New York: World Publishing Company.

    Google Scholar 

  • Pirralha, A., & Weber, W. (2014) Evaluations of the measurement of the concepts ‘Political Satisfaction’ and ‘Quality of state services’. RECSM Working Paper 40.

  • Przeworski, A., & Teune, H. (1966/67). Equivalence in cross-national research. Public Opinion Quarterly, 30(4), 551–568

  • Revilla, M., & Saris, W. (2012). Evaluation of the experiments in the supplementary questionnaire of the Round 5 of the ESS. Barcelona: RECSM.

    Google Scholar 

  • Rokkan, S., Verba, S., Viet, J., & Almasy, E. (1969). Comparative survey analysis. Paris: Mouton.

    Google Scholar 

  • Saris, W. E., & Gallhofer, I. N. (2004). Cross-cultural research comparability: The effects of random and systematic errors. An ESS report about the data collected in Round 1. Barcelona: RECSM.

    Google Scholar 

  • Saris, W. E., & Gallhofer, I. N. (2014). Design, evaluation and analysis of questionnaires for survey Research (2nd ed.). Hoboken: Wiley.

    Book  Google Scholar 

  • Steenkamp, J., & Baumgartner, H. (1998). Assessing measurement invariance in cross-national consumer research. Journal of Consumer Research, 25, 78–90.

    Article  Google Scholar 

  • Van der Veld, W., & Saris, W. (2011). Causess of generlized social trust. In E. Davidov, P. Schmidt, & J. Billiet (Eds.), Cross cultural research: Methods and applications (pp. 207–247). New York: Routledge.

    Google Scholar 

  • Van Deth, J. (Ed.). (1998). Comparative politics: The problem of equivalence. London: Routledge.

    Google Scholar 

  • Zavala-Rojas, D. (2012). Evaluation of the concepts ‘Trust in institutions’ and ‘Trust in authorities’ (European Social Survey Deliverable 12.4: Evaluation of questions and concepts—report 2 (Political Trust)). RECSM Working Paper 29.

  • Zavala-Rojas, D. (2016). Unpublished Ph.D. dissertation Barcelona, Universitat Pompeu Fabra.

  • Zavala-Rojas, D., & Saris, W. E. (2015). Cross cultural or cross national research? The role of language in a comparative survey (unpublished working paper).

Download references

Author information

Authors and Affiliations

  1. Research and Expertise Centre for Survey Methodology, Universitat Pompeu Fabra, Edifici Mercè Rodoreda 24, Despatx 24.406, Barcelona, Spain

    Willem E. Saris & André Pirralha

  2. European Social Survey, Universitat Pompeu Fabra, Edifici Mercè Rodoreda 24, Despatx 24.407, Barcelona, Spain

    Diana Zavala-Rojas

Authors
  1. Willem E. Saris
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. André Pirralha
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Diana Zavala-Rojas
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to André Pirralha.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Saris, W.E., Pirralha, A. & Zavala-Rojas, D. Testing the Comparability of Different Types of Social Indicators Across Groups. Soc Indic Res 135, 927–939 (2018). https://doi.org/10.1007/s11205-016-1506-z

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11205-016-1506-z

Keywords

Search

Navigation