Comparative European Politics

, Volume 11, Issue 5, pp 555–576 | Cite as

Validating integration and citizenship policy indices

  • Marc Helbling
Original Article


After a long period of mostly case study research, in the recent past various integration and citizenship policy scholars have started to compare a relatively large range of countries by constructing policy indices. As there are almost as many indices as there are such studies, one might wonder whether it matters which indices we use. The main goal of this article is to compare these indices and to investigate commonalities and differences. By means of content, convergent and construct validity tests, methodological strengths and weaknesses will be discussed. It will be shown that most of the indices consist of different components and are sometimes weakly related to each other even if they can be explained by similar factors. An overview of the current state of research in this field allows us to learn from the innovative ideas that have been developed so far and to discuss the next steps to be taken.


index citizenship integration validity 



I would like to thank Sara Goodman Wallace, Edward Koning, Ruud Koopmans, Enric Martinez-Herrera, Ines Michalowski, Didier Ruedin, Maarten Vink and the anonymous reviewers for their comments on previous versions of this article.


  1. Bader, V. (2007) The governance of Islam in Europe: The perils of modelling. Journal of Ethnic and Migration Studies 33 (6): 871–886.CrossRefGoogle Scholar
  2. Banting, K. and Kymlicka, W. (eds.) (2006a) Multiculturalism and the Welfare State in: Recognition and Redistribution in Contemporary Democracies. Oxford: Oxford University Press.CrossRefGoogle Scholar
  3. Banting, K. and Kymlicka, W. (eds.) (2006b) Introduction. Multiculturalism and the welfare state: Setting the context. In: Multiculturalism and the Welfare State. Recognition and Redistribution in Conteporary Democracies. Oxford: Oxford University Press, pp. 1–45.CrossRefGoogle Scholar
  4. Banting, K. and Kymlicka, W. (forthcoming) Is there really a backlash against multiculturalism policies? New evidence from the multiculturalism policy index. Comparative European Politics.Google Scholar
  5. Banting, K., Johnston, R., Kymlicka, W. and Soroka, S. (2006) Do multiculturalism policies erode the welfare state? An empirical analysis. In: K. Banting and W. Kymlicka (eds.) Multiculturalism and the Welfare State. Recognition and Redistribution in Conteporary Democracies. Oxford: Oxford University Press, pp. 49–91.CrossRefGoogle Scholar
  6. Bjerre, L., Helbling, M., Römer, F. and Zobel, M. (2013) Conceptualizing and Measuring Immigration Policies. A Comparative Perspective Manuscript under review.Google Scholar
  7. Bollen, K.A. (1989) Structural Equations with Latent Variables. New York: John Wiley and Sons.CrossRefGoogle Scholar
  8. Bolliger, C. (2004) Spielt es eine Rolle, wer entscheidet? Einbürgerungen in Gemeinden mit Parlaments- und Volksentscheid im Vergleich. In: P. Steiner and H-R. Wicker (eds.) Paradoxien im Bürgerrecht. Sozialwissenschaftliche Studien zur Einbürgerungspraxis in Schweizer Gemeinden. Zürich: Seismo, pp. 43–61.Google Scholar
  9. Brubaker, R. (1992) Citizenship and Nationhood in France and Germany. Cambridge, MA: Harvard University Press.Google Scholar
  10. Brubaker, R. (2010) Migration, membership, and the modern nation-state: Internal and external dimensions of the politics of belonging. Journal of Interdisciplinary History 41 (1): 61–78.CrossRefGoogle Scholar
  11. Bultmann, P.F. (1999) Lokale Gerechtigkeit im Einbürgerungsrecht. Berlin, Germany: Duncker&Humblot.Google Scholar
  12. Carmines, E.G. and Zeller, R.A. (1979) Reliability and Validity Assessment. Beverly Hills, CA and London: SAGE Publications.CrossRefGoogle Scholar
  13. Casper, G. and Tufis, C. (2003) Correlation versus interchangeability: The limited robustness of empirical findings on democracy using highly correlated data sets. Political Analysis 11 (2): 196–203.CrossRefGoogle Scholar
  14. Cerna, L. (2008) Towards an EU Blue Card? The delegation of National High Skilled Immigration Policies to the EU level. Oxford University, Centre on Migration, Policy and Society (COMPAS) Working Paper Series, July 2011.Google Scholar
  15. Cinar, D., Hofinger, C. and Waldrauch, H. (1995) Integrationsindex. Zur rechtlichen Integration von AusländerInnen in ausgewählten europäischen Ländern. Political Science Series No. 25. Vienna, Austria: Institute for Advanced Studies.Google Scholar
  16. Coppedge, M. and Gerring, J. (2011) Conceptualizing and measuring democracy: A new approach. Perspectives on Politics 9 (2): 247–267.CrossRefGoogle Scholar
  17. Crepaz, M. (2006) ‘If you are my brother, I may give you a dime!’ Public opinion on multiculturalism, trust and the welfare state. In: K. Banting and W. Kymlicka (eds.) Multiculturalism and the Welfare State. Recognition and Redistribution in Conteporary Democracies. Oxford: Oxford University Press, pp. 92–117.CrossRefGoogle Scholar
  18. Dinesen, P. and Hooghe, M. (2010) When in Rome, Do as The Romans Do: The acculturation of generalized trust among immigrants in Western Europe. International Migration Review 44 (3): 697–727.CrossRefGoogle Scholar
  19. Dornis, C. (1999) Einbürgerung in Deutschland: Eine vergleichende Untersuchung der Verwaltungspraxis in verschiedenen Regionen. Demographie aktuell (15). Berlin, Germany: Humbold-Universität.Google Scholar
  20. Dornis, C. (2001) Einbürgerung in Deutschland: Die Verwaltungspraxis in verschiedenen Regionen im Vergleich. In: L. Akgün and D. Thränhardt (eds.) Integrationspolitik in föderalistischen Systemen (Jahrbuch Migration). Münster, Germany: Lit, pp. 63–99.Google Scholar
  21. Dronkers, J. and Vink, M.P. (2012) Explaining access to citizenship in Europe: How policies affect naturalisation rates. European Union Politics 13 (3): 390–412.CrossRefGoogle Scholar
  22. Elkins, Z. (2000) Gradations of democracy? Empirical tests of alternative conceptualizations. American Journal of Political Science 44 (2): 293–300.CrossRefGoogle Scholar
  23. Fleischmann, F. and Dronkers, J. (2010) Unemployment among immigrants in European labour markets: An analysis of origin and destination effects. Work, Employment and Society 24 (2): 337–354.CrossRefGoogle Scholar
  24. Givens, T. and Luedtke, A. (2005) European immigration policies in comparative perspective: Issue salience, partisanship and immigrant rights. Comparative European Politics 3 (1): 1–22.CrossRefGoogle Scholar
  25. Goodman, S.W. (2010) Integration requirements for integration’s sake? Identifying, categorising and comparing civic integration policies. Journal of Ethnic and Migration Studies 36 (5): 753–772.CrossRefGoogle Scholar
  26. Goodman, S.W. (2012) Measurement and interpretation issues in civic integration studies: A rejoinder. Journal of Ethnic and Migration Studies 38 (1): 173–186.CrossRefGoogle Scholar
  27. Hagedorn, H. (2001a) Föderalismus und die deutsche Staatsangehörigkeit: Die Einbürgerungspolitik der Bundesländer. In: L. Akgün and D. Thränhardt (eds.) Integrationspolitik in föderalistischen Systemen (Jahrbuch Migration). Münster, Germany: Lit, pp. 91–117.Google Scholar
  28. Hagedorn, H. (2001b) Einbürgerungspolitik in Deutschland und Frankreich. Leviathan 29 (1): 36–57.CrossRefGoogle Scholar
  29. Hammar, T. (1990) Democracy and the Nation State. Aliens, Denizens and Citizens in a World of International Migration. Aldershot: Avebury.Google Scholar
  30. Hatton, T.J. (2004) Seeking asylum in Europe. Economic Policy 19 (38): 5–62.CrossRefGoogle Scholar
  31. Helbling, M. (2008) Practising Citizenship and Heterogeneous Nationhood. Naturalisations in Swiss Municipalities. Amsterdam, the Netherlands: Amsterdam University Press.CrossRefGoogle Scholar
  32. Helbling, M. and Tresch, A. (2011) Measuring party positions and issue salience from media coverage: Discussing and crossvalidating new indices. Electoral Studies 30 (1): 174–183.CrossRefGoogle Scholar
  33. Helbling, M., Bjerre, L., Römer, F. and Zobel, M. (eds.) (2013) How to measure immigration policies. In: APSA Newsletter Migration and Citizenship. Issue 2 (forthcoming).Google Scholar
  34. Herrera, Y.M. and Kapur, D. (2007) Improving data quality: Actors, incentives, and capabilities. Political Analysis 15 (4): 365–386.CrossRefGoogle Scholar
  35. Hooghe, M., Reeskens, T., Stolle, D. and Trappers, A. (2009) Ethnic diversity and generalized trust in Europe. A cross-national multilevel study. Comparative Political Studies 42 (2): 198–223.CrossRefGoogle Scholar
  36. Howard, M.M. (2006) Comparative citizenship: An agenda for cross-national research. Perspectives on Politics 4 (3): 443–455.CrossRefGoogle Scholar
  37. Howard, M.M. (2009) The Politics of Citizenship in Europe. New York: Cambridge University Press.CrossRefGoogle Scholar
  38. Huddleston, T. and Niessen, J. (2011) Migration Integration Policy Index III, British Council and Migration Policy Group.Google Scholar
  39. Janoski, T. (2010) The Ironies of Citizenship: Naturalization and Integration in Industrialized Countries. New York: Cambridge University Press.CrossRefGoogle Scholar
  40. Janoski, T. (forthcoming) Foreigners acquiring citizenship in advanced industrialized countries: The complexities of measuring naturalization rates. Comparative European Politics.Google Scholar
  41. Jeffers, K., Honohan, I. and Bauböck, R. (2012) CITLAW indicators: How to measure the purposes of citizenship laws. San Domenico di Fiesole: EUDO CITIZENSHIP Observatory,
  42. Kesler, C. and Bloemraad, I. (2010) Does immigration erode social capital? The conditional effects of immigration-generated diversity on trust, membership and participation across 19 countries, 1981–2000. Canadian Journal of Political Science 43 (2): 319–347.CrossRefGoogle Scholar
  43. Klugman, J. and Pereira, I.M. (2009) Assessment of National Migration Policies: An Emerging Picture on Admissions, Treatment and Enforcement in Developing and Developed Countries. United Nations Development Programme: Human Development Research Paper 2009/48.Google Scholar
  44. Koning, E.A. (2011) Ethnic and civic dealings with newcomers: Naturalization policies and practices in twenty-six immigration countries. Ethnic and Racial Studies 34 (11): 1974–1994.CrossRefGoogle Scholar
  45. Koopmans, R. and Kriesi, H. (1997) Citoyenneté, identité nationale et mobilisation de l’extrême droite. Une comparaison entre la France, l’Allemagne, les Pays-Bas et la Suisse. In: P. Birnbaum (ed.) Sociologie des Nationalismes. Paris, France: Presses Universitaires de France, pp. 295–324.Google Scholar
  46. Koopmans, R., Statham, P., Giugni, M. and Passy, F. (2005) Contested Citizenship: Immigration and Cultural Diversity in Europe. Minneapolis, MN and London: University of Minnesota Press.Google Scholar
  47. Koopmans, R., Michalowski, I. and Waibel, S. (2012) Citizenship rights for immigrants: National political processes and cross-national convergence in Western Europe, 1980–2008. American Journal of Sociology 117 (4): 1202–1245.CrossRefGoogle Scholar
  48. Ludvig, A. (2004) Why should Austria be different from Germany? The two recent nationality reforms in contrast. German Politics 13 (3): 499–515.CrossRefGoogle Scholar
  49. Manatschal, A. (2012) Path dependent or dynamic? Cantonal integration policies between regional citizenship traditions and right populist party politics. Ethnic and Racial Studies 35 (2): 281–297.Google Scholar
  50. Manatschal, A. and Stadelmann-Steffen, I. (2013) Cantonal variations of integration policy and their impact on immigrant educational inequality. Comparative European Politics 11 (5): 671–695.CrossRefGoogle Scholar
  51. Marks, G., Hooghe, L., Steenbergen, M.R. and Bakker, R. (2007) Crossvalidating data on party positioning on European integration. Electoral Studies 26 (1): 23–38.CrossRefGoogle Scholar
  52. McLaren, L.M. (2010) Cause for Concern? The Impact of Immigration on Political Trust, Policy Network, The-impact-of-immigration-on-political-trust, accessed 20 September 2010.
  53. Michalowski, I. and Van Oers, R. (2012) How can we categorize and interpret civic integration policies? Journal of Ethnic and Migration Studies 38 (1): 163–171.CrossRefGoogle Scholar
  54. Munck, G.L. and Verkuilen, J. (2002) Conceptualizing and measuring democracy. Evaluating alternative indices. Comparative Political Studies 35 (1): 5–34.CrossRefGoogle Scholar
  55. Niessen, J., Huddleston, T., Citron, L., Geddes, A. and Jacobs, D. (2007) Migrant Integration Policy Index. Brussels, Belgium: British Council of Migration Policy Group.Google Scholar
  56. Ray, L. (2007) Validity of measured party positions on European integration: Assumptions, approaches, and a comparison of alternative measures’. Electoral Studies 26 (1): 11–22.CrossRefGoogle Scholar
  57. Reichel, D. (2011) Do Legal Regulations Hinder Naturalization? Citizenship Policies and Naturalization Rates in Europe. European University Institute, Robert Schuman Centre for Advanced Studies, EUDO Citizenship Observatory. RSCAS Working Paper 2011/51.Google Scholar
  58. Ruedin, D. (2011) The Reliability of MIPEX Indices as Scales, SOM. Working Papers no. 2011–03,, accessed April 2012.
  59. Ruhs, M. (2011) Openness, Skills and Rights: An Empirical Analysis of Labour Immigration Programmes in 46 High and Middle Income Countries. Oxford University, Centre on Migration, Policy and Society (COMPAS). Working Paper Series, July 2011.Google Scholar
  60. Skaaning, S.-E. (2010) Measuring the rule of law. Political Research Quarterly 63 (2): 449–460.CrossRefGoogle Scholar
  61. Teorell, J. and Lindstedt, C. (2010) Measuring electoral systems. Political Research Quarterly 63 (2): 434–448.CrossRefGoogle Scholar
  62. Thielemann, E.R. (2003) Does Policy Matter? On Governments' Attempts to Control Unwanted Migration, The Center of Comparative Immigration Studies, University of California, San Diego. Working Paper no. 112, December 2004.Google Scholar
  63. Thränhardt, D. (2008) Einbürgerung Rahmenbedingungen, Motive und Perspektiven des Erwerbs der deutschen Staatsangehörigkeit. Bonn, Germany: Friedrich-Ebert-Stiftung.Google Scholar
  64. Tilly, C. (1995) Citizenship, identity and social history. International Review of Social History 40 (3): 1–17.CrossRefGoogle Scholar
  65. Vink, M. (2011) Naturalisation rates and rejection rates measure different phenomena, and have different problems. In: R. Bauböck and M. Helbling (eds.) Which Indices are Most Useful for Comparing Citizenship Policies? European University Institute, Robert Schuman Centre for Advanced Studies, EUDO Citizenship Observatory. RSCAS Working Paper, pp. 11–14.Google Scholar
  66. Vink, M.P. and Bauböck, R. (2013) Citizenship configurations: Analysing the multiple purposes of citizenship regimes in Europe. Comparative European Politics.Google Scholar
  67. Waldrauch, H. and Hofinger, C. (1997) An index to measure the legal obstacles to the integration of migrants. New Community 23 (2): 271–285.Google Scholar
  68. Weber, M. (1946) From Max Weber: Essays in Sociology. New York: Oxford University Press.Google Scholar

Copyright information

© Palgrave Macmillan, a division of Macmillan Publishers Ltd 2013

Authors and Affiliations

  • Marc Helbling
    • 1
  1. 1.Social Science Research Center Berlin (WZB)Germany

Personalised recommendations