Skip to main content

Advertisement

SpringerLink
Log in

From Dependent to Independent Variable: A Critical Assessment of Operationalisations of ‘Welfare Stateness’ as Macro-Level Indicators in Multilevel Analyses

  • Published:
Social Indicators Research Aims and scope Submit manuscript

Abstract

This paper explores different ways to operationalise properties of the welfare state as explanatory variable in multilevel frameworks. Based on the observation that many common applications of welfare state measurements as independent macro-level variables lack standardised proceeding, differences between commonly used approaches (single indicators, regime typologies, and composite indices) are examined concerning their consequences for empirical results and their comparability. Each approach is first discussed regarding conceptual premises and practical applications in the literature. In a second step, differences are demonstrated empirically by performing several multilevel analyses using welfare attitudes as an exemplary dependent variable. The comparison shows that even slight differences in the operationalisation have an impact on the results and their explanatory contribution. Based on this, the paper offers possible points of departure for the development of more fitting operationalisations for the specific use as explanatory instruments. This includes criteria a measurement should meet and a stronger focus on capturing the relevant causal mechanisms assumed to be at work. The aim of this paper is thus twofold. On the one hand, it provides an overview of existing strategies and raises awareness to critical issues. On the other hand, it gives some initial pointers for a conceptual debate about how to turn characteristics of the welfare state into macro-level indicators, which can serve as independent variable.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

Notes

  1. E.g. multilevel regression analysis or fixed effect models.

  2. As indicators underlying the construction of typologies or as part of generosity measures.

  3. Among other issues, differences in the replacement rates are due to the calculation of taxes and the referenced period of time in which a benefit is received.

  4. The extent to which social policies reproduce, increase or decrease social inequality.

  5. The extent to which one’s social protection is detached from the market.

  6. The importance of different providers of welfare (state, family, and market).

  7. A miscalculation in the decommodification score for several countries led to a misclassification of several countries (e.g. discussed by Bambra 2006).

  8. Naren Prasad at the United Nations Research Institute proposed the SPI for Social Development in 2006. No final version of the index has been published apart from a research proposal, which has been picked up by other researchers (e.g. Garcés Ferrer et al. 2016).

  9. EU member states (in 2008) plus Norway and Switzerland.

  10. AT, BE, BG, CH, CZ, DE, DK, EE, ES, FI, FR, GB, HU, LT, LV, NO, PL, PT, SE, SI, SK.

  11. Missing data on coverage of unemployment insurance was added from the SIED (Social Policy Indicator Database (SPIN) 2015).

  12. Based on ESS data: NL, IE, CY, GR, RO are added.

References

  • Angel, S., & Heitzmann, K. (2015). Over-indebtedness in Europe: The relevance of country-level variables for the over-indebtedness of private households. Journal of European Social Policy, 25(3), 331–351.

    Article  Google Scholar 

  • Arikan, G., & Ben-Nun Bloom, P. (2015). Social values and cross-national differences in attitudes towards welfare. Political Studies, 63(2), 431–448.

    Article  Google Scholar 

  • Arts, W., & Gelissen, J. (2001). Welfare states, solidarity and justice principles: Does the type really matter? Acta Sociologica, 44(4), 283–299.

    Article  Google Scholar 

  • Arts, W., & Gelissen, J. (2002). Three worlds of welfare capitalism or more? A state-of-the-art report. Journal of European Social Policy, 12(2), 137–158.

    Article  Google Scholar 

  • Arundel, R., & Lennartz, C. (2017). Returning to the parental home: Boomerang moves of younger adults and the welfare regime context. Journal of European Social Policy, 27(3), 276–294.

    Article  Google Scholar 

  • Bambra, C. (2005). Cash versus services: ‘Worlds of welfare’ and the decommodification of cash benefits and health care services. Journal of Social Policy, 34(2), 195–213.

    Article  Google Scholar 

  • Bambra, C. (2006). Decommodification and the worlds of welfare revisited. Journal of European Social Policy, 16(1), 73–80.

    Article  Google Scholar 

  • Bambra, C. (2007). ‘Sifting the wheat from the chaff’: A two-dimensional discriminant analysis of welfare state regime theory. Social Policy & Administration, 41(1), 1–28.

    Article  Google Scholar 

  • Bambra, C., Lunau, T., van der Wel, K. A., Eikemo, T. A., & Dragano, N. (2014). Work, health, and welfare: the association between working conditions, welfare states, and self-reported general health in Europe. International Journal of Health Services, 44(1), 113–136.

    Article  Google Scholar 

  • Bergqvist, K., Yngwe, M. Å., & Lundberg, O. (2013). Understanding the role of welfare state characteristics for health and inequalities: An analytical review. BMC Public Health, 13(1), 1–20.

    Article  Google Scholar 

  • Bolukbasi, H. T., & Öktem, K. G. (2018). Conceptualizing and operationalizing social rights: Towards higher convergent validity in SCIP and CWED. Journal of European Social Policy, 28(1), 86–100.

    Article  Google Scholar 

  • Bonoli, G. (1997). Classifying welfare states: a two-dimension approach. Journal of Social Policy, 26(3), 351–372.

    Article  Google Scholar 

  • Castles, F., & McKinlay, R. D. (1979). Does politics matter: An analysis of the public welfare commitment in advanced democratic states. European Journal of Political Research, 7(2), 169–186.

    Article  Google Scholar 

  • Castles, F. G., & Obinger, H. (2008). Worlds, families, regimes: country clusters in European and OECD area public policy. West European Politics, 31(1–2), 321–344.

    Article  Google Scholar 

  • Clasen, J., & Siegel, N. A. (Eds.). (2007). Investigating welfare state change: The “dependent variable problem” in comparative analysis. Cheltenham: Edward Elgar.

    Google Scholar 

  • Cruz-Martínez, G. (2014). Welfare state development in Latin America and the Caribbean (1970s–2000s): Multidimensional welfare index, its methodology and results. Social Indicators Research, 119(3), 1295–1317.

    Article  Google Scholar 

  • Cruz-Martínez, G. (2017). Welfare state development, individual deprivations and income inequality: A Cross-country analysis in Latin America and the Caribbean. Social Indicators Research, 134(3), 955–979.

    Article  Google Scholar 

  • Deeming, C., & Jones, K. (2015). Investigating the macro determinants of self-rated health and well-being using the european social survey: Methodological innovations across countries and time. International Journal of Sociology, 45(4), 256–285.

    Article  Google Scholar 

  • Ebbinghaus, B. (2011). Case selection in medium-N comparative welfare state analysis. Qualitative & Multi-Method Research. APSA Section Newsletter (Fall), pp. 15–20.

  • Eger, M. A., & Breznau, N. (2017). Immigration and the welfare state: A cross-regional analysis of European welfare attitudes. International Journal of Comparative Sociology, 30, 002071521769079.

    Google Scholar 

  • Esping-Andersen, G. (1990). The three worlds of welfare capitalism. Cambridge, UK: Polity Press.

    Google Scholar 

  • Esping-Andersen, G. (1999). Social foundations of postindustrial economies. Oxford, New York: Oxford University Press.

    Book  Google Scholar 

  • European Social Survey. (2008). Round 4 (ESS 4).

  • Eurostat. (2018a). Social expenditure in 2008 (% GDP): Last updated: March 2018.

  • Eurostat. (2018b). Social expenditure unemployment (% GDP): Last updated: March 2018.

  • Ferragina, E., & Seeleib-Kaiser, M. (2011). Welfare regime debate: Past, present, futures? Policy & Politics, 39(4), 583–611.

    Article  Google Scholar 

  • Ferragina, E., Seeleib-Kaiser, M., & Tomlinson, M. (2013). Unemployment protection and family policy at the turn of the 21st century: A dynamic approach to welfare regime theory. Social Policy & Administration, 47(7), 783–805.

    Article  Google Scholar 

  • Ferrera, M. (1996). The ‘Southern model’ of welfare in social Europe. Journal of European Social Policy, 6(1), 17–37.

    Article  Google Scholar 

  • Garcés Ferrer, J., Ródenas Rigla, F., & Vidal Figueroa, C. (2016). Application of Social Policy Index (SPI) amended in three OECD countries: Finland, Spain and Mexico. Social Indicators Research, 127(2), 529–539.

    Article  Google Scholar 

  • Green-Pedersen, C. (2004). The dependent variable problem within the study of welfare state retrenchment: Defining the problem and looking for solutions. Journal of Comparative Policy Analysis: Research and Practice, 6(1), 3–14.

    Article  Google Scholar 

  • Howell, D. R., & Rehm, M. (2009). Unemployment compensation and high European unemployment: A reassessment with new benefit indicators. Oxford Review of Economic Policy, 25(1), 60–93.

    Article  Google Scholar 

  • ISSP Research Group. (2017). International social survey programme: Social inequality IV - ISSP 2009. GESIS Data Archive, Cologne. ZA5400 Data file Version 4.0.0. Mannheim: ISSP Research Group.

    Google Scholar 

  • Jæger, M. M. (2006). Welfare regimes and attitudes towards redistribution: The regime hypothesis revisited. European Sociological Review, 22(2), 157–170.

    Article  Google Scholar 

  • Jæger, M. M. (2009). United but divided: Welfare regimes and the level and variance in public support for redistribution. European Sociological Review, 25(6), 723–737.

    Article  Google Scholar 

  • Jæger, M. M. (2013). The effect of macroeconomic and social conditions on the demand for redistribution: A pseudo panel approach. Journal of European Social Policy, 23(2), 149–163.

    Article  Google Scholar 

  • Jaime-Castillo, A. M. (2013). Public opinion and the reform of the pension systems in Europe: The influence of solidarity principles. Journal of European Social Policy, 23(4), 390–405.

    Article  Google Scholar 

  • Jakobsen, T. G. (2010). Public versus private: The conditional effect of state policy and institutional trust on mass opinion. European Sociological Review, 26(3), 307–318.

    Article  Google Scholar 

  • Jakobsen, T. G. (2011). Welfare attitudes and social expenditure: Do regimes shape public opinion? Social Indicators Research, 101(3), 323–340.

    Article  Google Scholar 

  • Jensen, C. (2011). Less bad than its reputation: Social spending as a proxy for welfare effort in cross-national studies. Journal of Comparative Policy Analysis: Research and Practice, 13(3), 327–340.

    Article  Google Scholar 

  • Jordan, J. (2013). Policy feedback and support for the welfare state. Journal of European Social Policy, 23(2), 134–148.

    Article  Google Scholar 

  • Kühner, S. (2007). Country-level comparisons of welfare state change measures: another facet of the dependent variable problem within the comparative analysis of the welfare state?: ESPA net/JESP Doctoral Researcher Prize Essay. Journal of European Social Policy, 17(1), 5–18.

    Article  Google Scholar 

  • Kuitto, K. (2011). More than just money: Patterns of disaggregated welfare expenditure in the enlarged Europe. Journal of European Social Policy, 21(4), 348–364.

    Article  Google Scholar 

  • Kuitto, K. (2016). Measuring welfare entitlement generosity in transitional welfare states: The case of post-communist countries in central and Eastern Europe. Social Indicators Research, 136, 1–22.

    Google Scholar 

  • Kulin, J., & Meuleman, B. (2015). Human values and welfare state support in Europe: An east-west divide? European Sociological Review, 31(4), 418–432.

    Article  Google Scholar 

  • Kvist, J. (2011). One-size-fits-all? Measurement issues in medium-N comparative welfare analysis. Qualitative & Multi-Method Research. APSA Section Newsletter, 9(Fall), 20–25.

    Google Scholar 

  • Lohmann, H., & Zagel, H. (2016). Family policy in comparative perspective: The concepts and measurement of familization and defamilization. Journal of European Social Policy, 26(1), 48–65.

    Article  Google Scholar 

  • Mattila, M., & Rapeli, L. (2018). Just sick of it?: Health and political trust in Western Europe. European Journal of Political Research, 57(1), 116–134.

    Article  Google Scholar 

  • Menahem, G. (2007). The decommodified security ratio: A tool for assessing European social protection systems. International Social Security Review, 60(4), 69–103.

    Article  Google Scholar 

  • Motel-Klingebiel, A., Romeu Gordo, L., & Betzin, J. (2009). Welfare states and quality of later life: Distributions and predictions in a comparative perspective. European Journal of Ageing, 6(2), 67–78.

    Article  Google Scholar 

  • Obinger, H., & Wagschal, U. (1998). Drei Welten des Wohlfahrtsstaates? Das Stratifizierungskonzept in der clusteranalytischen Überprüfung. In S. Lessenich & I. Ostner (Eds.), Welten des Wohlfahrtskapitalismus: Der Sozialstaat in vergleichender Perspektive (Vol. 40, pp. 109–135)., Theorie und Gesellschaft Frankfurt: Campus.

    Google Scholar 

  • Orloff, A. S. (1993). Gender and the social rights of citizenship: The comparative analysis of gender relations and welfare states. American Sociological Review, 58(3), 303–328.

    Article  Google Scholar 

  • Pfau-Effinger, B. (2005). Culture and welfare state policies: reflections on a complex interrelation. Journal of Social Policy, 34(1), 3–20.

    Article  Google Scholar 

  • Pierson, P. (1996). The new politics of the welfare state. World Politics, 48(02), 143–179.

    Article  Google Scholar 

  • Raudenbush, S. W., & Bryk, A. S. (2012). Hierarchical linear models: Applications and data analysis methods (2nd ed., Vol. 1)., Advanced quantitative techniques in the social sciences Thousand Oaks: Sage.

    Google Scholar 

  • Rice, D. (2013). Beyond welfare regimes: From empirical typology to conceptual ideal types. Social Policy & Administration, 47(1), 93–110.

    Article  Google Scholar 

  • Roosma, F., van Oorschot, W., & Gelissen, J. (2014). The preferred role and perceived performance of the welfare state: European welfare attitudes from a multidimensional perspective. Social Science Research, 44, 200–210.

    Article  Google Scholar 

  • Schneider, C. Q., & Makszin, K. (2014). Forms of welfare capitalism and education-based participatory inequality. Socio-Economic Review, 12(2), 437–462.

    Article  Google Scholar 

  • Schuck, B., & Steiber, N. (2017). Does intergenerational educational mobility shape the well-being of young Europeans?: Evidence from the European Social Survey. Social Indicators Research, 37, 307.

    Google Scholar 

  • Scruggs, L. (2013). Measuring and validating social program replacement rates. Journal of European Public Policy, 20(9), 1267–1284.

    Article  Google Scholar 

  • Scruggs, L. (2014). Social welfare generosity scores in CWED 2: A methodological genealogy: CWED working paper 01, February 2014.

  • Scruggs, L., & Allan, J. P. (2006). Welfare-state decommodification in 18 OECD countries: A replication and revision. Journal of European Social Policy, 16(1), 55–72.

    Article  Google Scholar 

  • Scruggs, L., Jahn, D., & Kuitto, K. (2014). Comparative welfare entitlements dataset 2. version 2014-03.

  • Segura-Ubiergo, A. (2007). The political economy of the welfare state in Latin America. The political economy of the welfare state in Latin America: Globalization, democracy, and development. Cambridge: Cambridge University Press.

    Book  Google Scholar 

  • Snijders, T. A. B., & Bosker, R. J. (2012). Multilevel analysis: An introduction to basic and advanced multilevel modeling (2nd ed.). Los Angeles: Sage.

    Google Scholar 

  • Social Policy Indicator Database (SPIN). (2015). Social Insurance Entitlements Dataset (SIED).

  • Steele, L. G. (2015). Income inequality, equal opportunity, and attitudes about redistribution. Social Science Quarterly, 96(2), 444–464.

    Article  Google Scholar 

  • Stephens, J. D. (2010). The social rights of citizenship. In F. G. Castles, S. Leibfried, J. Lewis, H. Obinger, & C. Pierson (Eds.), The Oxford handbook of the welfare state (pp. 511–525). Oxford: Oxford University Press.

    Google Scholar 

  • Svallfors, S. (1997). Worlds of welfare and attitudes to redistribution: A comparison of eight western nations. European Sociological Review, 13(3), 283–304.

    Article  Google Scholar 

  • Titmuss, R. M. (1974). Social policy. An introduction: Edited by Brian Abel-Smith and Kay Titmuss. London: George Allen & Unwin Ltd.

    Google Scholar 

  • van Kersbergen, K., & Vis, B. (2015). Three worlds’ typology: Moving beyond normal science? Journal of European Social Policy, 25(1), 111–123.

    Article  Google Scholar 

  • Visser, M., Gesthuizen, M., & Scheepers, P. (2018). The crowding in hypothesis revisited: New insights into the impact of social protection expenditure on informal social capital. European Societies, 20, 1–24.

    Article  Google Scholar 

  • von dem Knesebeck, O., Vonneilich, N., & Kim, T. J. (2016). Are health care inequalities unfair? A study on public attitudes in 23 countries. International Journal for Equity in Health, 15(1), 61.

    Article  Google Scholar 

  • Wenzelburger, G., Zohlnhöfer, R., & Wolf, F. (2013). Implications of dataset choice in comparative welfare state research. Journal of European Public Policy, 20(9), 1229–1250.

    Article  Google Scholar 

Download references

Acknowledgements

I am very grateful to Gunnar Otte, Lena Zimmer, my colleagues at the Working Group of Social Stratification Research in Mainz (especially Debora Eicher and Theresa Wieland), and the anonymous referees for valuable comments on an earlier version of this paper.

Author information

Authors and Affiliations

  1. Institute of Sociology, Johannes Gutenberg-University Mainz, Jakob-Welder-Weg 12, 55128, Mainz, Germany

    Katharina Kunißen

Authors
  1. Katharina Kunißen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Katharina Kunißen.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kunißen, K. From Dependent to Independent Variable: A Critical Assessment of Operationalisations of ‘Welfare Stateness’ as Macro-Level Indicators in Multilevel Analyses. Soc Indic Res 142, 597–616 (2019). https://doi.org/10.1007/s11205-018-1930-3

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11205-018-1930-3

Keywords

Search

Navigation