Abstract
Based on a quantitative meta-analysis of empirical studies, this article points out a significant flaw in the Three Worlds of Welfare literature, the “variable selection problem.” Compiling, classifying, and quantitatively analysing all variables that have been employed in this literature, the article shows first that variable selection has depended more on case selection than on theory. Scholars tend to employ variables based on data availability, rather than selecting variables according to theoretical frameworks. Second, the use of welfare policy variables is mostly limited to the analysis of Organization for Economic Co-operation and Development (OECD) countries, while studies analysing non-OECD countries, where data is limited, tend to use developmental outcome variables as a proxy. This tendency harms conceptualization and operationalization of welfare regimes, as well as blur the boundary between development and welfare regimes studies. Third, the use of original Esping-Andersen variables remains very limited, undermining continuity, comparability, and reliability within the literature.
This is a preview of subscription content, access via your institution.

Notes
We contend that the use of certain political variables is necessary for capturing the political causes or effects of welfare regime changes. Our intention however is to point out a more general tendency in the literature to easily replace welfare policy variables by other variables without regarding much about the ensuing validity problems.
Here “all” does not refer to all countries in the world but rather connotes those with available comparable datasets. Kim (2015, p. 314) refers to this group of studies as those encompassing OECD and non-OECD nations on the basis of certain case selection criteria. Even if the study itself aimed at “all nation-states of the world,” as for instance in Abu Sharkh (2009), case selection was narrowed down to those reporting data or with UN or World Bank “guestimates” of national data (Kim 2015, p. 315).
In order to replicate the analysis provided in this paper, an anonymized dataset replication is uploaded online at http://bit.ly/2jFuScM.
Each observation we have refers to a variable used in a specific study. The same variable can be reused in multiple articles and we approach each instance of a specific variable as a single observation, used in a specific study. Therefore, our unit of analysis is a “variable-study” dyad. For convenience, in the rest of the article, wherever we used the term variable, we refer to a particular instance in which a variable is used by a particular article.
Exponentiated coefficients obtained from multinomial logit are called “relative risk ratios,” rather than odds ratios. We employed a multinomial logistic regression analysis since our dependent variable has more than two categories. Multinomial logit method is used to predict a nominal dependent variable given one or more independent variables. It is an extension of binomial logistic regression to allow for a dependent variable with more than two categories. As with other types of regression, multinomial logistic regression can have nominal and/or continuous independent variables and can have interactions between independent variables to predict the dependent variable.
These datasets and related documentations are available from http://datatopics.worldbank.org/aspire/, http://cwed2.org/ and http://www.spin.su.se/datasets/samip.
The 16 variables used by Esping-Andersen (1990) is as follows: 1—minimum pension replacement rate, 2—standard pension replacement rate, 3—number of years of contributions required to qualify for old age pension, 4—the share of total pension finance paid by individuals, 5—the percent of persons above pension age actually receiving a pension (take-up rate), 6—sickness benefits replacement rate, 7—number of waiting days to receive benefits, 8—number of weeks of benefit duration, 9—unemployment benefits replacement rate, 10—number of waiting days to receive benefits, 11—number of weeks of benefit duration, 12—corporatism (occupationally distinct public pension schemes), 13—etatism (measured as expenditure on pensions to government employees as percentage GDP), 14—means-tested poor relief (as a percentage of total public social expenditure), 15—private pensions (as percentage of total pensions,) and 16—private health spending (as percentage of total). In his analysis, Esping-Andersen (1990) also uses “average universalism” and “average benefit equality” measures but we excluded those in our review since these two measures are his own index calculations, hence not original variables.
Scruggs and Allan (2006, 2008) and Powell and Barrientos (2004) are examples of good practice. They have used genuine social policy variables to represent welfare state efforts. Castles and Obinger (2008) can be cited as two examples for the type of flaws that dominate the literature. In their cluster analysis, they mixed different types of variables to estimate welfare regimes, including total fertility rate, public sector employment, social security contributions, direct taxes, indirect taxes, inflation, unemployment, education expenditure, subsidies, male employment, social transfers, total tax revenues, female employment, outlays of government, economic growth.
References
Abrahamson, P. (1999). The welfare modelling business. Social Policy & Administration, 33, 394–415. https://doi.org/10.1111/1467-9515.00160.
Abu Sharkh, M. (2009). Global welfare mixes and wellbeing: cluster, factor and regression analyses from 1990 to 2000. Retrieved from Centre for Democracy, Development and the Rule of Law (CDDRL) at Stanford University website: http://cddrl.fsi.stanford.edu/sites/default/files/No_94_Sharkh_Global_welfare.pdf.
Abu Sharkh, M., & Gough, I. (2010). Global welfare regimes: A cluster analysis. Global Social Policy, 10, 27–58. https://doi.org/10.1177/1468018109355035.
Appadurai, A. (1988). Putting hierarchy in its place. Cultural Anthropology, 3(1), 36–49.
Araghi, F. A. (1995). Global depeasantization, 1945–1990. The Sociological Quarterly, 36(2), 337–368.
Arts, W., & Gelissen, J. (2010). Models of the welfare state. In F. G. Castles, S. Leibfried, & J. Lewis (Eds.), The Oxford handbook of the welfare state (pp. 569–583). Oxford: Oxford University Press.
Bambra, C. (2004). The worlds of welfare: Illusory and gender blind? Social Policy and Society, 3, 201–211. https://doi.org/10.1017/s147474640400171x.
Bambra, C. (2005). Cash versus services: ‘Worlds of welfare’ and the decommodification of cash benefits and health care services. Journal of Social Policy, 34, 195–213. https://doi.org/10.1017/s0047279404008542.
Bambra, C. (2006). Research note: Decommodification and the worlds of welfare revisited. Journal of European Social Policy, 16, 73–80. https://doi.org/10.1177/0958928706059835.
Bambra, C. (2007). Defamilisation and welfare state regimes: A cluster analysis. International Journal of Social Welfare, 16(4), 326–338. https://doi.org/10.1111/j.1468-2397.2007.00486.x.
Barrientos, A. (2015). ‘A veritable mountain of data and years of endless statistical manipulation’: Methods in the three worlds and after. Social Policy and Society, 14, 259–270. https://doi.org/10.1017/s1474746414000578.
Bernstein, H. (2010). Class dynamics of agrarian change. Hartford: Kumarian Press.
Castles, F. G., & Obinger, H. (2008). Worlds, families, regimes: Country clusters in European and OECD area public policy. West European Politics, 31, 321–344. https://doi.org/10.1080/01402380701835140.
Chakrabarty, D. (2007). Provincializing Europe: Postcolonial thought and historical difference—new edition (1st ed.). Princeton, NJ: Princeton University Press.
Clasen, J., & Siegel, N. A. (2007). Comparative welfare state analysis and the ‘dependent variable problem’. In J. Clasen & N. A. Siegel (Eds.), Investigating welfare state change: The ‘dependent variable problem’ in comparative analysis (pp. 3–12). Retrieved from http://rszarf.ips.uw.edu.pl/welfare-state/clasen.pdf.
Danforth, B. (2014). Worlds of welfare in time: A historical reassessment of the three-world typology. Journal of European Social Policy, 24, 164–182. https://doi.org/10.1177/0958928713517919.
Ebbinghaus, B. (2012, September). Comparing welfare state regimes: Are typologies an ideal or realistic strategy? Paper presented at European Social Policy Analysis Network Conference, Edinburgh, UK. Retrieved from http://www.cas.ed.ac.uk/__data/assets/pdf_file/0005/89033/Ebbinghaus_-_Stream_2.pdf.
Eger, M. A., & Breznau, N. (2017). Immigration and the welfare state: A cross-regional analysis of European welfare attitudes. International Journal of Comparative Sociology, 58(5), 440–463.
Elyachar, J. (2005). Markets of dispossession: NGOs, economic development, and the state in Cairo (49320th ed.). Durham: Duke University Press Books.
Emmenegger, P., Kvist, J., & Marx, P. (2015). Three worlds of welfare capitalism: The making of a classic. Journal of European Social Policy, 25, 3–13. https://doi.org/10.1177/0958928714556966.
Esping-Andersen, G. (1990). The three worlds of welfare capitalism. Princeton, NJ: Princeton University Press.
Esping-Andersen, G. (1996). Welfare states in transition: National adaptations in global economies. London: Sage.
Esping-Andersen, G. (1999). Social foundations of post-industrial economies. New York: Oxford University Press.
Fabian, J., & Bunzl, M. (2002). Time and the other: How anthropology makes its object (unknown ed.). New York: Columbia University Press.
Ferguson, J. (2006). Global shadows: Africa in the neoliberal world order (1st ed.). Durham, NC: Duke University Press Books.
Ferragina, E., & Seeleib-Kaiser, M. (2011). Thematic review: Welfare regime debate: past, present, futures? Policy and Politics, 39(4), 583–611.
Ferragina, E., Seeleib-Kaiser, M., & Spreckelsen, T. (2015). The four worlds of ‘welfare reality’: Social risks and outcomes in Europe. Social Policy and Society, 14, 287–307. https://doi.org/10.1017/s1474746414000530.
Ferragina, E., Seeleib-Kaiser, M., & Tomlinson, M. (2012). Unemployment protection and family policy at the turn of the 21st century: A dynamic approach to welfare regime theory. Social Policy and Administration, 47(7), 783–805.
Ferrera, M. (1996). The ‘southern model’ of welfare in social Europe. Journal of European Social Policy, 6, 17–37. https://doi.org/10.1177/095892879600600102.
Franzoni, J. M. (2008). Welfare regimes in Latin America: Capturing constellations of markets, families, and policies. Latin American Politics and Society, 50, 67–100. https://doi.org/10.1111/j.1548-2456.2008.00013.x.
Goodin, R. E. (2001). Work and welfare: Towards a post-productivist welfare regime. British Journal of Political Science, 31, 13–39. https://doi.org/10.1017/s0007123401000023.
Gough, I. (2004). Welfare regimes in development contexts: a global and regional analysis. In I. Gough & G. Wood (Eds.), Insecurity and Welfare Regimes in Asia, Africa and Latin America (pp. 15–48). New York: Cambridge University Press.
Gough, I. (2013). Social policy regimes in the developing world. In P. Kennett (Ed.), A handbook of comparative social policy (pp. 205–224). Cheltenham: Edward Elgar.
Gough, D., Oliver, S., & Thomas, J. (2012). An introduction to systematic reviews. London and Thousand Oaks, CA: Sage.
Gough, I., & Wood, G. (2004). Insecurity and Welfare Regimes in Asia, Africa and Latin America. New York: Cambridge University Press.
Gough, I., & Wood, G. (2006). A comparative welfare regime approach to global social policy. World Development, 34, 1696–1712. https://doi.org/10.1016/j.worlddev.2006.02.001.
Green-Pedersen, C. (2004). The dependent variable problem within the study of welfare state retrenchment: Defining the problem and looking for solutions. Journal of Comparative Policy Analysis: Research and Practice, 6, 3–14. https://doi.org/10.1080/1387698042000222763.
Harvey, D. (2006). Spaces of Global Capitalism: A Theory of Uneven Geographical Development. London: Verso.
Howlett, M., & Cashore, B. (2009). The dependent variable problem in the study of policy change: Understanding policy change as a methodological problem. Journal of Comparative Policy Analysis: Research and Practice, 11, 33–46. https://doi.org/10.1080/13876980802648144.
Hudson, J., & Kühner, S. (2009). Towards productive welfare? A comparative analysis of 23 OECD countries. Journal of European Social Policy, 19, 34–46. https://doi.org/10.1177/0958928708098522.
Hudson, J., & Kühner, S. (2012). Analysing the productive and protective dimensions of welfare: Looking beyond the OECD. Social Policy & Administration, 46, 35–60. https://doi.org/10.1111/j.1467-9515.2011.00813.x.
Kangas, O. (1994). The politics of social security: On regressions, qualitative comparisons, and cluster analysis. In T. Janosk & A. M. Hicks (Eds.), The comparative political economy of the welfare state (pp. 346–364). Cambridge: Cambridge University Press.
Kim, K. (2015). From worlds to cases: Case selection and ‘other worlds’ in the welfare modelling business. Social Policy and Society, 14, 309–321. https://doi.org/10.1017/s1474746414000554.
Korpi, W., & Palme, J. (1998). The paradox of redistribution and strategies of equality: Welfare state institutions, inequality, and poverty in the western countries. American Sociological Review, 63, 661–687. Retrieved from http://www.jstor.org/stable/2657333.
Kühner, S. (2007). Country-level comparisons of welfare state change measures: Another facet of the dependent variable problem within the comparative analysis of the welfare state. Journal of European Social Policy, 17, 5–18. https://doi.org/10.1177/0958928707071875.
Minas, C., Jacobson, D., Antoniou, E., & McMullen, C. (2014). Welfare regime, welfare pillar and Southern Europe. Journal of European Social Policy, 24, 135–149. https://doi.org/10.1177/0958928713517917.
Obinger, H., & Wagschal, U. (2001). Families of nations and public policy. West European Politics, 24, 99–114. https://doi.org/10.1080/01402380108425419.
Piot, C. (1999). Remotely global: Village modernity in West Africa (1st ed.). Chicago: University of Chicago Press.
Portes, A., Castells, M., & Benton, L. A. (1989). The informal economy: Studies in advanced and less advanced countries. Baltimore: Johns Hopkins University Press.
Powell, M., & Barrientos, A. (2004). Welfare regimes and the welfare mix. European Journal of Political Research, 43, 83–105. https://doi.org/10.1111/j.1475-6765.2004.00146.x.
Powell, M., & Barrientos, A. (2011). An audit of the welfare modelling business. Social Policy & Administration, 45(1), 69–84. https://doi.org/10.1111/j.1467-9515.2010.00754.x.
Powell, M., & Kim, K. (2014). The ‘Chameleon’ Korean welfare regime. Social Policy & Administration, 48(6), 626–646.
Ragin, C. (1994). A qualitative comparative analysis of pension systems. In T. Janosk & A. M. Hicks (Eds.), The comparative political economy of the welfare state (pp. 320–345). Cambridge: Cambridge University Press.
Rice, D. (2013). Beyond welfare regimes: From empirical typology to conceptual ideal types. Social Policy & Administration, 47(1), 93–110.
Rudra, N. (2007). Welfare states in developing countries: Unique or universal? Journal of Politics, 69, 378–396. https://doi.org/10.1111/j.1468-2508.2007.00538.x.
Said, E. W. (1979). Orientalism (1st Vintage Books ed edition). New York: Vintage.
Saint-Arnaud, S., & Bernard, P. (2003). Convergence or resilience? A hierarchical cluster analysis of the welfare regimes in advanced countries. Current Sociology, 51, 499–527. https://doi.org/10.1177/00113921030515004.
Schröder, M. (2009). Integrating welfare and production typologies: How refinements of the varieties of capitalism approach call for a combination of welfare typologies. Journal of Social Policy, 38, 19–43. https://doi.org/10.1017/s0047279408002535.
Scruggs, L., & Allan, J. P. (2006). The material consequences of welfare states: Benefit generosity and absolute poverty in 16 OECD countries. Comparative Political Studies, 39, 880–904. https://doi.org/10.1177/0010414005281935.
Scruggs, L., & Allan, J. P. (2008). Social stratification and welfare regimes for the twenty-first century: Revisiting the three worlds of welfare capitalism. World Politics, 60, 642–664. https://doi.org/10.1353/wp.0.0020.
Shalev, M. (1996). The privatization of social policy? Occupational welfare and the welfare state in America, Scandinavia, and Japan. Basingstoke: Palgrave Macmillan.
Shalev, M. (2007). Limits and alternatives to multiple regression in comparative research. In L. Mjøset & T. H. Clausen (Eds.), Capitalisms compared. Comparative social research (Vol. 24, pp. 261–308). Emerald Group Publishing Limited. Retrieved from http://www.emeraldinsight.com/doi/abs/10.1016/S0195-6310(06)24006-7.
Siaroff, A. (1994). Work, welfare and gender equality: A new typology. In D. Sainsbury (Ed.), Gendering welfare states (pp. 82–100). London: Sage.
Silver, B. J. (2003). Forces of labor: Workers’ movements and globalization since 1870. Cambridge: Cambridge University Press.
Talme, L. (2013). Do capitalist welfare states still consist of the good, the bad and the ugly? Unpublished thesis. Sweden: Lund University.
Vrooman, J. C. (2012). Regimes and cultures of social security: Comparing institutional models through nonlinear PCA. International Journal of Comparative Sociology, 53, 444–477. https://doi.org/10.1177/0020715212469512.
Walker, A., & Wong, C. (1996). Rethinking the western construction of the welfare state. International Journal of Health Services, 26(1), 67–92.
Wood, G., & Gough, I. (2006). A comparative welfare regime approach to global social policy. World Development, 34(10), 1696–1712.
Xu, Z. (2017). The development of capitalist agriculture in China. Review of Radical Political Economics, 49(4), 591–598.
Acknowledgements
We thank the team members of Emerging Welfare ERC project (emw.ku.edu.tr) for their comments and criticisms, the editor of Social Indicators Research for her continuous support and the anonymous reviewers for their very constructive criticisms and suggestions.
Funding
This work was supported by the European Research Council (ERC) (Grant Number: 714868).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Yörük, E., Öker, İ., Yıldırım, K. et al. The Variable Selection Problem in the Three Worlds of Welfare Literature. Soc Indic Res 144, 625–646 (2019). https://doi.org/10.1007/s11205-019-02070-7
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11205-019-02070-7
Keywords
- Welfare modelling
- Case selection
- Methodology
- Comparative analysis
- Welfare regime