Abstract
In recent years, pooled time-series cross-section data analysis has been advocated as a method for overcoming the ‘small N, many variables’ problem in comparative political economy in order to derive valid inferences from statistical comparisons of nation states. Moreover, the approach seemed promising in handling both comparisons among different countries and developments over time. However, due to the complex structure of pooled data sets, this approach cannot simply be regarded as a convenient way of increasing the number of cases and getting more significant results. This paper exemplifies the fallacies of pooled data sets by reanalyzing a study done by Paul Boreham and Hugh Compston on the effect of labour participation in policy formation on unemployment. Reanalysis of their data set controlling for the panel structure of the data by using ‘panel corrected standard errors’ and a more detailed analysis of the bivariate relationships show that the causal effect is less clear-cut than suggested and becomes considerably weaker during the 1980s. These dynamics are simply averaged out by pooled analysis. This leads to the conclusion that the currently most popular approach to pooled time-series cross-section analysis in comparative political economy – the constant-coefficients model – neither solves the small-N problem nor draws attention to dynamics over time. Thus, the article concludes that a sensitive interpretation of the findings obtained by advanced statistical methodology in comparative political economy is still dependent on small-N comparative analysis.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Alvarez, R. M., Garrett, G. & Lange, P. (1991). Government partisanship, labor organization, and macroeconomic performance, American Political Science Review 85(2): 539–556.
Baltagi, B.H. (1995). Econometric analysis of panel data. New York: Wiley.
Beck, N. et al. (1993). Government partisanship, labor organization, and macroeconomic performance: a corrigendum, American Political Science Review 87(4): 945–948.
Beck, N. & Katz, J. (1995). What to do (and not to do) with time-series cross-section data, American Political Science Review 89(3): 634–647.
Beck, N. & Katz, J. (1996a). Nuisance vs. substance: Specifying and estimating time-series cross-section models, Political Analysis 6: 1–34.
Beck, N. & Katz, J. (1996b). Lumpers aud splitters united: The random coefficients model. Paper presented at the annual meeting of the Political Methodology Group, American Political Science Association, Ann Arbor. Berger, S. & Dore, R., eds. (1996). National diversity and global capitalism. Ithaca, NY: Cornell University Press. Berk, R.A., Western, B. & Weiss, R.E. (1995). Statistical inference for apparent populations, Sociological Methodology 25: 421–458. Berry, W.D. (1993). Understanding regression assumptions [Quantitative Applications in the Social Sciences 92]. London: Sage. Boreham, P. & Compston, H. (1992). Labour movement organization and political intervention. The politics of unemployment in the OECD countries, 1974–1986, European Journal of Political Research 22: 143–170. Boyer, R. & Drache, D. (1996). States against markets. The limits of globalization. London: Routledge. Burkhart, R. & Lewis-Beck, M. (1994). Comparative democracy: the economic development thesis, American Political Science Review 88(4): 903–910. Burrows, R. & Loader, B., eds. (1994). Towards a post-fordist welfare state? London: Routledge. Calmfors, L. & Driffill, J. (1988). Bargaining structure, corporatism and macroeconomic performance, Economic Policy 3: 13–61. Cameron, D. (1984). Social democracy, corporatism, labour quiescence and the representation of economic interests in advanced capitalist countries, in: J.H. Goldthorpe (ed.), Order and conflict in contemporary capitalism. Studies in the political economy of Western European nations. Oxford: Clarendon Press. Collier, D. (1993). The comparative method, in: A. Finifter (ed.), Political science of the discipline II (pp. 105–119). Washington: American Political Science Association. Compston, H. (1997). Union power, policy-making and unemployment in Western Europe 1972–1993, Comparative Political Studies 30(4): 732–751. Dielman, T.E. (1989). Pooled cross-sectional and time series analysis. New York: Marcel Dekker. Enders, W. (1995). Applied econometric time series. New York: Wiley. Ferner, A. & Hyman, R. (1992). Industrial relations in the new Europe: Seventeen types of ambiguity, in: A. Ferner & R. Hyman (eds.), Industrial relations in the new Europe. Oxford: Blackwell. Firebaugh, G. (1980). Cross-national versus historical regression models: conditions of equivalence in comparative analysis, Comparative Social Research 3: 333–344. Freeman, J.R. (1990). Systematic sampling, temporal aggregation, and the study of political relationships, Political Analysis 1: 61–98. Garrett, C. & Lange, P. (1989). Government partisanship and economic performance: When and how does ‘who governs’ matter?, Journal of Politics 51: 676–693. Gilbert, C. (1990). Professor Hendrys econometric methodology, in: C.W.J. Granger (ed.), Modeling econometric series. Oxford: Oxford University Press. Greene, W. (1993). Econometric analysis. Englewood Cliffs: Prentice Hall. Hall, P.A. & Franzese, R.J. (1998). Mixed signals: central bank independence, coordinated wage bargaining, and European Monetary Union, International Organization 52(3): 505– 535. Harris, R. (1995). Using cointegration analysis in econometric modelling. Hemel Hempstead: Prentice Hall/Harvester Wheatsheaf. Hendry, D. (1995). Dynamic econometrics. Oxford: Oxford University Press. Hibbs, D. (1983). Comment on Beck, American Political Science Review 77: 447–451. Hicks, A. M. (1988). Social democratic corporatism and economic growth, Journal of Politics 50: 677–704. Hicks, A.M. (1994a). Introduction to pooling, in: A. Hicks & T. Janoski (eds.), The comparative political economy of the welfare state. Cambridge: Cambridge University Press. Hicks, A.M. (1994b). The social democratic corporatist model of economic performance in short-and medium-run perspective, in: A. Hicks & T. Janoski (eds.), The comparative political economy of the welfare state. Cambridge: Cambridge University Press. Hicks, A.M. & Patterson, D.W. (1989). On the robustness of the left corporatist model of economic growth, Journal of Politics 51: 662–675. Hicks, A.M. & Swank, D. (1992). Politics, institutions, and welfare spending in industrialized democracies, 1960–82, American Political Science Review 86(3): 658–674. Hollingsworth, J.R. & Boyer, R. (1997). Coordination of economic actors and social systems of production, in: J.R. Hollingsworth & R. Boyer (eds.), Contemporary capitalism. The embeddedness of institutions (pp. 1–47). Cambridge: Cambridge University Press. Hüttner, H.J.M. & van den Eeden, P. (1995). The multilevel design. A guide with an annotated bibliography 1980–1993. Westport/London: Greenwood Press. Hsiao, C. (1986). Analysis of panel data. Cambridge: Cambridge University Press. Iversen, T. (1998).Wage bargaining, central bank independence, and the real effects of money, International Organization 52(3): 469–504. Jackman, R.W. (1987). The politics of economic growth in the industrial democracies, 1974– 1980: leftist strength or North Sea oil?, Journal of Politics 49: 242–256. Jackman, R.W. (1989). The politics of economic growth, once again, Journal of Politics 51: 646–661. Kennedy, P. (1992). A guide to econometrics. Oxford: Blackwell. King, C., Keohane, R. & Verba, S. (1994). Designing social inquiry. Scientific inference in qualitative research. Princeton: Princeton University Press. Kmenta, J. (1990). Elements of econometrics. New York: Macmillan. Lange, P. & Garrett, C. (1985). The politics of growth: Strategic interaction and economic performance in the advanced industrial democracies, 1974–1980, Journal of Politics 47(4): 792–827. Lange, P. & Garrett, G. (1987). The politics of growth reconsidered, Journal of Politics 49: 257–274. Layard, R., Nickell, S. & Jackman, R. (1991). Unemployment. Macroeconomic performance and the labour market. Oxford: Oxford University Press. Lehmbruch, C. (1984). Concertation and the structure of corporatist networks, in: J.H. Goldthorpe (ed.), Order and conflict in contemporary capitalism. Studies in the political economy of Western European nations. Oxford: Clarendon Press. Lieberson, S. (1991). Small Ns and big conclusions: An examination of the reasoning in comparative studies based on a small number of cases, Social Forces 70(2): 307–320. Lieberson, S. (1994). More on the uneasy case for using Mill-type methods in small-N comparative studies, Social Forces 72(4): 1225–1237. Lijphart, A. (1971). Comparative politics and the comparative method, American Political Science Review 65: 682–693. Luhmann, N. (1988). Die Wirtschaft der Gesellschaft. Frankfurt/M.: Suhrkamp. Maddala, C. S. (1997). Recent developments in dynamic econometric modelling: A personal viewpoint, manuscript, Ohio State University. Matzner, E. & Streeck, W., eds. (1991). Beyond Keynesianism. The socio-economics of production and full employment. Aldershot: Edward Elgar. Máytás, L. & Severstre, P., eds. (1996). The econometrics of panel data. Handbook of theory and applications. Dordrecht/Boston/London: Kluwer. McCleary, R. & Hay, R. (1980). Applied time series analysis for the social sciences. Beverly Hills/London: Sage. Nerlove, M. (1997). Likelihood inference for dynamic panel models, manuscript, University of Maryland. Ostrom, C.W. Jr. (1990). Time series analysis. Regression techniques [Quantitative Applications in the Social Sciences 9]. London: Sage. Pagan, A. (1990). Three econometric methodologies, in: C.W.J. Granger (ed.), Modelling econometric series. Oxford: Oxford University Press. Ragin, C. (1987). The comparative method. Moving beyond qualitative and quantitative strategies. Berkely: University of California Press. Ragin, C. (1994). Introduction to qualitative comparative analysis, in: T. Janoski & A.M. Hicks (eds.), The comparative political economy of the welfare state, Cambridge: Cambridge University Press. Savolainen, J. (1994). The rationality of drawing big conclusions on small samples: In defense of Mills method, Social Forces 72(4): 1217–1224. Sayrs, L.W. (1989). Pooled time series analysis [Quantitative Applications in the Social Sciences 70]. London: Sage. Schmidt, M.G. (1992). Regierungen: parteipolitische Zusammensetzung, in: M.G. Schmidt (ed.), Lexikon der Politik, Bd. 3: Die westlichen Länder. München: Piper. Schmidt, M.C. (1995). Vergleichende Politikforschung mit Aggregatdaten: Inwieweit beein-flussen Parteien Regierungspolitik?, in: U. von Alemann (ed.), Politikwissenschaftliche Methoden. Opladen: Westdeutscher Verlag. Schmitter, P.C. (1979). Still the century of corporatism?, in: P.C. Schmitter & G. Lehmbruch (eds.), Trends toward corporatist intermediation. London: Sage. Schmitter, P.C. (1981). Interest intermediation and regime governability in contemporary Western Europe and North America, in: S.D. Berger (ed.), Organizing interests in Western Europe. Cambridge: Cambridge University Press. Schmitter, P.C. (1982). Reflections on where the theory of neo-corporatism has gone and where the praxis of neo-corporatism may be going, in: G. Lehmbruch & P.C. Schmitter (eds.), Patterns of corporatist policy-making. London: Sage. Smith, M.A. (1995). Time serial designs and cross-sectional designs: Uncovering the structural logic of pooled analyses. Paper presented to the 1995 APSA Meeting (Political Methodology Electronic Paper Archive at the University of California, Riverside). Stimson, J. A. (1985). Regression in time and space: A statistical essay, American Journal of Political Science 29(4): 914–947. Swank, D. (1992). Politics and the structural dependence of the state in democratic capitalist nations, American Political Science Review 86(1): 38–54. Therborn, G. (1987). Does corporatism really matter? The economic crisis and issues of political theory, Journal of Public Policy 7: 259–283. Western, B. (1998). Causal heterogeneity in comparative research: a Bayesian hierarchical modelling approach, American Journal of Political Science 42(4): 1233–1259. Williamson, P.J. (1989). Corporatism in perspective. An introductory guide to corporatist theory. London: Sage.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Kittel, B. Sense and sensitivity in pooled analysis of political data. European Journal of Political Research 35, 225–253 (1999). https://doi.org/10.1023/A:1006914424403
Issue Date:
DOI: https://doi.org/10.1023/A:1006914424403