Abstract
Testing veto players theory in parliamentary systems requires researchers to have accurate estimates of policy preferences of political parties. In empirical studies, however, political scientists use remarkably context-free and invariant estimates of party positions. As a consequence, they must make assumptions about the nature of policy conflict. In the extreme, the lack of accurate estimates reduces sample sizes and increases the risk of selection bias in studies that use the ideological range among veto players as a key explanatory variable. We introduce a new automated method to identify policy relevant content in political texts. Our method “smart tags” sentences in election manifestos using portfolio-specific keywords from a legislative database. Policy positions can then be estimated on the tagged subset of relevant sentences. We apply our method to analyze the legislative positions of political parties for several portfolios in the German parliament. We show that these estimates vary over time and across portfolios – variation which cannot be produced using existing methods. We believe our method simplifies preference estimation and increases construct validity of policy preference measures used to evaluate policy-focused theories.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Although Veto Players Theory is applicable to all democratic political systems, our focus in this paper is on parliamentary democracies. This is because we are interested in estimating policy portfolio specific positions for partisan veto players.
- 2.
- 3.
Note that the statistical inference problem in expert surveys is different from that in voter surveys. Whereas in the latter we are interested in inferring the attitudes of a population (i.e., all citizens or voters) from information about a sample, the goal in expert surveys is to “uncover an assumed underlying truth, the spatial location of a party’s policy positions” (Benoit and Laver 2006). Nevertheless, the reasons for expert participation in surveys remain unexplored, as do issues of expert pool contamination due to multiple surveys directed repeatedly at the same experts.
- 4.
Even more problematic are expert surveys that ask experts at point tto “remember” and indicate the positions of parties held at point t− x.
- 5.
We thank George Tsebelis for making the replication data available to us.
- 6.
In cases for which all three indices exist, the average was calculated on the basis of all three; for countries covered by two indices, only the two standardized indices were used. The same logic was applied for cases covered only by one index.
- 7.
The CMP data contain information on 56 categories, indicating the relative frequency of manifesto quasi-sentences that fit into each of these categories. There has been much criticism of this approach on grounds of reliability and misclassification of the CMP codings (e.g., Mikhaylov et al. 2008; Benoit et al. 2009).
- 8.
See, for example, a recent special issue on the topic: The Statistical Analysis of Political Text. Political Analysis16(4), edited by Burt L. Monroe and Philip A. Schrodt.
- 9.
This is different from the CMP measurement approach, which assumes that there is a true coding of quasi-sentences (the CMP “gold standard”) according to which each coder should be evaluated.
- 10.
Only if researchers assign different party documents as reference texts does this approach use different text for different dimensions, but in any case, it does not use policy-specific texts, but the entire manifesto.
- 11.
- 12.
GESTA is electronically available via the ‘Documentation and Information System for Parliamentary Materials’ (DIP) system (http://dip.bundestag.de).
- 13.
To ensure comparability across time, we matched policy portfolios to the 14 federal ministries in the 16th legislative term of Bundestag. Although the policy portfolios in GESTA closely mirror the ministerial portfolios, the match is not exact because some ministries changed over time. For example, new ministries were added (e.g., the Ministry for the Environment, Nature Conservation and Nuclear Safety following the 1986 Chernobyl disaster) while others were split (e.g., the Ministry for Youth, Family and Health in 1991).
- 14.
We also process the files by removing all numbers, punctuation, other nonalphanumeric characters, and checking for spelling errors. We furthermore exclude words with little semantic value (very short words, articles, pronouns, prepositions, conjunctions, etc.) as well as words without a clear political meaning which appear in almost each GESTA entry (i.e., “proposal”, “measure”, “implementation,” etc.). To do this, we used a dictionary approach implemented in Simstat/WordStat (Davi et al. 2005; Johnson 2007).
- 15.
However, this unique allocation to a policy area is not an essential step in our approach, and researchers may decide to consider multiple policy areas for the same keyword. We use a relative frequency criterion rather than an absolute frequency criterion because the absolute frequency criterion would mean that policy areas in which more legislation is written would also have far more keywords than areas in which less legislation is produced.
- 16.
If a manifesto sentence contains keywords from two or more portfolios, the sentence counts for each of those portfolios. An alternative approach would be to assign each sentence exclusively to one portfolio.
- 17.
We use keyword stems and stemmed manifesto sentences.
- 18.
For example, in some instances a keyword may only occur during one legislative period. Nevertheless, we examine how many times that word was mentioned in the manifestos drafted before and after this period.
- 19.
Wordfish assumes that the frequency with which words occur in documents is generated by a Poisson process, the simplest of the count distributions. The systematic component of this process contains four parameters: document (party) positions, document (party) fixed effects, word weights (discrimination parameters), and word fixed effects. Formally, y ijt ∼ Poisson(λ ijt ), where y ijt is the count of word jin party i’s manifesto at time t. The lambda parameter has the systematic component λ ijt = exp(α it + ψ j + β j ∗ ω it ), with α as a set of document (party-election year) fixed effects, ψ as a set of word fixed effects, β as estimates of word specific weights capturing the importance of word jin discriminating between manifestos, and ω as the estimate of party i’s position in election year t(therefore itis indexing one specific manifesto). For a more detailed description of the estimation process, see Slapin and Proksch (2008).
- 20.
In German, Ladenschluss, Dienstleistungsabend, and Beschäftigungsförderung, respectively.
- 21.
This is also the reason Tsebelis uses multiplicative heteroskedastic regression in his empirical analysis (Tsebelis 2002).
- 22.
The results are based on keyword stems. Only keywords that appear in at least one election manifesto are considered.
- 23.
The CDU–CSU and FDP formed the governing coalition throughout the period of investigation.
- 24.
Moreover, the keyword coverage in manifestos across legislative periods, which is not shown in the table, reveals that for almost all portfolios the majority of keywords appear in at least two legislative periods. In other words, we are not simply selecting keywords that are relevant in one legislative period only. The most stable keyword coverage is in the areas of development and defense, in which more than 70% and 60%, respectively, of keyword stems occur in more than one legislative period. The least stable keyword coverage is in the areas of finances and justice, in which slightly less than 50% occur in at least two periods. We consider this stability to be sufficient to use the keywords to construct a term-document matrix and estimate positions over all three periods simultaneously.
References
Adams J, Somer-Topcu Z (2009) Do parties adjust their policies in response to rival parties’ policy shifts? Br J Political Sci 39(4):825–846
Adams J, Clark M, Ezrow L, Glasgow G (2006) Are niche parties fundamentally different from mainstream parties? the causes and the electoral consequences of western european parties’ policy shifts, 1976–1998. Am J Political Sci 50(3):513–529
Alt JE, Lassen DD (2006) Transparency, political polarization, and political budget cycles in oecd countries. Am J Political Sci 50(3):530–550
Bawn K, Rosenbluth F (2006) Short versus long coalitions: electoral accountability and the size of the public sector. Am J Political Sci 50(2):251–265
Benoit K, Laver M (2006) Party Policy in Modern Democracies. Routledge, London
Benoit K, Laver M, Mikhaylov S (2009) Treating words as data with error: uncertainty in text statements of policy positions. Am J Political Sci 53(2):495–513
Blanpain R (ed) (1995) International encyclopedia for labour law and industrial relations. Kluwer, Amsterdam
Browne EC, Gleiber DW, Mashoba CS (1984) Evaluating conflict of interest theory: Western European cabinet coalitions, 1945–1980. Br J Political Sci 14(1):1–32
Budge I (2000) Expert judgements of party policy positions: uses and limitations in political research. Eur J Political Res 37:103–113
Budge I, Robertson D, Hearl D (1987) Ideology, strategy, and party change: spatial analyses of post-war election programmes in 19 democracies. Cambridge University Press, Cambridge
Budge I, Klingemann HD, Volkens A, Bara J, Tanenbaum E (2001) Mapping policy preferences: estimates for parties, electors, and governments 1945–1998. Oxford University Press, Oxford
Castles FG, Mair P (1984) Left-right political scales: some expert judgements. Eur J Political Res 12(1):73–88
Crombez C (1996) Minority governments, minimal winning coalitions and surplus majorities in parliamentary systems. Eur J Political Res 29(1):1–29
Davi A, Haughton D, Nasr N, Shah G, Skaletsky M, Spack R (2005) A review of two text-mining packages: Sas textmining and wordstat. Am Statist 59(1):89–103
Dodd L (1976) Coalitions in parliamentary government. Princeton University Press, Princeton, NJ
Döring H (ed) (1995) Parliaments and majority rule in Western Europe. St. Martin’s Press, New York, NY
Druckman JN, Thies MF (2002) The importance of concurrence: The impact of bicameralism on government formation and duration. Am J Political Sci 46(4):760–771
Eyheramendy S, Lewis D, Madigan D (2003) On the naive bayes model for text categorization. Proceedings of the 9th Workshop on Artificial Intelligence
Gabel MJ, Huber JD (2000) Putting parties in their place: inferring left-right ideological positions from party manifestos data. Am J Political Sci 44(1):94–103
Hooghe L, Bakker R, Brigevich A, de Vries C, Edwards E, Marks G, Rovny J, Steenbergen M (2010) Reliability and validity of measuring party positions: The Chapel Hill expert surveys of 2002 and 2006. Eur J Political Res
Hopkins D, King G (2010) A method of automated nonparametric content analysis for social science. Am J Political Sci 54(1):229–247
Huber JD, McCarty N (2001) Cabinet decision rules and political uncertainty in parliamentary bargaining. Am Political Sci Rev 95(2):345–360
Johnson T (2007) Review of wordstat 5.1, simstat 2.5 and qda miner 2.0. Political Methodol 15(1):11–14
Klingemann H-D, Volkens A, Bara J, Budge I, McDonald M (2006) Mapping policy preferences II: estimates for parties, electors and governments in Central and Eastern Europe, European Union and OECD 1990-2003. Oxford University Press, Oxford
König T, Bräuninger T (2005) Gesetzgebung im Föderalismus. Speyerer Forschungsberichte 237, Forschungsinstitut für Öffentliche Verwaltung, Speyer
König T, Luig B (2009) German ‘lexiconspace’: policy positions and their legislative context. German Politics 18(3):345–364
König T, Finke D, Daimer S (2005) Ignoring the non-ignorables?: missingness and missing positions. Eur Union Politics 6(3):269–290
Laver M, Garry J (2000) Estimating policy positions from political texts. Am J Political Sci 44(3):619–634
Laver M, Hunt WB (1992) Policy and party competition. Routledge, Chapman and Hall, New York
Laver M, Schofield N (1998) Multiparty government: the politics of coalition in Europe, 2nd edn. Oxford University Press, Oxford
Laver M, Shepsle KA (1996) Making and breaking governments: cabinets and legislatures in parliamentary democracies. Cambridge University Press, Cambridge
Laver M, Benoit K, Garry J (2003) Extracting policy positions from political texts using words as data. Am Political Sci Rev 97(2):311–332
Lewis DD (1998) Naive (bayes) at forty: the independence assumption in information retrieval. Proceedings of the 10th European Conference on Machine Learning pp. 4–15
Lijphart A (1999) Patterns of democracy: government forms and performance in thirty-six countries. Yale University Press, New Haven
Lowe W (2008) Understanding wordscores. Political Anal 16(4):356–371
Mair P (2001) Searching for positions of political actors: a review of approaches and a critical evaluation of expert surveys. In: Laver M (ed) Estimating the policy positions of political actors, pp. 10–30. Routledge, London
Martin LW, Stevenson RT (2001) Government formation in parliamentary democracies. Am J Political Sci 45(1):33–50
Martin LW, Vanberg G (2003) Wasting time? the impact of ideology and size on delay in coalition formation. Br J Political Sci 33(2):323–332
Martin LW, Vanberg G (2004) Policing the bargain: coalition government and parliamentary scrutiny. Am J Political Sci 48(1):13–27
Martin LW, Vanberg G (2005) Coalition policymaking and legislative review. Am Political Sci Rev 99(1):93–106
Mikhaylov S, Laver M, Benoit K (2008) Coder reliability and misclassification in comparative manifesto project codings. Paper presented at the 66th MPSA Conference, 3–6 April 2008
Miller G (1956) Magical number seven, plus or minus two. Psychol Rev 63(2):81–97
Monroe BL, Maeda K (2004) Talk’s cheap: text-based estimation of rhetorical ideal-points. Paper presented at the 21st PolMeth Conference, 29–31 July 2004
Proksch SO, Slapin JB (2006) Institutions and coalition formation: the german election of 2005. West Eur Politics 29(3):540–559
Proksch SO, Slapin JB (2009) How to avoid pitfalls in statistical analysis of political texts: the case of germany. German Politics 18(3):323–344
Proksch SO, Slapin JB (2010) Position Taking in European Parliament Speeches. Br J Political Sci 40(3):587–611
Quinn KM, Monroe BL, Colaresi M, Crespin MH, Radev D (2010) How to analyze political attention with minimal assumptions and costs. Am J Political Sci 54(1):209–228
Rohrschneider R, Whitefield S (2007) Representation in new democracies: party stances on european integration in post-communist eastern europe. J Politics 69(4):1133–1146
Roozendaal PV (1992) The effect of dominant and central parties on cabinet composition and durability. Legis Stud Quart 17(1):5–36
Santoni M, Zucchini F (2004) Does policy stability increase the constitutional court’s independence? the case of italy during the first republic (1956–1992). Public Choice 120(3/4):439–461
Scholtz E, Trantas G (1995) Legislation on benefits and on regulatory matters: social security and labor matters. In: Döring H (ed) Parliaments and majority rule in western Europe. St. Martin’s Press, New York
Slapin JB, Proksch SO (2008) A scaling model for estimating time-series party positions from texts. Am J Political Sci 52(3):705–722
Steenbergen MR, Marks G (2007) Evaluating expert judgments. Eur J Political Res 46(3):347–366
Strøm K, Leipart JY (1993) Policy, institutions, and coalition avoidance: Norwegian governments, 1945–1990. Am Political Sci Rev 87(4):870–887
Tsebelis G (1995) Decision-making in political systems: Veto players in presidentialism, parliamentarism, multicameralism, and multipartyism. Br J Political Sci 25(3):289–325
Tsebelis G (1999) Veto players and law production in parliamentary democracies: an empirical analysis. Am Political Sci Rev 93(3):591–608
Tsebelis G (2002) Veto players: how political institutions work. Russell Sage/Princeton University Press, Princeton, NJ
Tsebelis G, Money J (1997) Bicameralism. Cambridge University Press, Cambridge
Volden C, Carrubba CJ (2004) The formation of oversized coalitions in parliamentary democracies. Am J Political Sci 48(3):521–537
Warwick P (1994) Government survival in west European parliamentary democracies. Cambridge University Press, New York
Warwick P (1996) Coalition government membership in west european parliamentary democracies. Br J Political Sci 26(4):471–499
Warwick P (1998) Policy distance and parliamentary government. Legis Stud Quart 23(3):319–345
Warwick P (2005) When far apart becomes too far apart: evidence for a threshold effect in coalition formation. Br J Political Sci 35(3):383–401
Acknowledgements
The authors’ names appear in alphabetical order. All authors have contributed equally to all work. A previous version of this chapter was presented at the 67th Annual MPSA National Conference in Chicago, April 2009, and the Veto Players Workshop at the University of Mannheim in May 2009. We thank the participants for helpful comments and suggestions.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer Science+Business Media, LLC
About this chapter
Cite this chapter
König, T., Luig, B., Proksch, SO., Slapin, J.B. (2011). Measuring Policy Positions of Veto Players in Parliamentary Democracies. In: König, T., Debus, M., Tsebelis, G. (eds) Reform Processes and Policy Change. Studies in Public Choice, vol 16. Springer, New York, NY. https://doi.org/10.1007/978-1-4419-5809-9_4
Download citation
DOI: https://doi.org/10.1007/978-1-4419-5809-9_4
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4419-5808-2
Online ISBN: 978-1-4419-5809-9
eBook Packages: Humanities, Social Sciences and LawPolitical Science and International Studies (R0)