Skip to main content

Measuring Policy Positions of Veto Players in Parliamentary Democracies

  • Chapter
  • First Online:
Reform Processes and Policy Change

Part of the book series: Studies in Public Choice ((SIPC,volume 16))

Abstract

Testing veto players theory in parliamentary systems requires researchers to have accurate estimates of policy preferences of political parties. In empirical studies, however, political scientists use remarkably context-free and invariant estimates of party positions. As a consequence, they must make assumptions about the nature of policy conflict. In the extreme, the lack of accurate estimates reduces sample sizes and increases the risk of selection bias in studies that use the ideological range among veto players as a key explanatory variable. We introduce a new automated method to identify policy relevant content in political texts. Our method “smart tags” sentences in election manifestos using portfolio-specific keywords from a legislative database. Policy positions can then be estimated on the tagged subset of relevant sentences. We apply our method to analyze the legislative positions of political parties for several portfolios in the German parliament. We show that these estimates vary over time and across portfolios – variation which cannot be produced using existing methods. We believe our method simplifies preference estimation and increases construct validity of policy preference measures used to evaluate policy-focused theories.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Although Veto Players Theory is applicable to all democratic political systems, our focus in this paper is on parliamentary democracies. This is because we are interested in estimating policy portfolio specific positions for partisan veto players.

  2. 2.

    Other prominent expert surveys have been conducted specifically on the issue of European integration, see Rohrschneider and Whitefield (2007), Steenbergen and Marks (2007), and Hooghe et al. (2010).

  3. 3.

    Note that the statistical inference problem in expert surveys is different from that in voter surveys. Whereas in the latter we are interested in inferring the attitudes of a population (i.e., all citizens or voters) from information about a sample, the goal in expert surveys is to “uncover an assumed underlying truth, the spatial location of a party’s policy positions” (Benoit and Laver 2006). Nevertheless, the reasons for expert participation in surveys remain unexplored, as do issues of expert pool contamination due to multiple surveys directed repeatedly at the same experts.

  4. 4.

    Even more problematic are expert surveys that ask experts at point tto “remember” and indicate the positions of parties held at point tx.

  5. 5.

    We thank George Tsebelis for making the replication data available to us.

  6. 6.

    In cases for which all three indices exist, the average was calculated on the basis of all three; for countries covered by two indices, only the two standardized indices were used. The same logic was applied for cases covered only by one index.

  7. 7.

    The CMP data contain information on 56 categories, indicating the relative frequency of manifesto quasi-sentences that fit into each of these categories. There has been much criticism of this approach on grounds of reliability and misclassification of the CMP codings (e.g., Mikhaylov et al. 2008; Benoit et al. 2009).

  8. 8.

    See, for example, a recent special issue on the topic: The Statistical Analysis of Political Text. Political Analysis16(4), edited by Burt L. Monroe and Philip A. Schrodt.

  9. 9.

    This is different from the CMP measurement approach, which assumes that there is a true coding of quasi-sentences (the CMP “gold standard”) according to which each coder should be evaluated.

  10. 10.

    Only if researchers assign different party documents as reference texts does this approach use different text for different dimensions, but in any case, it does not use policy-specific texts, but the entire manifesto.

  11. 11.

    In essence, we are interested in topic-coding manifestos. However, we differ from computer-based methods of topic-coding (e.g., Hopkins and King 2010; Quinn et al. 2010) in that we use keywords from bills to explicitly link policy-specific information in manifestos to policy portfolios.

  12. 12.

    GESTA is electronically available via the ‘Documentation and Information System for Parliamentary Materials’ (DIP) system (http://dip.bundestag.de).

  13. 13.

    To ensure comparability across time, we matched policy portfolios to the 14 federal ministries in the 16th legislative term of Bundestag. Although the policy portfolios in GESTA closely mirror the ministerial portfolios, the match is not exact because some ministries changed over time. For example, new ministries were added (e.g., the Ministry for the Environment, Nature Conservation and Nuclear Safety following the 1986 Chernobyl disaster) while others were split (e.g., the Ministry for Youth, Family and Health in 1991).

  14. 14.

    We also process the files by removing all numbers, punctuation, other nonalphanumeric characters, and checking for spelling errors. We furthermore exclude words with little semantic value (very short words, articles, pronouns, prepositions, conjunctions, etc.) as well as words without a clear political meaning which appear in almost each GESTA entry (i.e., “proposal”, “measure”, “implementation,” etc.). To do this, we used a dictionary approach implemented in Simstat/WordStat (Davi et al. 2005; Johnson 2007).

  15. 15.

    However, this unique allocation to a policy area is not an essential step in our approach, and researchers may decide to consider multiple policy areas for the same keyword. We use a relative frequency criterion rather than an absolute frequency criterion because the absolute frequency criterion would mean that policy areas in which more legislation is written would also have far more keywords than areas in which less legislation is produced.

  16. 16.

    If a manifesto sentence contains keywords from two or more portfolios, the sentence counts for each of those portfolios. An alternative approach would be to assign each sentence exclusively to one portfolio.

  17. 17.

    We use keyword stems and stemmed manifesto sentences.

  18. 18.

    For example, in some instances a keyword may only occur during one legislative period. Nevertheless, we examine how many times that word was mentioned in the manifestos drafted before and after this period.

  19. 19.

    Wordfish assumes that the frequency with which words occur in documents is generated by a Poisson process, the simplest of the count distributions. The systematic component of this process contains four parameters: document (party) positions, document (party) fixed effects, word weights (discrimination parameters), and word fixed effects. Formally, y ijt ∼ Poisson(λ ijt ), where y ijt is the count of word jin party i’s manifesto at time t. The lambda parameter has the systematic component λ ijt = exp(α it + ψ j + β j ∗ ω it ), with α as a set of document (party-election year) fixed effects, ψ as a set of word fixed effects, β as estimates of word specific weights capturing the importance of word jin discriminating between manifestos, and ω as the estimate of party i’s position in election year t(therefore itis indexing one specific manifesto). For a more detailed description of the estimation process, see Slapin and Proksch (2008).

  20. 20.

    In German, Ladenschluss, Dienstleistungsabend, and Beschäftigungsförderung, respectively.

  21. 21.

    This is also the reason Tsebelis uses multiplicative heteroskedastic regression in his empirical analysis (Tsebelis 2002).

  22. 22.

    The results are based on keyword stems. Only keywords that appear in at least one election manifesto are considered.

  23. 23.

    The CDU–CSU and FDP formed the governing coalition throughout the period of investigation.

  24. 24.

    Moreover, the keyword coverage in manifestos across legislative periods, which is not shown in the table, reveals that for almost all portfolios the majority of keywords appear in at least two legislative periods. In other words, we are not simply selecting keywords that are relevant in one legislative period only. The most stable keyword coverage is in the areas of development and defense, in which more than 70% and 60%, respectively, of keyword stems occur in more than one legislative period. The least stable keyword coverage is in the areas of finances and justice, in which slightly less than 50% occur in at least two periods. We consider this stability to be sufficient to use the keywords to construct a term-document matrix and estimate positions over all three periods simultaneously.

References

  1. Adams J, Somer-Topcu Z (2009) Do parties adjust their policies in response to rival parties’ policy shifts? Br J Political Sci 39(4):825–846

    Article  Google Scholar 

  2. Adams J, Clark M, Ezrow L, Glasgow G (2006) Are niche parties fundamentally different from mainstream parties? the causes and the electoral consequences of western european parties’ policy shifts, 1976–1998. Am J Political Sci 50(3):513–529

    Article  Google Scholar 

  3. Alt JE, Lassen DD (2006) Transparency, political polarization, and political budget cycles in oecd countries. Am J Political Sci 50(3):530–550

    Article  Google Scholar 

  4. Bawn K, Rosenbluth F (2006) Short versus long coalitions: electoral accountability and the size of the public sector. Am J Political Sci 50(2):251–265

    Article  Google Scholar 

  5. Benoit K, Laver M (2006) Party Policy in Modern Democracies. Routledge, London

    Google Scholar 

  6. Benoit K, Laver M, Mikhaylov S (2009) Treating words as data with error: uncertainty in text statements of policy positions. Am J Political Sci 53(2):495–513

    Article  Google Scholar 

  7. Blanpain R (ed) (1995) International encyclopedia for labour law and industrial relations. Kluwer, Amsterdam

    Google Scholar 

  8. Browne EC, Gleiber DW, Mashoba CS (1984) Evaluating conflict of interest theory: Western European cabinet coalitions, 1945–1980. Br J Political Sci 14(1):1–32

    Article  Google Scholar 

  9. Budge I (2000) Expert judgements of party policy positions: uses and limitations in political research. Eur J Political Res 37:103–113

    Google Scholar 

  10. Budge I, Robertson D, Hearl D (1987) Ideology, strategy, and party change: spatial analyses of post-war election programmes in 19 democracies. Cambridge University Press, Cambridge

    Book  Google Scholar 

  11. Budge I, Klingemann HD, Volkens A, Bara J, Tanenbaum E (2001) Mapping policy preferences: estimates for parties, electors, and governments 1945–1998. Oxford University Press, Oxford

    Google Scholar 

  12. Castles FG, Mair P (1984) Left-right political scales: some expert judgements. Eur J Political Res 12(1):73–88

    Article  Google Scholar 

  13. Crombez C (1996) Minority governments, minimal winning coalitions and surplus majorities in parliamentary systems. Eur J Political Res 29(1):1–29

    Article  Google Scholar 

  14. Davi A, Haughton D, Nasr N, Shah G, Skaletsky M, Spack R (2005) A review of two text-mining packages: Sas textmining and wordstat. Am Statist 59(1):89–103

    Article  Google Scholar 

  15. Dodd L (1976) Coalitions in parliamentary government. Princeton University Press, Princeton, NJ

    Google Scholar 

  16. Döring H (ed) (1995) Parliaments and majority rule in Western Europe. St. Martin’s Press, New York, NY

    Google Scholar 

  17. Druckman JN, Thies MF (2002) The importance of concurrence: The impact of bicameralism on government formation and duration. Am J Political Sci 46(4):760–771

    Article  Google Scholar 

  18. Eyheramendy S, Lewis D, Madigan D (2003) On the naive bayes model for text categorization. Proceedings of the 9th Workshop on Artificial Intelligence

    Google Scholar 

  19. Gabel MJ, Huber JD (2000) Putting parties in their place: inferring left-right ideological positions from party manifestos data. Am J Political Sci 44(1):94–103

    Article  Google Scholar 

  20. Hooghe L, Bakker R, Brigevich A, de Vries C, Edwards E, Marks G, Rovny J, Steenbergen M (2010) Reliability and validity of measuring party positions: The Chapel Hill expert surveys of 2002 and 2006. Eur J Political Res

    Google Scholar 

  21. Hopkins D, King G (2010) A method of automated nonparametric content analysis for social science. Am J Political Sci 54(1):229–247

    Article  Google Scholar 

  22. Huber JD, McCarty N (2001) Cabinet decision rules and political uncertainty in parliamentary bargaining. Am Political Sci Rev 95(2):345–360

    Google Scholar 

  23. Johnson T (2007) Review of wordstat 5.1, simstat 2.5 and qda miner 2.0. Political Methodol 15(1):11–14

    Google Scholar 

  24. Klingemann H-D, Volkens A, Bara J, Budge I, McDonald M (2006) Mapping policy preferences II: estimates for parties, electors and governments in Central and Eastern Europe, European Union and OECD 1990-2003. Oxford University Press, Oxford

    Google Scholar 

  25. König T, Bräuninger T (2005) Gesetzgebung im Föderalismus. Speyerer Forschungsberichte 237, Forschungsinstitut für Öffentliche Verwaltung, Speyer

    Google Scholar 

  26. König T, Luig B (2009) German ‘lexiconspace’: policy positions and their legislative context. German Politics 18(3):345–364

    Article  Google Scholar 

  27. König T, Finke D, Daimer S (2005) Ignoring the non-ignorables?: missingness and missing positions. Eur Union Politics 6(3):269–290

    Article  Google Scholar 

  28. Laver M, Garry J (2000) Estimating policy positions from political texts. Am J Political Sci 44(3):619–634

    Article  Google Scholar 

  29. Laver M, Hunt WB (1992) Policy and party competition. Routledge, Chapman and Hall, New York

    Google Scholar 

  30. Laver M, Schofield N (1998) Multiparty government: the politics of coalition in Europe, 2nd edn. Oxford University Press, Oxford

    Google Scholar 

  31. Laver M, Shepsle KA (1996) Making and breaking governments: cabinets and legislatures in parliamentary democracies. Cambridge University Press, Cambridge

    Book  Google Scholar 

  32. Laver M, Benoit K, Garry J (2003) Extracting policy positions from political texts using words as data. Am Political Sci Rev 97(2):311–332

    Google Scholar 

  33. Lewis DD (1998) Naive (bayes) at forty: the independence assumption in information retrieval. Proceedings of the 10th European Conference on Machine Learning pp. 4–15

    Google Scholar 

  34. Lijphart A (1999) Patterns of democracy: government forms and performance in thirty-six countries. Yale University Press, New Haven

    Google Scholar 

  35. Lowe W (2008) Understanding wordscores. Political Anal 16(4):356–371

    Article  Google Scholar 

  36. Mair P (2001) Searching for positions of political actors: a review of approaches and a critical evaluation of expert surveys. In: Laver M (ed) Estimating the policy positions of political actors, pp. 10–30. Routledge, London

    Google Scholar 

  37. Martin LW, Stevenson RT (2001) Government formation in parliamentary democracies. Am J Political Sci 45(1):33–50

    Article  Google Scholar 

  38. Martin LW, Vanberg G (2003) Wasting time? the impact of ideology and size on delay in coalition formation. Br J Political Sci 33(2):323–332

    Article  Google Scholar 

  39. Martin LW, Vanberg G (2004) Policing the bargain: coalition government and parliamentary scrutiny. Am J Political Sci 48(1):13–27

    Article  Google Scholar 

  40. Martin LW, Vanberg G (2005) Coalition policymaking and legislative review. Am Political Sci Rev 99(1):93–106

    Google Scholar 

  41. Mikhaylov S, Laver M, Benoit K (2008) Coder reliability and misclassification in comparative manifesto project codings. Paper presented at the 66th MPSA Conference, 3–6 April 2008

    Google Scholar 

  42. Miller G (1956) Magical number seven, plus or minus two. Psychol Rev 63(2):81–97

    Article  Google Scholar 

  43. Monroe BL, Maeda K (2004) Talk’s cheap: text-based estimation of rhetorical ideal-points. Paper presented at the 21st PolMeth Conference, 29–31 July 2004

    Google Scholar 

  44. Proksch SO, Slapin JB (2006) Institutions and coalition formation: the german election of 2005. West Eur Politics 29(3):540–559

    Article  Google Scholar 

  45. Proksch SO, Slapin JB (2009) How to avoid pitfalls in statistical analysis of political texts: the case of germany. German Politics 18(3):323–344

    Article  Google Scholar 

  46. Proksch SO, Slapin JB (2010) Position Taking in European Parliament Speeches. Br J Political Sci 40(3):587–611

    Article  Google Scholar 

  47. Quinn KM, Monroe BL, Colaresi M, Crespin MH, Radev D (2010) How to analyze political attention with minimal assumptions and costs. Am J Political Sci 54(1):209–228

    Article  Google Scholar 

  48. Rohrschneider R, Whitefield S (2007) Representation in new democracies: party stances on european integration in post-communist eastern europe. J Politics 69(4):1133–1146

    Article  Google Scholar 

  49. Roozendaal PV (1992) The effect of dominant and central parties on cabinet composition and durability. Legis Stud Quart 17(1):5–36

    Article  Google Scholar 

  50. Santoni M, Zucchini F (2004) Does policy stability increase the constitutional court’s independence? the case of italy during the first republic (1956–1992). Public Choice 120(3/4):439–461

    Article  Google Scholar 

  51. Scholtz E, Trantas G (1995) Legislation on benefits and on regulatory matters: social security and labor matters. In: Döring H (ed) Parliaments and majority rule in western Europe. St. Martin’s Press, New York

    Google Scholar 

  52. Slapin JB, Proksch SO (2008) A scaling model for estimating time-series party positions from texts. Am J Political Sci 52(3):705–722

    Article  Google Scholar 

  53. Steenbergen MR, Marks G (2007) Evaluating expert judgments. Eur J Political Res 46(3):347–366

    Article  Google Scholar 

  54. Strøm K, Leipart JY (1993) Policy, institutions, and coalition avoidance: Norwegian governments, 1945–1990. Am Political Sci Rev 87(4):870–887

    Article  Google Scholar 

  55. Tsebelis G (1995) Decision-making in political systems: Veto players in presidentialism, parliamentarism, multicameralism, and multipartyism. Br J Political Sci 25(3):289–325

    Article  Google Scholar 

  56. Tsebelis G (1999) Veto players and law production in parliamentary democracies: an empirical analysis. Am Political Sci Rev 93(3):591–608

    Article  Google Scholar 

  57. Tsebelis G (2002) Veto players: how political institutions work. Russell Sage/Princeton University Press, Princeton, NJ

    Google Scholar 

  58. Tsebelis G, Money J (1997) Bicameralism. Cambridge University Press, Cambridge

    Book  Google Scholar 

  59. Volden C, Carrubba CJ (2004) The formation of oversized coalitions in parliamentary democracies. Am J Political Sci 48(3):521–537

    Article  Google Scholar 

  60. Warwick P (1994) Government survival in west European parliamentary democracies. Cambridge University Press, New York

    Google Scholar 

  61. Warwick P (1996) Coalition government membership in west european parliamentary democracies. Br J Political Sci 26(4):471–499

    Article  Google Scholar 

  62. Warwick P (1998) Policy distance and parliamentary government. Legis Stud Quart 23(3):319–345

    Article  Google Scholar 

  63. Warwick P (2005) When far apart becomes too far apart: evidence for a threshold effect in coalition formation. Br J Political Sci 35(3):383–401

    Article  Google Scholar 

Download references

Acknowledgements

The authors’ names appear in alphabetical order. All authors have contributed equally to all work. A previous version of this chapter was presented at the 67th Annual MPSA National Conference in Chicago, April 2009, and the Veto Players Workshop at the University of Mannheim in May 2009. We thank the participants for helpful comments and suggestions.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Thomas König .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer Science+Business Media, LLC

About this chapter

Cite this chapter

König, T., Luig, B., Proksch, SO., Slapin, J.B. (2011). Measuring Policy Positions of Veto Players in Parliamentary Democracies. In: König, T., Debus, M., Tsebelis, G. (eds) Reform Processes and Policy Change. Studies in Public Choice, vol 16. Springer, New York, NY. https://doi.org/10.1007/978-1-4419-5809-9_4

Download citation

Publish with us

Policies and ethics