Quadratic voting in the wild: real people, real votes
Since their introduction in 1932, Likert and other continuous, independent rating scales have become the de facto toolset for survey research. Scholars have raised significant reliability and validity problems with these types of scales, and alternative methods for capturing perceptions and preferences have gained traction within specific domains. In this paper, we evaluate a new, broadly applicable approach to opinion measurement based on quadratic voting (QV), a method in which respondents express preferences by ‘buying’ votes for options using a fixed budget from which they pay quadratic prices for votes. Comparable QV-based and Likert-based survey instruments designed by Collective Decision Engines LLC were evaluated experimentally by assigning potential respondents randomly to one or the other method. Using a host of metrics, including respondent engagement and process-based metrics, we provide some initial evidence that the QV-based instrument provides a clearer measure of the preferences of the most intensely motivated respondents than the Likert-based instrument does. We consider the implications for survey satisficing, a key threat to the continued value of survey research, and discuss the mechanisms by which QV differentiates itself from Likert-based scales, thus establishing QV as a promising alternative survey tool for political and commercial research. We also explore key design issues within QV-based surveys to extend these promising results.
KeywordsSocial choice Collective decisions Survey methods Intensity of preference Preference elicitation Budgeted voting
JEL ClassificationC42 C93 D71 D78
- Fournier, P., Blais, A., Nadeau, R., Gidengil, E., & Nevitte, N. (2003). Issue importance and performance voting. Political Behavior, 25(1), 51–67. http://www.jstor.org/stable/3657314. Accessed 21 March 2016.
- Hylland, A., & Zeckhauser, R. (1979). A mechanism for selecting public goods when preferences must be elicited. Working paper, Kennedy School of Government, Harvard University.Google Scholar
- Krosnick, J. A., & Fabrigar, L. R. (2012). Designing rating scales for effective measurement in surveys. Lyberg/Survey Survey Measurement and Process Quality, pp. 141–164.Google Scholar
- Krosnick, J. A., Presser, S., Fealing, K. H., & Ruggles, S. (2015). The future of survey research: Challenges and opportunities. NSF. The National Science Foundation Advisory Committee for the Social, Behavioral and Economic Sciences Subcommittee on Advancing SBE Survey Research. https://www.nsf.gov/sbe/ac_materials/the_future_of_survey_research.pdf. Accessed 21 March 2016.
- Krosnick, J. A., Visser, P. S., & Harder, J. (2009). The psychological underpinnings of political behavior. In D. T. Gilbert, S. T. Fiske, & G. Lindzey (Eds.), Handbook of social psychology (pp. 1288–1342). New York, NY: Wiley.Google Scholar
- Lalley, S. P., & Weyl, E. G. (2016). Quadratic voting. SSRN Electronic Journal SSRN Journal. http://papers.ssrn.com/sol3/papers.cfm?abstract_id=2003531. Accessed 1 Aug 2016.
- Mullainathan, S., & Shafir, E. (2013). Scarcity: Why having too little means so much. New York: Times Books.Google Scholar
- Sides, J. (2014). Most political independents actually aren’t. Washington Post. The Washington Post. https://www.washingtonpost.com/news/monkey-cage/wp/2014/01/08/most-political-independents-actually-arent/. Accessed 21 March 2016.
- Tideman, T. N., & Plassmann, F. (2016), Efficient collective decision-making, marginal cost pricing, and quadratic voting. SSRN Electronic Journal SSRN Journal. http://ssrn.com/abstract=2836610. Accessed 11 September 2016.
- Weyl, E. G. (2012). Quadratic vote buying. SSRN Electronic Journal SSRN Journal. http://papers.ssrn.com/sol3/papers.cfm?abstract_id=2003531. Accessed 1 August 2016.