The Role of Call Quality in Voter Mobilization: Implications for Electoral Outcomes and Experimental Design
We demonstrate the centrality of high quality personal interactions for successfully overcoming the collective action problem of voter mobilization, and highlight the need for attention to treatment quality before making substantive inferences from field experiments. We exploit natural variation in the quality of voter mobilization phone calls across call centers to examine how call quality affects voter mobilization in a large-scale field experiment conducted during the 2010 Election. High quality calls (from call centers specializing in calling related to politics) produced significant increases in turnout. In contrast, low quality calls (from multi-purpose commercial call centers) failed to increase turnout. Furthermore, we offer caution about using higher contact rates as an indication of delivery quality. Our treatment conditions with higher contact rates had no impact on turnout, suggesting an unfavorable trade-off between quantity of contacts and call quality.
KeywordsField experiment Voter mobilization Causal inference Experimental design Mobilization calls House effects
We thank our partner organization for the support that made this research possible. We thank the editors, anonymous reviewers, Stephen Ansolabehere, Donald Green, John Love, Frank Sansom, Brian Shaffner, and the participants in the Political Science Faculty Colloquium at the University of Miami for their helpful comments. An earlier version of this paper was presented at the 2012 Midwest Political Science Association Conference. This research was conducted under University of Miami Human Subjects Research Office Protocol #20110124. Replication data is available at http://www.sites.google.com/site/christopherbmann. All errors are the responsibility of the authors.
- American Association for Public Opinion Research (AAPOR). (2011). Standard definitions: Final dispositions of case codes and outcome rates for surveys (7th ed.). Washington: AAPOR.Google Scholar
- Dahl, R. A. (1956). A preface to democratic theory. Chicago: University of Chicago Press.Google Scholar
- Green, Donald P., & Gerber, A. S. (2008). Get out the vote! (2nd ed.). Washington: Brookings.Google Scholar
- Mann, C. B. (2011). Preventing ballot roll-off: A multi-state field experiment addressing an overlooked deficit in voting participation. New Orleans: Annual Meeting of the Southern Political Science Association.Google Scholar
- Nickerson, D. W. (2011). When the client owns the data. The experimental political scientist: Newsletter of the APSA experimental section, 2(2), 5–6.Google Scholar
- Olson, M. (1965). The logic of collective action: Public goods and the theory of groups. Cambridge: Harvard University Press.Google Scholar
- Porter, T. (1995). Trust in numbers. Princeton: Princeton Univ. Press.Google Scholar
- Viterna, J. S., & Maynard, D. W. (2002). How uniform is standardization? Variation within and across survey research centers regarding protocols for interviewing. In D. W. Maynard, H. Houtkoop-Steenstra, N. C. Schaeffer, & J. van der Zouwen (Eds.), Standardization and tacit knowledge: Interaction and practice in the survey interview. New York: Wiley.Google Scholar