When Treatments are Tweets: A Network Mobilization Experiment over Twitter
This study rigorously compares the effectiveness of online mobilization appeals via two randomized field experiments conducted over the social microblogging service Twitter. In the process, we demonstrate a methodological innovation designed to capture social effects by exogenously inducing network behavior. In both experiments, we find that direct, private messages to followers of a nonprofit advocacy organization’s Twitter account are highly effective at increasing support for an online petition. Surprisingly, public tweets have no effect at all. We additionally randomize the private messages to prime subjects with either a “follower” or an “organizer” identity but find no evidence that this affects the likelihood of signing the petition. Finally, in the second experiment, followers of subjects induced to tweet a link to the petition are more likely to sign it—evidence of a campaign gone “viral.” In presenting these results, we contribute to a nascent body of experimental literature exploring political behavior in online social media.
KeywordsField experiments Networks Political participation
The authors would like to thank the League of Conservation Voters, whose support and eagerness to include new experimental designs in its programs made this study possible. We also thank the Analyst Institute for its initial support of this project. The authors’ names are listed in alphabetical order. We particularly thank Amit Mistry, Vanessa Kritzer, Kristin Brown, and Mo Maraqa at LCV for their crucial roles in the planning and implementation of the two experiments. We are further grateful to Andy Przybylski and Neelanjan Sircar for extremely helpful discussions and feedback during the early stages of this project. We also thank Kevin Collins, Lindsay Dolan, Ben Farrer, Don Green, Lucas Leemann, three anonymous reviewers, and the editors of Political Behavior for their helpful comments and advice. An earlier version of this paper was presented at the 2014 Annual Meeting of the American Political Science Association in Washington, D.C., where we benefited from a lively discussion with participants and comments by Jaime Settle. This study would not have been possible without the use of Columbia University's Hotfoot High Performance Computing (HPC) Cluster for hosting the scraping programs.
- Aaker, J., & Akutsu, S. (2009). Why do people give?. The role of identity in giving: Stanford University Graduate School of Business Research Paper.Google Scholar
- Benkler, Y. (2006). The wealth of networks: How social production transforms markets and freedom. New Haven, CT: Yale University Press.Google Scholar
- Bryan, CJ., Walton, GM., Rogers, T., Dweck, CS. (2011). Motivating voter turnout by invoking the sel. In Proceedings of the National Academy of Sciences (vol 108(31), pp. 12,653–12,656).Google Scholar
- Converse, P. E. (1964). The nature of belief systems in mass publics. In D. E. Apter (Ed.), Ideology and Discontent. Ann Arbor: University of Michigan Press.Google Scholar
- Gerber, A. S., & Green, D. P. (2012). Field Experiments: Design, Analysis, and Interpretation. New York: W. W. Norton.Google Scholar
- Gladwell, M. (2010). Small change: Why the revolution will not be tweeted. The New Yorker.Google Scholar
- Gong, S., Zhang, J., Zhao, P., Jiang, X. (2014). Tweets and sales. Retrived from SSRN Working Paper.Google Scholar
- Kobayashi, T., Ichifuji, Y. (2014). Tweets that matter: Evidence from a randomized field experiment in Japan. In Annual Meeting of the Southern Political Science Association.Google Scholar
- Morozov, E. (2009). Iran: Downside to the ‘Twitter revolution’. Dissent.Google Scholar
- Olson, M. (1965). The logic of collective action. Cambridge: Harvard University Press.Google Scholar
- Rosenstone, S., & Hansen, J. M. (1993). Mobilization, Participation and Democracy in America. New York: MacMillan Publishing.Google Scholar
- Shirky, C. (2008). Here Comes Everybody: The Power of Organizing Without Organizations. New York: Penguin Group.Google Scholar
- Taylor, S.J., Muchnik, L., Aral, S. (2014). Identity and opinion: A randomized experiment. Retrieved from SSRN.Google Scholar
- Teresi, H., Michelson, M. (2014). Wired to mobilize: The effect of social networking messages on voter turnout. The Social Science Journal. doi: 10.1016/j.soscij.2014.09.004.
- Verba, S., Schlozman, K. L., & Brady, H. E. (1995). Voice and Equality: Civic Voluntarism in American Politics. Cambridge: Harvard University Press.Google Scholar