The elusive sources of legitimacy beliefs: Civil society views of international election observers

Abstract

When do members of civil society view international election observers as legitimate? Motivated by recent work on the legitimacy of international organizations, we evaluate what type of information affects non-governmental organizations’ (NGOs) beliefs about international election observer groups, which include both intergovernmental organizations (IGOs) and international non-governmental organizations (INGOs) that seek to exercise authority, often regarding the same elections. Specifically, we examine the effects of two different types of information: information about the observers’ objective substantive features versus information that serves as heuristic shortcuts. Three survey-based experiments – one in Kenya and the others global – prime NGO respondents with information about both real and hypothetical election observer groups in ways intended to affect their votes for which organizations should be invited to observe the next election in their countries. In general, the primes about the objective substantive sources of legitimacy beliefs failed to produce consistent, measurable changes in responses among NGOs across both the hypothetical and real-world observer groups. That is, telling NGOs about the qualities of the organizations work failed to change perceptions. What mattered instead, however, was an organizations’ prominence or type, features that likely served as heuristic shortcuts. The findings, however, varied depending on whether we used hypothetical or real organizations. With hypothetical organizations, NGO respondents preferred other NGOs, suggesting an isomorphism heuristic. Conversely, with real organizations NGO respondents preferred more prominent and well-known intergovernmental organizations. This suggests that the isomorphism and prominence of observer organizations can drive legitimacy beliefs. Given the differences between using real versus hypothetical organizations, however, it also cautions against using hypothetical actors in survey experiments.

This is a preview of subscription content, log in to check access.

Fig. 1
Fig. 2
Fig. 3

Notes

  1. 1.

    See, for example, the 1992 report from NDI (National Democratic Institute for International Affairs 1992).

  2. 2.

    The Kenyan Star claimed that an internal report revealed that the EU had strong reservations about the processing of the results. Meanwhile, the International Crisis Group (ICG) noted numerous problems and criticized the swiftness with which international observer groups pronounced all well in Kenya’s vote (Kelley 2013). See also Table 2.

  3. 3.

    “Foreign election observers endorsed a deeply flawed election in Kenya. Now they face questions,” Quarts Africa, September 6, 2017. https://qz.com/1068521/kenya-elections-deeply-flawed-questions-foreign-observers/. Last accessed 24 April, 2018.

  4. 4.

    We registered the experimental designs and pre-analysis plans here: http://egap.org/design-registrations, numbers 20151112AB and 20160224AA.

  5. 5.

    Note that this article engages primarily with the literature on international organizations in political science, though there are a number of other pieces that are relevant, and that a longer article could engage with more fully. For example, Lister makes important and related arguments about “northern” NGOs and their process of constructing legitimacy from an anthropological perspective (2003). This empirically focused article is strongly motivated by Tallberg and Zürn (2019) and we recommend any readers access both pieces.

  6. 6.

    For an application to international democracy as seen in international parliamentary institutions, see Rocabert et al. (2018)

  7. 7.

    Similarly, transnational NGOs have been criticized for a lack of accountability or representation, and their reputations might be difficult to shift (Grant and Keohane 2005; Rubenstein 2014).

  8. 8.

    Declaration of Principles for International Election Observations and Code of Conduct for International Election Observers, 2005. Available online at https://www.ndi.org/DoP. Last accesses April 29, 2018.

  9. 9.

    Note that what performance legitimacy means in the context of international election observation is subject to debate, and IGOs and INGOs in particular may have varying conceptions of legitimacy as it relates to their performance or the construction of “effectiveness” (Lister 2003). NGOs, we note, are not expected to represent the populations they serve in the same way as IGOs (Rubenstein 2014, 2016), and may not have access to performance legitimacy in the traditional sense. They may also rely more heavily on credibility and reputation (Gourevitch et al. 2012).

  10. 10.

    See for example Harteveld et al. (2013); Armingeon and Ceka (2014); Dellmuth and Tallberg (2015).

  11. 11.

    See, for example, Sanchez (2014)

  12. 12.

    Note that NGOs may become prominent not because they are passionately carrying out their missions, but precisely because they have managed to assuage multiple key audiences by toning it down (Stroup and Wong 2017).

  13. 13.

    Heterogeneity across the types of subject NGOs does not appear to have affected results appreciably. Treatment effects for the subgroups of NGOs self-reporting a political mandate or not are substantively similar to the main results reported in Table 3.

  14. 14.

    Experiment 1 (Kenya) also included additional treatment conditions derived from a collaborative project. They are shown in the online appendix but omitted for economy of presentation here because we did not retain them for Experiments 2 or 3.

  15. 15.

    Two control statements added to the five substantive objective conditions were used to create numerical balance in comparison with the seven named election observer organizations. This both facilitated experimental design and also allowed us to verify that no meaningful confounds arose from specific wording of the control statements, verified in subsequent analysis.

  16. 16.

    Covariates for the number of employees, number of volunteers, number of current projects, and whether or not the organization engages in political activities were included in estimation but omitted for presentation purposes. Omission of the covariates in estimation does not alter the results substantively. Full results can be viewed in the appendix. Additional treatment conditions not employed across all experiments were also included in estimation but coefficients and standard errors are omitted for presentation purposes. These fuller results for additional treatment conditions not retained across the three experiments are also available in the appendix. Again, their inclusion or omission in the models does not substantively alter results.

  17. 17.

    Note that IGOs and NGOs may have different preferences with respect to independence, as noted above, which suggests an interaction effect between the independence treatment and the named organizations. There is some evidence for the interaction, though not necessarily as expected. For the vote outcome, the interaction term for the independent treatment with the regional treatment is positive and significant; the interaction of independent and the UN is negative and significant for votes. All other interaction effects are either not statistically significant or not robust across specifications.

  18. 18.

    When subjects were randomly prompted that the monitoring organization was well known and widely covered by media, this treatment significantly decreased their votes for the observer group by 3.7. The mean number of votes received was 16.9 and the standard deviation 15.7. So, the effect size (in standard deviation units) was 0.23, which is modest substantively.

  19. 19.

    See Grant and Keohane (2005) for a discussion of the relatively weak accountability structures facing NGOs.

  20. 20.

    In 2007 in particular, the AU failed to criticize the elections that erupted in widespread riots.

  21. 21.

    Though note that this possibility is also consistent with generally high levels of trust in NGOs amongst the general public, and we do not test whether NGO respondents were more likely to trust election observation NGOs relative to the general public. See also the Edleman Trust Baromotor (Edelman 2018) and relevant work by Keating and Thrandardottir (2017) and Logister (2007)

  22. 22.

    Though note that much of this existing research focuses more on citizen attitudes about the legitimacy of the election rather than the factors that increase or decrease legitimacy beliefs about election observers.

  23. 23.

    Ironically, whereas the Carter Center had performed credibly in past Kenyan elections, in the 2017 elections, conducted after this study, a premature positive statement by former US Secretary of State John Kerry, threw the legitimacy of the Carter Center into doubt and deepened skepticism of foreign observers even further.

References

  1. Anderson, B., Bernauer, T., & Kachi, A. (2018). Does international pooling of authority affect the perceived legitimacy of global governance? The Review of International Organizations. https://doi.org/10.1007/s11558-018-9341-4.

  2. Armingeon, K., & Ceka, B. (2014). The loss of trust in the European Union during the great recession since 2007: The role of heuristics from the national political system. European Union Politics, 15(1), 82–107.

    Article  Google Scholar 

  3. Ashforth, B. E., & Mael, F. (1989). Social identity theory and the organization. Academy of Management Review, 14(1), 20–39.

    Article  Google Scholar 

  4. Beetham, D. (1991). The legitimation of power. Macmillan.

  5. Benstead, L. J., Kao, K., & Lust, E. (n.d.). Does it matter what observers say? The impact of international election monitoring on legitimacy. http://www.academia.edu/30532200/Does_it_Matter_What_Observers_Say_The_Impact_of_International_Election_Monitoring_on_Legitimacy. Accessed 26 Apr 2018.

  6. Berger, J., Sorensen, A. T., & Rasmussen, S. J. (2010). Positive effects of negative publicity: When negative reviews increase sales. Marketing Science, 29(5), 815–827.

    Article  Google Scholar 

  7. Bjornlund, E. (2004). Beyond free and fair: Monitoring elections and building democracy. Washington, D.C.: Woodrow Wilson Center Press.

    Google Scholar 

  8. Bland, G. (2015). Measuring the quality of Kenya’s march 2013 election. Election Law Journal: Rules, Politics and Policy, 14(2), 136–147.

    Article  Google Scholar 

  9. Bornstein, R. F. (1989). Exposure and affect: Overview and meta-analysis of research, 1968–1987. Psychological Bulletin, 106(2), 265–289.

    Article  Google Scholar 

  10. Brewer, M. B. (1979). In-group bias in the minimal intergroup situation: A cognitive-motivational analysis. Psychological Bulletin, 86(2), 307–324.

    Article  Google Scholar 

  11. Brown, S. (2001). Authoritarian leaders and multiparty elections in Africa: How foreign donors help to keep Kenya’s Daniel Arap Moi in power. Third World Quarterly, 22(5), 725–739.

    Article  Google Scholar 

  12. Bush, S. S., & Prather, L. (2017). The promise and limits of election observers in building election credibility. The Journal of Politics, 79(3), 921–935.

    Article  Google Scholar 

  13. Bush, S. S., & Prather, L. (2018). Who’s there? Election observer identity and the local credibility of elections. International Organiztion, 72(3).

  14. Caldeira, G. A., & Gibson, J. L. (1992). The etiology of public support for the supreme court. American Journal of Political Science, 36, 635–664.

    Article  Google Scholar 

  15. Chaudoin, S. (2014). Promises or policies? An experimental analysis of international agreements and audience reactions. International Organization, 68(01), 235–256.

    Article  Google Scholar 

  16. Cole, R. J. (2013). Africa’s relationship with the international criminal court: More political than legal. Melbourne Journal of International Law, 14(2), 353–382.

    Google Scholar 

  17. Dafoe, A., Zhang, B., & Caughey, D. (forthcoming). Information equivalence in survey experiments. Political Analysis https://www.dropbox.com/s/j9b5xow6yscfigi/17-07-31-2143_confounding-sa.pdf?dl=0. Accessed 26 April 2018.

  18. Davies, G. A. M., & Johns, R. (2013). Audience costs among the British public: The impact of escalation, crisis type, and prime ministerial rhetoric. International Studies Quarterly, 57(4), 725–737.

    Article  Google Scholar 

  19. Dellmuth, L. M., & Tallberg, J. (2015). The social legitimacy of international organisations: Interest representation, institutional performance, and confidence extrapolation in the United Nations. Review of International Studies, 41(3), 451–475. https://doi.org/10.1017/S0260210514000230.

    Article  Google Scholar 

  20. Dellmuth, L. M., & Tallberg, J. (2018). Elite communication and the legitimacy of international organizations. Unpublished paper.

  21. Desposato, S., & Garztke, E. (2013). How “democratic” is the democratic peace? A survey experiment of foreign policy preferences in Brazil and China. Working Paper, Univ. Calif. San Diego and Univ. Essex.

  22. Desposato, S., Gartzke, E., & Suong, C. (2013). How popular is the democratic peace? A survey experiment of political preferences in Brazil and China. Working Paper. http://www.scpi.politicaldata.org/SCPIV/scpi6_Desposato.pdf. Accessed 26 April 2018.

  23. Downs, A. (1957). An economic theory of political action in a democracy. Journal of Political Economy, 65(2), 135–150.

    Article  Google Scholar 

  24. Edelman. (2018). 2018 Edelman TRUST BAROMETER. https://www.edelman.com/trust-barometer. Accessed 15 May 2018.

  25. Findley, M. G., Laney, B., Nielson, D. L., & Sharman, J. C. (2017). External validity in parallel global field and survey experiments on anonymous incorporation. The Journal of Politics, 79(3), 856–872. https://doi.org/10.1086/690615.

    Article  Google Scholar 

  26. Follesdal, A., & Hix, S. (2006). Why there is a democratic deficit in the EU: A response to Majone and Moravcsik. JCMS: Journal of Common Market Studies, 44(3), 533–562. https://doi.org/10.1111/j.1468-5965.2006.00650.x.

    Article  Google Scholar 

  27. Franck, T. M. (1990). The power of legitimacy among nations. New York: Oxford University Press.

    Google Scholar 

  28. Gelpi, C. (2010). Performing on cue? The formation of public opinion toward war. Journal of Conflict Resolution, 54(1), 88–116.

    Article  Google Scholar 

  29. Gourevitch, P. A., Lake, D. A., & Stein, J. G. (2012). The credibility of transnational NGOs: When virtue is not enough. Cambridge University Press.

  30. Grant, R. W., & Keohane, R. O. (2005). Accountability and abuses of power in world politics. American Political Science Review, 99(1), 29–43.

    Article  Google Scholar 

  31. Haidt, J. (2012). The righteous mind: Why good people are divided by politics and religion. Knopf Doubleday Publishing Group.

  32. Harteveld, E., van der Meer, T., & Vries, C. E. D. (2013). In Europe we trust? Exploring three logics of trust in the European Union. European Union Politics, 14(4), 542–565.

    Article  Google Scholar 

  33. Held, D. (1995). Democracy and the global order: From the modern state to cosmopolitan governance. Palo Alto: Stanford University Press.

  34. Hetherington, M. J., & Nugent, J. D. (2001). Explaining public support for devolution: The role of political trust. In What is it about government that Americans dislike (pp. 134–151).

  35. Horowitz, M. C., & Levendusky, M. S. (2011). Drafting support for war: Conscription and mass support for warfare. Journal of Politics, 73(02), 524–534.

    Article  Google Scholar 

  36. Hurd, I. (1999). Legitimacy and Authority in International Politics. International Organization, 53(2), 379–408.

    Article  Google Scholar 

  37. Hurd, I. (2002). Legitimacy, power, and the symbolic life of the UN security council. Global Governance, 8(1), 35–51.

    Article  Google Scholar 

  38. Hyde, S. D. (2011a). The Pseudo-democrat’s dilemma, why election observation became an international norm. Ithaca: Cornell University Press Accessed 26 April 2018.

    Google Scholar 

  39. Hyde, S. D. (2011b). Catch us if you can: Election monitoring and international norm diffusion. American Journal of Political Science, 55(2), 356–369.

    Article  Google Scholar 

  40. Hyde, S. D. (2012). Why believe international election monitors? In P. A. Gourevitch, D. A. Lake, & J. G. Stein (Eds.), The credibility of transnational NGOs: When virtue is not enough. Cambridge University Press.

  41. Hyde, S. D. (2015). Experiments in international relations: Lab, survey, and field. Annual Review of Political Science, 18(1), 403–424.

    Article  Google Scholar 

  42. Jennings, M. K. (1998). Political trust and the roots of devolution. In V. Braithwaite & M. Levi (Eds.), Trust and governance (pp. 218–44). Russell Sage Foundation.

  43. Johns, R., & Davies, G. A. M. (2012). Democratic peace or clash of civilizations? Target states and support for war in Britain and the United States. The Journal of Politics, 74(04), 1038–1052.

    Article  Google Scholar 

  44. Keating, V. C., & Thrandardottir, E. (2017). NGOs, trust, and the accountability agenda. The British Journal of Politics and International Relations, 19(1), 134–151. https://doi.org/10.1177/1369148116682655.

    Article  Google Scholar 

  45. Kelley, J. G. (2008). Assessing the complex evolution of norms: The rise of international election monitoring. International Organization, 62(02), 221–255.

    Article  Google Scholar 

  46. Kelley, J. G. (2009a). The more the merrier? The effects of having multiple international election monitoring organizations. Perspectives on Politics, 7(01), 59–64.

    Article  Google Scholar 

  47. Kelley, J. G. (2009b). D-minus elections: The politics and norms of international election observation. International Organization., 63, 765.

    Article  Google Scholar 

  48. Kelley, J. G. (2012). Monitoring democracy: When international election observation works, and why it often fails. Princeton University Press.

  49. Kelley, J. G. (2013). Watching the watchmen: the role of election observers in Africa. Think Africa Press. https://thinkafricapress.com/watching-watchmen-role-election-observers-africa-kenya-drc-zimbabwe/. Accessed 19 Dec 2018.

  50. Levendusky, M. S., & Horowitz, M. C. (2012). When backing down is the right decision: Partisanship, new information, and audience costs. Journal of Politics, 74(02), 323–338.

    Article  Google Scholar 

  51. Levy, J. S., McKoy, M. K., Poast, P., & Wallace, G. P. R. (2015). Backing out or backing in? Commitment and consistency in audience costs theory. American Journal of Political Science, 59(4), 988–1001.

    Article  Google Scholar 

  52. Lister, S. (2003). NGO legitimacy: Technical issue or social construct? Critique of Anthropology, 23(2), 175–192.

    Article  Google Scholar 

  53. Logister, L. (2007). Global governance and civil society. Some reflections on NGO legitimacy. Journal of Global Ethics, 3(2), 165–179. https://doi.org/10.1080/17449620701437988.

    Article  Google Scholar 

  54. Majone, G. (1998). Europe’s ‘democratic deficit’: The question of standards. European Law Journal, 4(1), 5–28.

    Article  Google Scholar 

  55. National Democratic Institute for International Affairs. (1992). NDI mission to the Republic of Kenya (International Delegation Report).

  56. Newton, K., & Norris, P. (2000). Confidence in political institutions: Faith, culture, or performance? In S. J. Pharr & R. D. Putnam (Eds.), Disaffected democracies: What’s troubling the trilateral countries? (pp. 52–73). Princeton: Princeton University Press.

    Google Scholar 

  57. Nye, J. S. (1997). Introduction: The decline of confidence in government. In J. S. Nye, P. Zelikow, & D. C. King (Eds.), Why people don’t trust government (pp. 1–18). Harvard University Press.

  58. Owuor, M., Nguyen, D., Kuria, A., & Salinas, A. O. (2008). The electoral process in Kenya: A review of past experience and recommendations for reform. International Foundation for Electoral Systems.

  59. Pearl, J. (1984). Heuristics: Intelligent search strategies for computer problem solving. Addison-Wesley.

  60. Rawls, J. (1971). A theory of justice. Belknap Press of Harvard University Press.

  61. Rocabert, J., Schimmelfennig, F., Crasnic, L., & Winzen, T. (2018). The Rise of international parliamentary institutions: purpose and legitimation. The Review of International Organizations. https://doi.org/10.1007/s11558-018-9326-3.

  62. Rubenstein, J. C. (2014). The misuse of power, not bad representation: Why it is beside the point that no one elected Oxfam. Journal of Political Philosophy, 22(2), 204–230. https://doi.org/10.1111/jopp.12020.

    Article  Google Scholar 

  63. Rubenstein, J. C. (2016). Between Samaritans and States: The Political Ethics of Humanitarian INGOs (reprint edition.). Oxford: Oxford University Press.

  64. Sanchez, R. (2014, October 19). WHO to review Ebola response amid criticism. CNN. https://www.cnn.com/2014/10/18/world/who-ebola-response/index.html. Accessed 16 May 2018.

  65. Scharpf, F. W. (1970). Demokratietheorie Zwischen Utopie Und Anpassung. Vol. 25. Konstanzer Universitätsreden. Konstanz: Druckerei u. Verlagsanst. Universitätsverl.

  66. Schmidtke, H. (2018). Elite legitimation and delegitimation of international organizations in the media: Patterns and explanations. The Review of International Organizations. https://doi.org/10.1007/s11558-018-9320-9.

  67. Simon, H. A. (1955). A behavioral model of rational choice. The Quarterly Journal of Economics, 69(1), 99–118.

    Article  Google Scholar 

  68. Stroup, S. S., & Wong, W. H. (2017). The authority trap: Strategic choices of international NGOs. Ithac: Cornell University Press.

    Google Scholar 

  69. Suchman, M. C. (1995). Managing legitimacy: Strategic and institutional approaches. Academy of Management Review, 20(3), 571–610.

    Article  Google Scholar 

  70. Tallberg, J., & Zürn, M. (2019). The legitimacy and legitimation of international organizations: introduction and framework. The Review of International Organizations. (this issue).

  71. Tomz, M. (2007). Domestic audience costs in international relations: An experimental approach. International Organization, 61(4), 821–840.

    Article  Google Scholar 

  72. Tomz, M., & Weeks, J. L. P. (2013). Public opinion and the democratic peace. American Political Science Review, 107(04), 849–865.

    Article  Google Scholar 

  73. Trager, R. F., & Vavreck, L. (2011). The political costs of crisis bargaining: Presidential rhetoric and the role of party. American Journal of Political Science, 55(3), 526–545.

    Article  Google Scholar 

  74. Tversky, A., & Kahneman, D. (1973). Availability: A heuristic for judging frequency and probability. Cognitive Psychology, 5(2), 207–232.

    Article  Google Scholar 

  75. Wallace, G. P. R. (2013a). International law and public attitudes toward torture: An experimental study. International Organization, 67(01), 105–140.

    Article  Google Scholar 

  76. Wallace, G. P. R. (2013b). Martial law? Military experience, international law, and support for torture. International Studies Quarterly.

  77. Weber, M. (1978). Economy and society: An outline of interpretive sociology. (G. Roth & C. Wittich, Eds.). Berkeley: University of California Press.

  78. Zajonc, R. B. (1968). Attitudinal effects of mere exposure. Journal of Personality and Social Psychology, 9(2p2), 1–27.

    Article  Google Scholar 

  79. Zaum, D. (Ed.). (2013). Legitimating International Organization. Oxford. New York: Oxford University Press.

    Google Scholar 

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to Daniel L. Nielson.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

ESM 1

(ZIP 180 kb)

ESM 2

(DOCX 48 kb)

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Nielson, D.L., Hyde, S.D. & Kelley, J. The elusive sources of legitimacy beliefs: Civil society views of international election observers. Rev Int Organ 14, 685–715 (2019). https://doi.org/10.1007/s11558-018-9331-6

Download citation

Keywords

  • Legitimacy
  • Civil society
  • International election observation
  • Survey experiment
  • Heuristics