Skip to main content

The Benefits and Challenges of Randomized Control Trials in Conflict Environments: Reflections From a Scholar-Practitioner

  • Chapter
  • First Online:

Part of the book series: Peace Psychology Book Series ((PPBS))

Abstract

A greater proportion of international aid spending is targeted towards conflict-affected and fragile environments. Concurrently, donors have higher standards for evidence of what programs are effective. The combination of these two trends provides social psychologists with ample opportunity to understand whether and under what conditions some core theories, such as the contact hypothesis and social identity theory, apply in the field. However, rigorously evaluating the effectiveness of development programs in conflict environments, particularly peacebuilding programs, through Randomized Control Trials (RCTs), comes with numerous challenges. These include (1) insecurity and consistent access to populations; (2) ethics of randomization especially, during a humanitarian crisis; and (3) how to maintain the integrity of a program and research design within a changing context. As a result, implementers are often resistant to conducting RCTs. Based on my experience as a scholar-practitioner, I describe the benefits of RCTs that implementers may be unaware of, such as how RCTs help disentangle the impacts of the program from the changing context, as well as how to address the most common concerns of implementers. The hope is that by better understanding and addressing implementers’ concerns, researchers will have more opportunities to rigorously test programs and theories, simultaneously improving theory and peacebuilding and development interventions globally.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    When I use “we” in this chapter, I’m referring to my colleagues at Mercy Corps and/or other research collaborators.

  2. 2.

    The herders we worked with migrated regularly.

  3. 3.

    There are also donor considerations that often affect this decision, which I describe below.

  4. 4.

    A potential downside of this approach for some people may be the seemingly lack of independence between the implementers and researchers. This is a risk, however, given how much data is often collected by implementers that is not used effectively, and with a bit more investment people could learn so much more, it feels worth investing in these studies in under less than ideal conditions.

  5. 5.

    I believe some form of payment, whether in cash or in kind, should be standard for all implementers when collecting data. People’s time is valuable. It may also help implementers be more intentional about how they use the data they collect given the added cost.

  6. 6.

    The early stages of the conflict in the Central Africa Republic were a rare example of when peacebuilding and humanitarian programs were being implemented simultaneously.

  7. 7.

    RCTs on unconditional cash transfers have largely been studied in more stable contexts, not in the midst of conflict (Blattman et al. 2017).

References

  • 3IE (2015). Peacebuilding evidence gap map. Retrieved from: http://gapmaps.3ieimpact.org/evidence-maps/evidence-peacebuilding-evidence-gap-map.

  • Alfadhli, K. & Drury, J. (2020). On the borders: Research with refugees of conflict. In Y. Acar, S. M. Moss, & Ö. M. Uluğ (Eds.), Researching peace, conflict and power in the field: Methodological challenges and opportunities (pp. 129–148). Peace Psychology Book Series. Cham, Switzerland: Springer.

    Google Scholar 

  • Allport, G. (1954). The nature of prejudice. Reading, MA: Addison-Wesley.

    Google Scholar 

  • Amir, Y. (1976). The role of intergroup contact in change of prejudice and race relations. In P. A. Katz (Ed.), Towards the elimination of racism (pp. 245–280). New York, NY: Pergamon.

    Chapter  Google Scholar 

  • Baird, S., Hicks, J. H., Kremer, M., & Miguel, E. (2016). Worms at work: Long-run impacts of a child health investment. The Quarterly Journal of Economics, 131(4), 1637–1680. https://doi.org/10.1093/qje/qjw022

  • Banerjee, A. & Duflo, E. (2011). Poor economics: A radical rethinking of the way to fight global poverty. New York, NY: PublicAffairs.

    Google Scholar 

  • Banerjee, A., Duflo, E., Goldberg, N., Karlan, D., Osei, R., Parienté, W., Shapiro, J., Thuysbaert, B., and Udry, C. (2015a). A multi-faceted program causes lasting progress for the very poor: Evidence from six countries. Science, 348(6236), 1260799. https://doi.org/10.1126/science.1260799

    Article  Google Scholar 

  • Banerjee, A., Karlan, D. & Zinman, J. (2015b). Six randomized evaluations of microcredit: Introduction and further steps. American Economic Journal: Applied Economics, 7(1), 1–21. https://doi.org/10.1257/app.20140287

  • Bayad, A. & Aydemir, A. (2020). When research, identity and context merge: A reflexive assessment on studying peace during conflict. In Y. Acar, S. M. Moss, & Ö. M. Uluğ (Eds.), Researching peace, conflict and power in the field: Methodological challenges and opportunities (pp. 283–300). Peace Psychology Book Series. Cham, Switzerland: Springer.

    Google Scholar 

  • Beaman, L., Hershkovitz, S., Keleher, N. & Macgruder (forthcoming). Stay in the dame: A randomized controlled trial of a sports and life skills program for vulnerable youth in Liberia. Economic Development and Cultural Change.

    Google Scholar 

  • Bilali, R., & Vollhardt, J. R. (2015). Do mass media interventions effectively promote peace in contexts of ongoing violence? Evidence from Eastern Democratic Republic of Congo. Peace and Conflict: Journal of Peace Psychology, 21(4), 604–620. https://doi.org/10.1037/pac0000124

  • Blattman, C. & Annan, J. (2016). Can employment reduce lawlessness and rebellion? A field experiment with high-risk men in a fragile state. American Political Science Review, 110(1), 1–17. https://doi.org/10.1017/S0003055415000520

    Article  Google Scholar 

  • Blattman, C., Faye, M., Karlan, D., Niehus, P., & Urdy, C. (2017a). Cash as capital. Stanford Social Innovation Review (Summer), 57–58. Retrieved from https://ssir.org/articles/entry/cash_as_capital?utm_source=Enews&utm_medium=Email&utm_campaign=SSIR_Now&utm_content=Title

  • Blattman, C., Fiala, N., & Martinez, S. (2014). Generating skilled self-employment in developing countries: Experimental evidence from Uganda. Quarterly Journal of Economics, 129(2), 697–752. https://doi.org/10.1093/qje/qjt057

    Article  Google Scholar 

  • Blattman, C., Fiala, N., & Martinez, S. (forthcoming). The long-term impacts of grants on poverty: 9-year evidence from the Youth Opportunities Program in Uganda. American Economic Review: Insights.

    Google Scholar 

  • Blattman, C., Jamison, J., & Sheridan, M. (2017b). Reducing crime and violence: Experimental evidence from cognitive behavioral therapy in Liberia. American Economic Review, 107(4), 1165–1206. https://doi.org/10.1257/aer.20150503

    Article  Google Scholar 

  • Blattman, C., & Ralston, L. (2015). Generating employment in poor and fragile states: Evidence from labor market and entrepreneurship programs. Retrieved from SSRN: https://ssrn.com/abstract=2622220

  • Brück, T., Ferguson, N., Izzi, V., & Stojetz, W. (2016). Jobs aid peace. Berlin, Germany: International Security and Development Center.

    Google Scholar 

  • Christensen, D., Dube, O., Haushofer, J., Siddiqi, B., & Voors, M. (2020). Healthcare Delivery during Crises: Experimental Evidence from Sierra Leone’s Ebola Outbreak. Working Paper.

    Google Scholar 

  • Cillers, J., Dube, O., & Siddiqui, B. (2016). Reconciling after civil conflict increases social capital but reduces individual wellbeing. Science, 352(6287), 787–794. https://doi.org/10.1126/science.aad9682

  • Collier, P., & Hoeffler, A. (2004). Greed and grievance in civil war. Oxford Economic Papers, 56(4), 563–595. https://doi.org/10.1093/oep/gpf064

    Article  Google Scholar 

  • Cronin-Furman, K. & Lake, M. (2018). Ethics abroad: Field work in fragile and violent contexts. PS: Political Science & Politics, 51(3), 607–614. https://doi.org/10.1017/S1049096518000379

  • Dionne, K.Y., Harawa, A., & Honde, H. (2015). The ethics of exclusion when experimenting in impoverished settings. In Desposato, S. (ed). Ethics and experiments in political science (pp. 25–41). New York, NY: Routledge.

    Google Scholar 

  • Desposato, S. (2015). Ethics and experiments in political science. New York, NY: Routledge.

    Google Scholar 

  • Ditlmann, R. K., & Samii, C. (2016). Can intergroup contact affect ingroup dynamics? Insights from a field study with Jewish and Arab-Palestinian youth in Israel. Peace and Conflict: Journal of Peace Psychology, 22(4), 380–392. https://doi.org/10.1037/pac0000217

  • Duflo, E., & Banarjee, A. (2017). Handbook of field experiments. Amsterdam, The Netherlands: North-Holland.

    Google Scholar 

  • Dupas, P. & Cohen, J. (2010). Free distribution or cost-sharing? Evidence from a randomized malaria prevention experiment. The Quarterly Journal of Economics, 125(1), 1–45. https://doi.org/10.2139/ssrn.1080301.

  • Dunning, T., Grossman, G., Humphreys, M., Hyde, S., McIntosh, C., & Nellis, G. (2019). Information, accountability, and cumulative learning: Lessons from Metaketa I. Cambridge, UK: Cambridge University Press.

    Book  Google Scholar 

  • Enos, R. (2014). Causal effect of intergroup contact on exclusionary attitudes. Proceedings of the National Academy of Sciences, 111(10), 3699–3704. https://doi.org/10.1073/pnas.1317670111

  • Galinsky, A., & Moskowitz, G. (2000). Perspective-taking: Decreasing stereotype expression, stereotype accessibility, and in-group favoritism. Journal of Personality and Social Psychology, 78, 708–724. https://doi.org/10.1037//0022-3514.78.4.708.

  • Goldstone, J. (2010). The New Population Bomb: The Four Megatrends That Will Change the World. Foreign Affairs, 89(1), 31–43.

    Google Scholar 

  • Gubler, J. (2011). The micro-motives of intergroup aggression: A case study in Israel. Unpublished Dissertation. University of Michigan, Ann Arbor, MI.

    Google Scholar 

  • Figueiredo, A., Montagna, P., & Rocha, C. (2020). Data collection with indigenous people: Fieldwork experiences from Chile. In Y. G. Acar, S. M. Moss, & Ö. M. Uluğ (Eds.), Researching peace, conflict and power in the field: Methodological challenges and opportunities (pp. 63–83). Peace Psychology Book Series. Cham, Switzerland: Springer.

    Google Scholar 

  • Hartman, A., Blair, R., & Blattman, C. (2018). Engineering informal institutions: Long-run impacts of alternative dispute resolution on violence and property rights in Liberia. Working paper. Retrieved from: https://www.nber.org/papers/w24482

  • Holla, A. (2018). Are we over-investing in baselines? Retrieved from: http://blogs.worldbank.org/impactevaluations/are-we-over-investing-baselines

  • Humphreys, M. (2014, November 2). How to make field experiments more ethical. The Washington Post. Retrieved from: https://www.washingtonpost.com/news/monkey-cage/wp/2014/11/02/how-to-make-field-experiments-more-ethical/?utm_term=.b95e728af290

  • Inks, L. & Wolfe, R. (2016). Motivations and empty promises: Voices of former Boko Haram combatants and Nigerian youth. Washington, DC: Mercy Corps.

    Google Scholar 

  • Karlan, D. & Appel, J. (2012). More than good intentions: Improving the way the world’s poor borrow, save, farm, learn and stay health. New York, NY: Random House.

    Google Scholar 

  • Kurtz, J., Tesfaye, B., & Wolfe, R.J. (2018). Can economic interventions reduce violence: Impacts of vocational training and cash transfers on youth support for political violence in Afghanistan. Washington, DC: Mercy Corps.

    Google Scholar 

  • Levine, R. (2017). The moral case for evidence in policymaking. Retrieved from: https://hewlett.org/moral-case-evidence-policymaking/

  • Lierl, M. & Holmlund, M. (2019). Performance-based voting in local elections: Experimental evidence from Burkina Faso. In Dunning, T., Grossman, G., Humphreys, M., Hyde, S., McIntosh, C., & Nellis, G. Information, accountability, and cumulative learning: Lessons from Metaketa I (pp. 221–256). Cambridge, UK: Cambridge University Press.

    Google Scholar 

  • Lyall, J., Zhou, Y., & Imai, K. (2019). Can economic assistance shape combatant support in Wartime? Experimental evidence from Afghanistan. American Political Science Review, 1–18. https://doi.org/10.1017/S0003055419000698

  • Mercy Corps (2015). Beyond Meeting Immediate Needs: The Impact of Electronic Cash Transfer Approaches on Disaster Recovery and Financial Inclusion. https://www.mercycorps.org/sites/default/files/TabangKO%20Impact%20Evaluation%20Report_Final.pdf

  • Moss, S. M., Uluğ, Ö. M., & Acar, Y. G. (2019). Doing research in conflict contexts: Practical and ethical challenges for researchers when conducting fieldwork. Peace and Conflict: Journal of Peace Psychology, 25(1), 86–99. https://doi.org/10.1037/pac0000334

  • Mousa, S. (2019). Building tolerance: Intergroup contact and soccer in post-ISIS Iraq. Working Paper.

    Google Scholar 

  • Muralidharan, M., Niehaus, P., & Sukhtankar, S. (2016). Building state capacity: Evidence from biometric smartcards in India. American Economic Review, 106(10), 2895–2929. https://doi.org/10.1257/aer.20141346

    Article  Google Scholar 

  • OCHA (2018, January 28). North-east Nigeria: Humanitarian Situation Update, December 2107. Retrieved from: https://reliefweb.int/report/nigeria/north-east-nigeria-humanitarian-situation-update-december-2017

  • Offer-Westort, M., Coppock, A., & Green, D. (2018). Adaptive experimental design: Prospects and applications in political science. Presented at the Annual Meeting of the American Political Science Association, Boston, August 30th - September 2, 2018. Retrieved from: https://alexandercoppock.com/papers/OCG_adaptive.pdf

  • Paler, L., Marshall, L. & Atallah, S. (2018). Discussing Politics in Ethnically Divided Societies: An Experiment in Lebanon. Working paper.

    Google Scholar 

  • Paolini, S., Harwood, J., & Rubin, M. (2010). Negative intergroup contact makes group memberships salient: Explaining why intergroup conflict endures. Personality & Social Psychology Bulletin, 36, 1723–38. https://doi.org/10.1177/0146167210388667.

  • Paluck, E. L. (2009). Reducing intergroup prejudice and conflict using the media: A field experiment in Rwanda. Journal of Personality and Social Psychology, 96, 574–587. https://doi.org/10.1037/a0011989

  • Paluck, E. L. (2010). Is it better not to talk? Group polarization, extended contact, and perspective-taking in eastern Democratic Republic of Congo. Personality and Social Psychology Bulletin, 36, 1170–1185. https://doi.org/10.1177/0146167210379868

  • Paluck, E. L. & Green, D. P. (2009). Deference, dissent, and dispute resolution: A field experiment on a mass media intervention in Rwanda. American Political Science Review, 103(4), 622–644. https://doi.org/10.1017/S0003055409990128

  • Paluck, E., Green. S., & Green, D. P. (2018). The contact hypothesis re-evaluated. Behavioural Public Policy, 3(2) 1–30. https://doi.org/10.1017/bpp.2018.25

  • Pettigrew, T. F., & Tropp, L. R. (2008). How does intergroup contact reduce prejudice? Metaanalytic tests of three mediators. European Journal of Social Psychology, 38(6), 922–934. https://doi.org/10.1002/ejsp.504

  • Scacco, A. & Warren, S. (2018). Can social contact reduce prejudice and discrimination? Evidence from a field experiment in Nigeria. American Political Science Review, 112(3), 654–677. https://doi.org/10.1017/S0003055418000151

  • Sherif, M. (1958). Superordinate goals in the reduction of intergroup conflict. American Journal of Sociology, 63, 349–356.

    Google Scholar 

  • Tajfel, H., & Turner, J. C. (1979). An integrative theory of intergroup conflict. In W. G. Austin & S. Worchel. The social psychology of intergroup relations (pp. 33–47). Monterey, CA: Brooks/Cole.

    Google Scholar 

  • Urdal, H. (2004). The devil in the demographics: The effect of youth bulges on domestic armed conflict, 1950-2000. Social Development Papers - Conflict Prevention & Reconstruction, Paper No. 14.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rebecca Wolfe .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Wolfe, R. (2020). The Benefits and Challenges of Randomized Control Trials in Conflict Environments: Reflections From a Scholar-Practitioner. In: Acar, Y.G., Moss, S.M., Uluğ, Ö.M. (eds) Researching Peace, Conflict, and Power in the Field. Peace Psychology Book Series. Springer, Cham. https://doi.org/10.1007/978-3-030-44113-5_14

Download citation

Publish with us

Policies and ethics