Abstract
What is transformational change? Can we define it? Can we measure it? Will we know a transformational change when it occurs? In the book Soonish (Weinersmith and Weinersmith 2017), the authors discuss transformational technologies: Ideas such as asteroid mining and cable cars that run up into space require technologies whose times have not yet come, but represent important ways in which the world’s existing woes—including the problem of resource constraints—may be solved. Most multilateral development agencies aim for change that is ‘transformational’ or that ‘shifts the paradigm’. Arguably, transformational change has become the holy grail in development assistance. Most development and environmental aid agencies aspire to support transformational change, referring in turn, at least in spirit if not in letter, to something that will change the way our work is done or the way we think about the impact of our work (Levine and Savedoff 2015). Despite this, definitions of what constitutes transformational change remain elusive, resulting in the near absence of evidence related to transformational change. In this chapter we discuss some experiences of organisations that have aimed to define and measure transformational change. We then discuss whether or not these definitions are necessary and sufficient, and explore potential ways in which measurement may occur.
This paper was first published as a Working Paper as part of the series published by the Independent Evaluation Unit (IEU) of the Green Climate Fund.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
See the Governing Instrument document of the Green Climate Fund.
- 2.
Devolution refers to the fact that measurement capacities need to exist not just in centres or HQs but also at the field level.
- 3.
This is not a comprehensive summary of their conclusions. We urge the reader to refer to the original document (IFAD 2016b).
- 4.
IFAD9 IAI committed IFAD to producing and reporting on 30 impact assessments, all of which would use either ex ante methods or ex post methods (one-fifth needed to use ex ante impact evaluation methods), while moving to ‘succinct accounts (of results reporting) that are focused on impacts and outcomes achieved’.
- 5.
GC 35/L.4 commits IFAD to “Raising the level of compliance with the requirement for projects to have a baseline survey by the end of their first year of implementation” (IFAD 2012, p. viii).
- 6.
The GEF IEO called it a ‘meta-evaluation’, although it wasn’t a meta-evaluation in the strict sense of the word. For example, see Borenstein et al. (2009) for definitions.
- 7.
- 8.
The introduction of evidence-based medicine, or just more operationally, handwashing or a change in doctors’ practices with respect to how they treat malaria or tuberculosis, the use of vaccines, the use of checklists (see, for example, Gawande 2009).
References
Banerjee A, Duflo E, Imbert C, Pande R, Walton M, Mohapatra BP (2014) An impact evaluation of information disclosure on elected representatives’ performance: evidence from rural and urban India. 3ie Impact Evaluation Report 11, August 2014. International Initiative for Impact Evaluation (3ie), New Delhi. http://www.3ieimpact.org/evidence-hub/publications/impact-evaluations/impact-evaluation-information-disclosure-elected. Last accessed 31 Jan 2019
Barooah B, Kaushish B, Puri J (2017) Understanding financial risks for smallholder farmers in low-and middle-income countries: what do we know and not know? 3ie Scoping Paper 9. International Initiative for Impact Evaluation (3ie), New Delhi. http://www.3ieimpact.org/evidence-hub/publications/scoping-reports/understanding-financial-risks-smallholder-farmers-low-and. Accessed 31 Jan 2019
Borenstein M, Hedges LV, Higgins JPT, Rothstein HR (2009) Introduction to meta-analysis. Wiley, London
Börner J, Baylis K, Corbera E, Ezzine-de-Blas D, Ferraro PJ, Honey-Rosés J, Lapeyre R, Persson UM, Wunder S (2016) Emerging evidence on the effectiveness of tropical forest conservation. PLoS ONE 11(11):e0159152. https://doi.org/10.1371/journal.pone.0159152
Burwen J, Levine DI (2012) A rapid assessment randomised-controlled trial of improved cookstoves in rural Ghana. 3ie Impact Evaluation Report 2. International Initiative for Impact Evaluation (3ie), New Delhi. http://www.3ieimpact.org/evidence-hub/publications/impact-evaluations/rapid-assessment-randomised-controlled-trial-improved. Accessed 31 Jan 2019
Chong A, Karlan D, Shapiro J, Zinman J (2013) (Ineffective) messages to encourage recycling: evidence from a randomized evaluation in peru. World Bank Econ Rev 29(1):180–206
CIF – The Climate Investment Funds (2014) Delivering at scale, empowering transformation: 2014 CIF Annual Report. World Bank, Washington, DC
CIF – The Climate Investment Funds (2016) Accelerating climate action: 2016 CIF Annual Report. World Bank, Washington, DC
CIF – The Climate Investment Funds (2017) CIF evaluation and learning initiative: transformational change approach paper. World Bank, Washington, DC
Crowley P, Chalmers I, Keirse MJNC (1990) The effects of corticosteroid administration before preterm delivery: an overview of the evidence from controlled trials. Br J Obstet Gynaecol 97:11–25
Davis B, Handa S, Hypher N, Rossi NW, Winters P, Yablonski J (2016) From evidence to action: the story of cash transfers and impact evaluation in Sub-Saharan Africa. J Dev Stud 52(12):1831–1832
Davis R (2015) The Doctor Who Championed Hand-Washing and Briefly Saved Lives. Shots – Health News from NPR. https://www.npr.org/sections/health-shots/2015/01/12/375663920/the-doctor-who-championed-hand-washing-and-saved-women-s-lives. Accessed 31 Jan 2019
FAO – Food and Agriculture Organization of the United Nations (2018) FAO Policy Support and Governance: Vision. http://www.fao.org/policy-support/vision/en/. Accessed 31 Jan 2019
FAO, CIFOR – Food and Agriculture Organization of the United Nations, Center for International Forestry Research (2017) Transformational impact potential and approaches to land use and REDD+ implementation: summary of the expert meeting held in Rome on 6 and 7 March 2017. FAO, CIFOR, Rome
FAO OED – Office of Evaluation of the Food and Agriculture Organization of the United Nations (2017) Evaluation of FAO’s contribution to the reduction of rural poverty through Strategic Programme 3. FAO OED, Rome. http://www.fao.org/3/a-bd600e.pdf. Accessed 31 Jan 2019
Garbero A (2016) Measuring IFAD’s impact: Background paper to the IFAD9 Impact Assessment Initiative. IFAD Research Series, Issue 7. IFAD, Rome. https://www.ifad.org/en/web/knowledge/publication/asset/39318659. Accessed 31 Jan 2019
Gawande A (2009) The checklist Manifesto: how to get things right. Metropolitan Books, New York
GCF – Green Climate Fund (2016) Decisions of the Board – Twelfth Meeting of the Board, 8–10 March 2016, Annex I: Initial Strategic Plan for the GCF. GCF, Songdo
GCF – Green Climate Fund (2017) Who we are: About the fund. http://www.greenclimate.fund/who-we-are/about-the-fund. Accessed 31 Jan 2019
GEF – Global Environment Facility (2015) GEF 2020: strategy for the GEF. World Bank, Washington, DC
GEF IEO – Independent Evaluation Office of the Global Environment Facility (2017) Review of GEF Support for Transformational Change, May 2017. GEF IEO, Washington, DC. https://www.gefieo.org/sites/default/files/ieo/evaluations/files/transformational-engagement-2017.pdf. Accessed 31 Jan 2019
GEF Secretariat – Secretariat of the Global Environment Facility (2017) Guidelines on the Project and Program Cycle Policy, GEF/C.52/Inf.06/Rev.01. GEF, Washington, DC. https://www.thegef.org/council-meeting-documents/guidelines-project-and-program-cycle-policy-0. Accessed 31 Jan 2019
Halpern D (2015) The rise of psychology in policy: the UK’s de facto council of psychological science advisers. Perspect Psychol Sci 10(6):768–771
IDB – Inter-American Development Bank (2015) Update to the institutional strategy 2010–2020: partnering with Latin America and the Caribbean to improve lives. IDB, Washington, DC. https://publications.iadb.org/handle/11319/7515. Accessed 31 Jan 2019
IFAD – International Fund for Agricultural Development (2012) Report of the Consultation on the Ninth Replenishment of IFAD’s Resources, GC 35/L.4. IFAD, Rome. https://webapps.ifad.org/members/gc/35/docs/GC-35-L-4.pdf. Accessed 31 Jan 2019
IFAD – International Fund for Agricultural Development (2014) A strategic vision for IFAD 2016–2025: enabling inclusive and sustainable rural transformation. IFAD, Rome. https://webapps.ifad.org/members/repl/10/2/docs/IFAD10-2-R-2.pdf. Accessed 31 Jan 2019
IFAD – International Fund for Agricultural Development (2016a) IFAD strategic framework 2016–2025: enabling inclusive and sustainable rural transformation. IFAD, Rome. https://www.ifad.org/web/knowledge/publication/asset/39369820/. Accessed 31 Jan 2019
IFAD – International Fund for Agricultural Development (2016b) Synthesis of lessons learned from the IFAD9 Impact Assessment Initiative, EB 2016/117/R.8/Rev.1. IFAD, Rome. https://webapps.ifad.org/members/eb/117/docs/EB-2016-117-R-8-Rev-1.pdf. Accessed 31 Jan 2019
Ioannidis JPA (2005a) Contradicted and initially stronger effects in highly cited clinical research. JAMA 294(2): 218–228
Ioannidis JPA (2005b) Why most published research findings are false. PLoS ONE Med 2(8):696–701
Levine R, Savedoff W (2015) Aid at the frontier: building knowledge collectively. J Dev Effect 7(3):275–289
Nicolay CR (2006) Hand hygiene: an evidence-based review for surgeons. Int J Surg 4(1):53–65
Osbaldiston R (2013) Synthesizing the experiments and theories of conservation psychology. Sustainability 5:2770–2795
Osbaldiston R, Schott JP (2012) Environmental sustainability and behavioral science: a meta-analysis of proenvironmental behavior experiments. Environ Behav 44:257–299
Pereira TV, Horwitz RJ, Ioannidis JPA (2012) Empirical evaluation of very large treatment effects of medical interventions. JAMA 308(16):1676–1684
Pittet D, Hugonnet S, Harbarth S, Mourouga P, Sauvan V, Touveneau S, Perneger TV (2000) Effectiveness of a hospital-wide programme to improve compliance with hand hygiene. Lancet 356(9238):1307–1312
Prasad V, Vandross A, Toomey C, Cheung M, Rho J, Quinn S, Chacko S, Borkar D, Gall V, Selvaraj S, Ho N, Cifu A (2013) A decade of reversal: an analysis of 146 contradicted medical practices. Mayo Clinic Proc 88(8):790–798
Rogers EM (2003) Diffusion of innovations. Free Press, New York
Samii C, Lisiecki M, Kulkarni P, Paler L, Chavis L (2014) Effects of decentralized forest management (DFM) on deforestation and poverty in low and middle income countries. Campbell Syst Rev 10(1):1–88. CEE Review 13-015a. https://www.environmentalevidence.org/wp-content/uploads/2015/01/Samii_DFM_Review-formatted-for-CEE.pdf
Shahar A, Gino F, Barkan R, Ariely D (2015) Three principles to REVISE people’s unethical behavior. Perspect Psychol Sci 10(6):738–741
WB IEG – World Bank Independent Evaluation Group (2016) Supporting transformational change for poverty reduction and shared prosperity: lessons from World Bank Group experience. World Bank Group, Washington, DC. https://ieg.worldbankgroup.org/sites/default/files/Data/Evaluation/files/WBGSupportTransformationalEngagements.pdf. Accessed 31 Jan 2019
WBG DC – World Bank Group Development Committee (2013) A common vision for the World Bank Group, DC2013-0002. World Bank, Washington, DC. http://siteresources.worldbank.org/DEVCOMMINT/Documentation/23394965/DC2013-0002(E)CommonVision.pdf. Accessed 31 Jan 2019
Weinersmith K, Weinersmith Z (2017) Soonish. Penguin Press, New York
White H, Menon R, Waddington H (2018) Community-driven development: does it build social cohesion or infrastructure? A mixed-method evidence synthesis. 3ie Working Paper 30, March 2018. International Initiative for Impact Evaluation (3ie), New Delhi. http://www.3ieimpact.org/evidence-hub/publications/working-papers/community-driven-development-does-it-build-social-cohesion. Accessed 31 Jan 2019
Woon J, Kanthak K (2016) Elections, ability, and candidate honesty. University of Pittsburgh Press, Pittsburgh. http://www.pitt.edu/~kanthak/messages-nonanon.pdf. Accessed 31 Jan 2019
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Puri, J. (2019). Transformational Change: The Challenge of a Brave New World. In: Schmidt, M., Giovannucci, D., Palekhov, D., Hansmann, B. (eds) Sustainable Global Value Chains. Natural Resource Management in Transition, vol 2. Springer, Cham. https://doi.org/10.1007/978-3-319-14877-9_17
Download citation
DOI: https://doi.org/10.1007/978-3-319-14877-9_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-14876-2
Online ISBN: 978-3-319-14877-9
eBook Packages: Law and CriminologyLaw and Criminology (R0)