Abstract
Agricultural extension or advisory service is a method of providing scientific knowledge to farmers through farmer education. It aims at improving farm-level output while developing the management skills of the farmers. Although the literature has extensively discussed the impact evaluation of agricultural extension, there is still confusion whether correct methodologies or techniques are used to evaluate the outcomes properly. This chapter explains how the impact of a particular agricultural extension service is evaluated using the randomised control trial (RCT). The chapter outlines the basic methodology for designing impact evaluations for agricultural projects directly targeting farmers while demonstrating two empirical examples in Sri Lanka. This will help the readers to understand how the impact of agricultural extension services could be evaluated in a particular agricultural area. It also widens the knowledge of applying RCTs to evaluate any other agricultural policy or programme that is crucial to improving or redesigning an intervention in order to increase agricultural production, productivity, and profitability. Moreover, it is expected that this chapter will further motivate the use of impact evaluations to measure results in agricultural projects in various settings in other developing as well as developed countries.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
- 2.
Mass extension methods involve the use of the mass media, e.g. radio, posters, drama, television, newspapers, films, slide shows, etc., to create public awareness.
- 3.
They were termed Krushi Viapthi Sevaka (KVS).
- 4.
Hierarchy and accountability in extension flows downwards from the Secretary, Director General, Deputy Director, District Agricultural Extension Officers, to Agricultural Instructors, and Technical Assistants. Extension services implemented at the provincial level have their own hierarchy and accountability systems.
- 5.
The Council for Agricultural Research Policy (CARP) was established in 1987 to handle agricultural research and extension simultaneously with coordinating different departments/institutions in the country. However, CARP has principally engaged with research and without progress towards extension.
- 6.
Currently, more than 2500 grassroots agricultural extension workers are employed to maintain close contact with farming households; nevertheless, there is no proper mechanism to evaluate their services (Athukorala et al. 2017).
- 7.
RCT design can be randomised offering of intervention, randomised promotion of intervention, or multiple treatment design.
- 8.
The counterfactual is necessary for comparing actual outputs and outcomes to what they would have been in the absence of the intervention, i.e. with versus without.
- 9.
Instead of randomising individuals, randomisation can be done at cluster levels, such as villages, or schools, or health clinics. Such experiments are known as cluster randomised control trials.
- 10.
Statistical power refers to the probability of detecting an impact of a programme.
- 11.
At this stage, the researcher needs to obtain the informed consent of those recruited for the trial, after explaining the purpose, methodology, risks, and benefits. Only those participants willing to remain engaged throughout the study period should be selected.
- 12.
In a crossover design, all the trial participants receive both interventions in a sequential manner and only the order of intervention is randomly assigned.
- 13.
In cases where important differences are found (or anticipated), the use of stratified random assignment may be warranted.
- 14.
Also known as the ‘double difference’ method.
- 15.
A few farmers did not continue participation in the consultation process, while during monitoring it was discovered that others had not followed the AIs’ instructions. The questionnaires relevant to these farmers were dropped from the analysis. At this stage, the impact of smaller sample size on the results was not analysed.
References
Afrad SI, Wadud F, Babu SC (2019) Reforms in agricultural extension service system in Bangladesh. In: Babu SC, Joshi PK (eds) Agricultural extension reforms in South Asia. Academic Press, Cambridge, MA, pp 13–40
Banerjee A, Dean K, Zinman J (2015) Six randomized evaluations of microcredit: introduction and further steps. Am Econ J Appl Econ 7(1):1–21
Behaghel L, Macours K, Subervie J (2019) How can randomised controlled trials help improve the design of the common agricultural policy? Eur Rev Agric Econ 46(3):473–493
Chibuzo I, Chikerenma UA (2015) Redefining the Nigerian agricultural extension system for effective agricultural transformation. Dev Country Stud 5(11) ISSN 2225-0565. https://www.iiste.org/Journals/index.php/DCS/article/view/23087/23606. Accessed 7 Jan 2020
Cohen J, Dupas P (2010) Free distribution or cost-sharing? Evidence from a randomized malaria prevention experiment. Q J Econ 125(1):1–45
Cole SA, Fernando AN (2012) The value of advice: evidence from mobile phone based agricultural extension. Harvard Business School Finance Working Paper, 13-047. Harvard Library office for scholarly communication, Harvard University
De Soyza S (2014) Private sector involvement in agricultural extension in Sri Lanka. In: Wijeratne M, Mahaliyanaarachchi RP (eds) Agricultural extension: recent interventions for development in Sri Lanka. Sri Lanka Agricultural Extension Association, Peradeniya, pp 87–98
Dettori J (2014) The random allocation process: two things you need to know. Clin Orthop Surg 6(1):103–109
Dhehibi B, Werner J, Qaim M (2018) Designing and conducting randomized controlled trials (RCTs) for impact evaluations of agricultural development research: a case study from ICARDA’s ‘Mind the Gap’ project in Tunisia. The International Center for Agricultural Research in the Dry Areas (ICARDA), Beirut, Lebanon
Gertler PJ, Martinez S, Premand P, Rawlings LB, Vermeersch CMJ (2011) Impact evaluation in practice. World Bank, Washington, DC
Hamad R, Fernald LC, Karlan DS (2011) Health education for microcredit clients in Peru: a randomized controlled trial. BMC Public Health 11(1):1–10
Hamisu S, Ardo AM, Makinta MM, Garba L, Musa G (2017) A review on current status of agricultural extension service in Nigeria. Asian J Agric Res 1:1–8
Hutton G, Rehfuess E, Tediosi F (2007) Evaluation of the costs and benefits of interventions to reduce indoor air pollution. Energy Sustain Dev 11:34–43
Independent Evaluation Group (2011) Impact evaluations in agriculture: an assessment of the evidence. World Bank, Washington, DC
Miguel E, Kremer M (2004) Worms: identifying impacts on education and health in the presence of treatment externalities. Econometrica 72(1):159–217
Nandi R, Nedumaran S (2019) Agriculture extension system in India: a meta-analysis. Res J Agric Sci. Centre for Advanced Research in Agricultural Sciences 10(3):473–479
Nichol AD, Bailey M, Cooper DJ (2010) Challenging issues in randomised controlled trials. Injury 41(1):S20–S23
Pattanayak KS (2009) Rough guide to impact evaluation of environmental and development programs. South Asian Network for Development and Environmental Economics Working Paper No. 40-09. SANDEE, Nepal
Peirce CS, Jastrow J (1885) On small differences in sensation. Mem Natl Acad Sci 3:73–83
Rajalahti R, Woelcke J, Pehu E (2005) Development of research systems to support the changing agricultural sector. In: Proceedings of Agriculture and rural development discussion paper 14. World Bank, Washington, DC
Suresh KP (2011) An overview of randomization techniques: an unbiased assessment of outcome in clinical research. J Hum Reprod Sci 4(1):8–11
Toroyan T, Roberts I, Oakley A (2000) Randomisation and resource allocation: a missed opportunity for evaluating health care and social interventions. J Med Ethics 26:319–322
Van Spall HG, Toren A, Kiss A, Fowler RA (2007) Eligibility criteria of randomized controlled trials published in high-impact general medical journals: a systematic sampling review. JAMA 297:1233–1240
Wanigasundera WADP, Atapattu N (2019) Extension reforms in Sri Lanka: lessons and policy options. In: Babu S, Joshi PK (eds) Agricultural extension reforms in South Asia: status, challenges, and policy options. Academic Press, California
White H (2013) An introduction to the use of randomized control trials to evaluate development interventions. J Dev Effect 5(1):30–49
Winters P, Salazar L, Maffioli A (2010) Designing impact evaluations for agricultural projects. Technical notes, No. IDB-TN-198 Office of Strategic Planning and Development Effectiveness, Inter-American Development Bank
Further Readings
The following readings on the importance of impact evaluation in agricultural policies will be help a diverse group of people working in agriculture.
General Readings
Gertler PJ, Martinez S, Premand P, Rawlings LB, Vermeersch CMJ (2011) Impact evaluation in practice. World Bank, Washington, DC
Independent Evaluation Group (2011) Impact evaluations in agriculture: an assessment of the evidence. World Bank, Washington, DC
Pattanayak KS (2009) Rough guide to impact evaluation of environmental and development programs, South Asian Network for Development and Environmental Economics Working Paper No.40–09. SANDEE, Nepal
Winters P, Salazar L, Maffioli A (2010) Designing impact evaluations for agricultural projects. Technical Notes, No. IDB-TN-198, Office of Strategic Planning and Development Effectiveness, Inter-American Development Bank
Policy Documents
Babu S, Joshi PK (2019) Agricultural extension reforms in South Asia: status, challenges, and policy options. Elsevier Science, Amsterdam
Policy Document (2019) Overarching agriculture policy. Ministry of Agriculture, Rural Economic Affairs, Irrigation, and Fisheries, and Aquatic Resources Development; Ministry of National Policies, Economic Affairs, Resettlement and Rehabilitation, Northern Province Development and Youth Affairs, Sri Lanka
Empirical Applications in Sri Lanka
Athukorala W (2016) Identifying the role of agricultural extension services in improving technical efficiency in the paddy farming sector in Sri Lanka. Sri Lanka J Econ Res 4(2):63–77
Athukorala W, Karunarathna M, Ranatilaka MB (2017) Effectiveness of education and monitoring programs on improving technical efficiency in rice production: an application of a randomized control trial. Sri Lankan J Agric Econ 18(1):35–34
De Mel S, McKenzie D, Woodruff C (2008a) Business training and female enterprise start-up, growth, and dynamics: experimental evidence from Sri Lanka. Institute for the Study of Labor, Germany
De Mel S, McKenzie D, Woodruff C (2008b) Returns to capital in microenterprises: evidence from a field experiment. Q J Econ 123(4):1329–1372
De Mel S, McKenzie D, Woodruff C (2008c) Are women more credit constrained? Experimental evidence on gender and microenterprise returns, World Bank policy research working paper No. 4746. World Bank, Washington, DC
Empirical Application of Other Developing Countries
Banerjee A, Duflo E, Glennerster R, Kinnan C (2015) The miracle of microfinance? Evidence from a randomized evaluation. Am Econ J Appl Econ 7(1):22–53
Behaghel L, Macours K, Subervie J (2019) How can randomised controlled trials help improve the design of the common agricultural policy? Eur Rev. Agric Econ 46(3):473–493
Cole SA, Fernando AN (2012) The value of advice: evidence from mobile phone-based agricultural extension. Harvard Business School finance working paper. Harvard Library office for scholarly communication, Harvard University, pp 13–047
Dhehibi B, Werner J, Qaim M (2018) Designing and conducting randomized controlled trials (RCTs) for impact evaluations of agricultural development research: a case study from ICARDA’s ‘Mind the Gap’ project in Tunisia. The International Center for Agricultural Research in the Dry Areas, Beirut, Lebanon
Doll R, Hill B (1952) Study of the aetiology of carcinoma of the lung. Br Med J 1952(2):1271
Ferraro P, Pattanayak SK (2006) Money for nothing? A call for empirical evaluation of biodiversity conservation investments. PLoS Biol 4(4):e105
Henegedara GM (2002) Agricultural policy reforms in the paddy sector in Sri Lanka: An overview. Sri Lanka J Agrarian Stud 10(1):1–25
Kim J, Shin W (2014) How to do random allocation. Clin Orthop Surg 6(1):103–109
Kleiman DG, Reading RP, Wallace R, Felleman F (2000) Improving the value of conservation programs. Conserv Biol 14(6):1569–1569
National Agriculture Policy (2007) Ministry of agriculture development & Agrarian services. Sri Lanka, Colombo
Peduzzi P, Henderson W, Hartigan P, Lavori P (2002) Analysis of randomized controlled trials. Epidemiol Rev 24(1):26–38
Peto R, Pike MC, Armitage P, Breslow NE, Cox DR, Howard SV, Mantel N, McPherson K, Peto J, Smith PG (1977) Design and analysis of randomized clinical trials requiring prolonged observation of each patient. Br J Cancer 35(1):1–39
Pullin A, Knight TM (2001) Effectiveness in conservation practice: Pointers from medicine and public health. Conserv Biol 15(1):50–54
Senn SJ (1989) Covariate imbalance and random allocation in clinical trials. Stat Med 8(4):467–475
Sutherland WJ, Pullin A, Dolman PM, Knight TM (2004) The need for evidence-based conservation. Trends Ecol Evol 19(6):305–308
White H (2013) An introduction to the use of randomized control trials to evaluate development interventions. J Dev Effect 5(1):30–49
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Athukorala, W. (2022). Analysing Agriculture Extension Programmes Using Randomised Control Experiments. In: Weerahewa, J., Jacque, A. (eds) Agricultural Policy Analysis. Springer, Singapore. https://doi.org/10.1007/978-981-16-3284-6_14
Download citation
DOI: https://doi.org/10.1007/978-981-16-3284-6_14
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-16-3283-9
Online ISBN: 978-981-16-3284-6
eBook Packages: Biomedical and Life SciencesBiomedical and Life Sciences (R0)