Skip to main content

Analysing Agriculture Extension Programmes Using Randomised Control Experiments

  • Chapter
  • First Online:
Agricultural Policy Analysis
  • 635 Accesses

Abstract

Agricultural extension or advisory service is a method of providing scientific knowledge to farmers through farmer education. It aims at improving farm-level output while developing the management skills of the farmers. Although the literature has extensively discussed the impact evaluation of agricultural extension, there is still confusion whether correct methodologies or techniques are used to evaluate the outcomes properly. This chapter explains how the impact of a particular agricultural extension service is evaluated using the randomised control trial (RCT). The chapter outlines the basic methodology for designing impact evaluations for agricultural projects directly targeting farmers while demonstrating two empirical examples in Sri Lanka. This will help the readers to understand how the impact of agricultural extension services could be evaluated in a particular agricultural area. It also widens the knowledge of applying RCTs to evaluate any other agricultural policy or programme that is crucial to improving or redesigning an intervention in order to increase agricultural production, productivity, and profitability. Moreover, it is expected that this chapter will further motivate the use of impact evaluations to measure results in agricultural projects in various settings in other developing as well as developed countries.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 219.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 279.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 279.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    The public sector delivers the vast majority of agricultural extension services in, for instance, India (Nandi and Nedumaran 2019), Bangladesh (Afrad et al. 2019), and Nigeria (Chibuzo and Chikerenma 2015; Hamisu et al. 2017).

  2. 2.

    Mass extension methods involve the use of the mass media, e.g. radio, posters, drama, television, newspapers, films, slide shows, etc., to create public awareness.

  3. 3.

    They were termed Krushi Viapthi Sevaka (KVS).

  4. 4.

    Hierarchy and accountability in extension flows downwards from the Secretary, Director General, Deputy Director, District Agricultural Extension Officers, to Agricultural Instructors, and Technical Assistants. Extension services implemented at the provincial level have their own hierarchy and accountability systems.

  5. 5.

    The Council for Agricultural Research Policy (CARP) was established in 1987 to handle agricultural research and extension simultaneously with coordinating different departments/institutions in the country. However, CARP has principally engaged with research and without progress towards extension.

  6. 6.

    Currently, more than 2500 grassroots agricultural extension workers are employed to maintain close contact with farming households; nevertheless, there is no proper mechanism to evaluate their services (Athukorala et al. 2017).

  7. 7.

    RCT design can be randomised offering of intervention, randomised promotion of intervention, or multiple treatment design.

  8. 8.

    The counterfactual is necessary for comparing actual outputs and outcomes to what they would have been in the absence of the intervention, i.e. with versus without.

  9. 9.

    Instead of randomising individuals, randomisation can be done at cluster levels, such as villages, or schools, or health clinics. Such experiments are known as cluster randomised control trials.

  10. 10.

    Statistical power refers to the probability of detecting an impact of a programme.

  11. 11.

    At this stage, the researcher needs to obtain the informed consent of those recruited for the trial, after explaining the purpose, methodology, risks, and benefits. Only those participants willing to remain engaged throughout the study period should be selected.

  12. 12.

    In a crossover design, all the trial participants receive both interventions in a sequential manner and only the order of intervention is randomly assigned.

  13. 13.

    In cases where important differences are found (or anticipated), the use of stratified random assignment may be warranted.

  14. 14.

    Also known as the ‘double difference’ method.

  15. 15.

    A few farmers did not continue participation in the consultation process, while during monitoring it was discovered that others had not followed the AIs’ instructions. The questionnaires relevant to these farmers were dropped from the analysis. At this stage, the impact of smaller sample size on the results was not analysed.

References

  • Afrad SI, Wadud F, Babu SC (2019) Reforms in agricultural extension service system in Bangladesh. In: Babu SC, Joshi PK (eds) Agricultural extension reforms in South Asia. Academic Press, Cambridge, MA, pp 13–40

    Chapter  Google Scholar 

  • Banerjee A, Dean K, Zinman J (2015) Six randomized evaluations of microcredit: introduction and further steps. Am Econ J Appl Econ 7(1):1–21

    Article  CAS  Google Scholar 

  • Behaghel L, Macours K, Subervie J (2019) How can randomised controlled trials help improve the design of the common agricultural policy? Eur Rev Agric Econ 46(3):473–493

    Article  Google Scholar 

  • Chibuzo I, Chikerenma UA (2015) Redefining the Nigerian agricultural extension system for effective agricultural transformation. Dev Country Stud 5(11) ISSN 2225-0565. https://www.iiste.org/Journals/index.php/DCS/article/view/23087/23606. Accessed 7 Jan 2020

  • Cohen J, Dupas P (2010) Free distribution or cost-sharing? Evidence from a randomized malaria prevention experiment. Q J Econ 125(1):1–45

    Article  Google Scholar 

  • Cole SA, Fernando AN (2012) The value of advice: evidence from mobile phone based agricultural extension. Harvard Business School Finance Working Paper, 13-047. Harvard Library office for scholarly communication, Harvard University

    Google Scholar 

  • De Soyza S (2014) Private sector involvement in agricultural extension in Sri Lanka. In: Wijeratne M, Mahaliyanaarachchi RP (eds) Agricultural extension: recent interventions for development in Sri Lanka. Sri Lanka Agricultural Extension Association, Peradeniya, pp 87–98

    Google Scholar 

  • Dettori J (2014) The random allocation process: two things you need to know. Clin Orthop Surg 6(1):103–109

    Google Scholar 

  • Dhehibi B, Werner J, Qaim M (2018) Designing and conducting randomized controlled trials (RCTs) for impact evaluations of agricultural development research: a case study from ICARDA’s ‘Mind the Gap’ project in Tunisia. The International Center for Agricultural Research in the Dry Areas (ICARDA), Beirut, Lebanon

    Google Scholar 

  • Gertler PJ, Martinez S, Premand P, Rawlings LB, Vermeersch CMJ (2011) Impact evaluation in practice. World Bank, Washington, DC

    Google Scholar 

  • Hamad R, Fernald LC, Karlan DS (2011) Health education for microcredit clients in Peru: a randomized controlled trial. BMC Public Health 11(1):1–10

    Article  Google Scholar 

  • Hamisu S, Ardo AM, Makinta MM, Garba L, Musa G (2017) A review on current status of agricultural extension service in Nigeria. Asian J Agric Res 1:1–8

    Google Scholar 

  • Hutton G, Rehfuess E, Tediosi F (2007) Evaluation of the costs and benefits of interventions to reduce indoor air pollution. Energy Sustain Dev 11:34–43

    Article  Google Scholar 

  • Independent Evaluation Group (2011) Impact evaluations in agriculture: an assessment of the evidence. World Bank, Washington, DC

    Google Scholar 

  • Miguel E, Kremer M (2004) Worms: identifying impacts on education and health in the presence of treatment externalities. Econometrica 72(1):159–217

    Article  Google Scholar 

  • Nandi R, Nedumaran S (2019) Agriculture extension system in India: a meta-analysis. Res J Agric Sci. Centre for Advanced Research in Agricultural Sciences 10(3):473–479

    Google Scholar 

  • Nichol AD, Bailey M, Cooper DJ (2010) Challenging issues in randomised controlled trials. Injury 41(1):S20–S23

    Article  PubMed  Google Scholar 

  • Pattanayak KS (2009) Rough guide to impact evaluation of environmental and development programs. South Asian Network for Development and Environmental Economics Working Paper No. 40-09. SANDEE, Nepal

    Google Scholar 

  • Peirce CS, Jastrow J (1885) On small differences in sensation. Mem Natl Acad Sci 3:73–83

    Google Scholar 

  • Rajalahti R, Woelcke J, Pehu E (2005) Development of research systems to support the changing agricultural sector. In: Proceedings of Agriculture and rural development discussion paper 14. World Bank, Washington, DC

    Google Scholar 

  • Suresh KP (2011) An overview of randomization techniques: an unbiased assessment of outcome in clinical research. J Hum Reprod Sci 4(1):8–11

    Article  PubMed  PubMed Central  Google Scholar 

  • Toroyan T, Roberts I, Oakley A (2000) Randomisation and resource allocation: a missed opportunity for evaluating health care and social interventions. J Med Ethics 26:319–322

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  • Van Spall HG, Toren A, Kiss A, Fowler RA (2007) Eligibility criteria of randomized controlled trials published in high-impact general medical journals: a systematic sampling review. JAMA 297:1233–1240

    Article  PubMed  Google Scholar 

  • Wanigasundera WADP, Atapattu N (2019) Extension reforms in Sri Lanka: lessons and policy options. In: Babu S, Joshi PK (eds) Agricultural extension reforms in South Asia: status, challenges, and policy options. Academic Press, California

    Google Scholar 

  • White H (2013) An introduction to the use of randomized control trials to evaluate development interventions. J Dev Effect 5(1):30–49

    Article  Google Scholar 

  • Winters P, Salazar L, Maffioli A (2010) Designing impact evaluations for agricultural projects. Technical notes, No. IDB-TN-198 Office of Strategic Planning and Development Effectiveness, Inter-American Development Bank

    Google Scholar 

Further Readings

    The following readings on the importance of impact evaluation in agricultural policies will be help a diverse group of people working in agriculture.

      General Readings

      • Gertler PJ, Martinez S, Premand P, Rawlings LB, Vermeersch CMJ (2011) Impact evaluation in practice. World Bank, Washington, DC

        Google Scholar 

      • Independent Evaluation Group (2011) Impact evaluations in agriculture: an assessment of the evidence. World Bank, Washington, DC

        Google Scholar 

      • Pattanayak KS (2009) Rough guide to impact evaluation of environmental and development programs, South Asian Network for Development and Environmental Economics Working Paper No.40–09. SANDEE, Nepal

        Google Scholar 

      • Winters P, Salazar L, Maffioli A (2010) Designing impact evaluations for agricultural projects. Technical Notes, No. IDB-TN-198, Office of Strategic Planning and Development Effectiveness, Inter-American Development Bank

        Google Scholar 

      Policy Documents

      • Babu S, Joshi PK (2019) Agricultural extension reforms in South Asia: status, challenges, and policy options. Elsevier Science, Amsterdam

        Google Scholar 

      • Policy Document (2019) Overarching agriculture policy. Ministry of Agriculture, Rural Economic Affairs, Irrigation, and Fisheries, and Aquatic Resources Development; Ministry of National Policies, Economic Affairs, Resettlement and Rehabilitation, Northern Province Development and Youth Affairs, Sri Lanka

        Google Scholar 

      Empirical Applications in Sri Lanka

      • Athukorala W (2016) Identifying the role of agricultural extension services in improving technical efficiency in the paddy farming sector in Sri Lanka. Sri Lanka J Econ Res 4(2):63–77

        Google Scholar 

      • Athukorala W, Karunarathna M, Ranatilaka MB (2017) Effectiveness of education and monitoring programs on improving technical efficiency in rice production: an application of a randomized control trial. Sri Lankan J Agric Econ 18(1):35–34

        Google Scholar 

      • De Mel S, McKenzie D, Woodruff C (2008a) Business training and female enterprise start-up, growth, and dynamics: experimental evidence from Sri Lanka. Institute for the Study of Labor, Germany

        Google Scholar 

      • De Mel S, McKenzie D, Woodruff C (2008b) Returns to capital in microenterprises: evidence from a field experiment. Q J Econ 123(4):1329–1372

        Article  Google Scholar 

      • De Mel S, McKenzie D, Woodruff C (2008c) Are women more credit constrained? Experimental evidence on gender and microenterprise returns, World Bank policy research working paper No. 4746. World Bank, Washington, DC

        Google Scholar 

      Empirical Application of Other Developing Countries

      • Banerjee A, Duflo E, Glennerster R, Kinnan C (2015) The miracle of microfinance? Evidence from a randomized evaluation. Am Econ J Appl Econ 7(1):22–53

        Article  Google Scholar 

      • Behaghel L, Macours K, Subervie J (2019) How can randomised controlled trials help improve the design of the common agricultural policy? Eur Rev. Agric Econ 46(3):473–493

        Article  Google Scholar 

      • Cole SA, Fernando AN (2012) The value of advice: evidence from mobile phone-based agricultural extension. Harvard Business School finance working paper. Harvard Library office for scholarly communication, Harvard University, pp 13–047

        Google Scholar 

      • Dhehibi B, Werner J, Qaim M (2018) Designing and conducting randomized controlled trials (RCTs) for impact evaluations of agricultural development research: a case study from ICARDA’s ‘Mind the Gap’ project in Tunisia. The International Center for Agricultural Research in the Dry Areas, Beirut, Lebanon

        Google Scholar 

      • Doll R, Hill B (1952) Study of the aetiology of carcinoma of the lung. Br Med J 1952(2):1271

        Article  Google Scholar 

      • Ferraro P, Pattanayak SK (2006) Money for nothing? A call for empirical evaluation of biodiversity conservation investments. PLoS Biol 4(4):e105

        Article  PubMed  PubMed Central  CAS  Google Scholar 

      • Henegedara GM (2002) Agricultural policy reforms in the paddy sector in Sri Lanka: An overview. Sri Lanka J Agrarian Stud 10(1):1–25

        Google Scholar 

      • Kim J, Shin W (2014) How to do random allocation. Clin Orthop Surg 6(1):103–109

        Article  PubMed  PubMed Central  Google Scholar 

      • Kleiman DG, Reading RP, Wallace R, Felleman F (2000) Improving the value of conservation programs. Conserv Biol 14(6):1569–1569

        Article  Google Scholar 

      • National Agriculture Policy (2007) Ministry of agriculture development & Agrarian services. Sri Lanka, Colombo

        Google Scholar 

      • Peduzzi P, Henderson W, Hartigan P, Lavori P (2002) Analysis of randomized controlled trials. Epidemiol Rev 24(1):26–38

        Article  PubMed  Google Scholar 

      • Peto R, Pike MC, Armitage P, Breslow NE, Cox DR, Howard SV, Mantel N, McPherson K, Peto J, Smith PG (1977) Design and analysis of randomized clinical trials requiring prolonged observation of each patient. Br J Cancer 35(1):1–39

        Article  CAS  PubMed  PubMed Central  Google Scholar 

      • Pullin A, Knight TM (2001) Effectiveness in conservation practice: Pointers from medicine and public health. Conserv Biol 15(1):50–54

        Article  Google Scholar 

      • Senn SJ (1989) Covariate imbalance and random allocation in clinical trials. Stat Med 8(4):467–475

        Article  CAS  PubMed  Google Scholar 

      • Sutherland WJ, Pullin A, Dolman PM, Knight TM (2004) The need for evidence-based conservation. Trends Ecol Evol 19(6):305–308

        Article  PubMed  Google Scholar 

      • White H (2013) An introduction to the use of randomized control trials to evaluate development interventions. J Dev Effect 5(1):30–49

        Article  Google Scholar 

      Download references

      Author information

      Authors and Affiliations

      Authors

      Editor information

      Editors and Affiliations

      Rights and permissions

      Reprints and permissions

      Copyright information

      © 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

      About this chapter

      Check for updates. Verify currency and authenticity via CrossMark

      Cite this chapter

      Athukorala, W. (2022). Analysing Agriculture Extension Programmes Using Randomised Control Experiments. In: Weerahewa, J., Jacque, A. (eds) Agricultural Policy Analysis. Springer, Singapore. https://doi.org/10.1007/978-981-16-3284-6_14

      Download citation

      Publish with us

      Policies and ethics