Skip to main content
SpringerLink
Log in

Evaluating research institutions: Lessons from the CGIAR

  • Published:
Knowledge, Technology & Policy

Abstract

Investing in research is a long-term, risky proposition. In agriculture, it could take fifteen years or more for a research finding to show an improvement in a farmer’s field. Yet, research institutions, like other organizations it needs to be evaluated. For more than twenty years, independent panels of outside experts have evaluated each of the international research centers that the Consultative Group of International Agricultural Research (CGIAR) supports. This paper examines the evolution of this review system, outlines the key methodological challenges faced, and draws lessons for others engaged in evaluating research institutions. It notes that the scope of the CGIAR reviews have been broadened over time in response to users’ concerns. Reviews now cover four dimensions of performance: research results, quality and relevance of research, vision and strategic directions, and management efficiency. The methodological challenges faced in measurement, valuation, and attribution are reviewed, along with practices found to be helpful in addressing these concerns. The paper concludes that the panel approach to institutional evaluation has served CGIAR’s needs well, and recommends it as an evaluation technique for integrating quantitative and qualitative dimensions of institutional performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Anderson, J.R., Herdt, R.W., and Scobie, G.M. (1988). Science and food: The CGIAR and its partners. Washington, D.C.: The World Bank.

    Google Scholar 

  • Baum, W. (1986). Partners against hunger. Washington, D.C.: The World Bank.

    Google Scholar 

  • Blase, M. (1986). Institution building: A source book. Columbia, MO: University of Missouri Press.

    Google Scholar 

  • Campbell, D.T. and Stanley, J.C. (1963). Experimental and quasi-experimental designs for research. Chicago: Rand McNally.

    Google Scholar 

  • Caro, F.G. (ed.). (1971). Readings in evaluation research. New York: Russell-Sage.

    Google Scholar 

  • Consultative Group on International Agricultural Research (CGIAR) Secretariat (1981). Second review of the CGIAR. Washington, D.C.: CGIAR.

    Google Scholar 

  • Consultative Group on International Agricultural Research (CGIAR) Secretariat (1985). 1984 Annual report. Washington, D.C.: CGIAR.

    Google Scholar 

  • Consultative Group on International Agricultural Research (CGIAR) Secretariat (1994). Designing the new CGIAR review process. International Centers Week 1994, Doc. no. ICW/94/18. Washington, D.C.: CGIAR.

    Google Scholar 

  • Consultative Group on International Agricultural Research (CGIAR) Secretariat (1995a). Improving the quality and consistency of the CGIAR’s external center reviews. International Centers Week 1995, Doc. no. ICW/95/11. Washington, D.C.: CGIAR.

    Google Scholar 

  • Consultative Group on International Agricultural Research (CGIAR) Secretariat (1995b). Renewal of the CGIAR: Sustainable agriculture for food security in developing countries. Summary of proceedings and decisions at ministerial-level meeting, Lucerne, Switzerland, February 9–10, 1995. Washington, D.C.: CGIAR.

    Google Scholar 

  • Consultative Group on International Agricultural Research (CGIAR) Secretariat (1996). Committees and units of the CGIAR: Roles, responsibilities, and procedures. Washington, D.C.: CGIAR.

    Google Scholar 

  • Consultative Group on International Agricultural Research (CGIAR) Secretariat (1997a). CGIAR annual report, 1996. Washington, D.C.: CGIAR.

    Google Scholar 

  • Consultative Group on International Agricultural Research (CGIAR) Secretariat (1997b). CGIAR priorities and strategies for resource allocation during 1998–2000. CGIAR mid-term meeting, Doc. no. SDR/TAC: IAR/96/6.2. Washington, D.C.: CGIAR.

    Google Scholar 

  • Consultative Group on International Agricultural Research (CGIAR) Secretariat (1997c). Report of the twelfth meeting of the CGIAR finance committee. Washington, D.C.: CGIAR.

    Google Scholar 

  • Consultative Group on International Agricultural Research (CGIAR) Secretariat (1997d). Impact assessment and evaluation group (IAEG) report to the CGIAR. CGIAR mid-term meeting, Doc. no. MTM/97/11. Washington, D.C.: CGIAR.

    Google Scholar 

  • Consultative Group on International Agricultural Research (CGIAR) Secretariat (1997e). The role, responsibility and accountability of center boards of trustees. In Reference guides for CGIAR international agricultural research centers and their boards of trustees. Washington, D.C.: CGIAR.

    Google Scholar 

  • Consultative Group on International Agricultural Research (CGIAR) Secretariat (1997f). The role of the boards chair. In Reference guides for CGIAR international agricultural research centers and their boards of trustees. Washington, D.C.: CGIAR.

    Google Scholar 

  • Consultative Group on International Agricultural Research (CGIAR) Secretariat (1997g). Creating a well-balanced board. In Reference guides for CGIAR international agricultural research centers and their boards of trustees. Washington, D.C.: CGIAR.

    Google Scholar 

  • Consultative Group on International Agricultural Research (CGIAR) Secretariat (1997h). Building effective board committees. In Reference guides for CGIAR international agricultural research centers and their boards of trustees. Washington, D.C.: CGIAR.

    Google Scholar 

  • Consultative Group on International Agricultural Research (CGIAR) Secretariat (1997i). Choosing a director general: The search and selection process. In Reference guides for CGIAR international agricultural research centers and their boards of trustees. Washington, D.C.: CGIAR.

    Google Scholar 

  • Consultative Group on International Agricultural Research (CGIAR) Secretariat (1997j). Evaluating the director general: The assessment process. In Reference guides for CGIAR international agricultural research centers and their boards of trustees. Washington, D.C.: CGIAR.

    Google Scholar 

  • Consultative Group on International Agricultural Research (CGIAR) Secretariat (1997k). Board self-assessment. In Reference guides for CGIAR international agricultural research centers and their boards of trustees. Washington, D.C.: CGIAR.

    Google Scholar 

  • Egan, G. (1988a). Change-agent skills A: Assessing and designing excellence. San Diego, CA: University Associates.

    Google Scholar 

  • Egan, G. (1988b). Change-agent skills B: Managing innovation and change. San Diego, CA: University Associates.

    Google Scholar 

  • Horton, D., Ballantyne, P., Peterson, W., Uribe, B., Gapasin, D., and Sheridan, K. (eds.). (1993). Monitoring and evaluating agricultural research: A sourcebook. Wallingford, UK: CAB International.

    Google Scholar 

  • Israel, A. (1987). Institutional development: Incentives to performance. Baltimore, MD: Johns Hopkins University Press.

    Google Scholar 

  • Lee, D.R., Kearl, S., and Uphoff, N. (eds.) (1991). Assessing the impact of international agricultural research for sustainable development: Proceedings of a symposium at Cornell University. Ithaca, NY: Cornell International Institute for Food, Agriculture and Development.

    Google Scholar 

  • Light, R.J. and Pillemer, D.B. (1984). Summing up: The science of reviewing research. Cambridge, MA: Harvard University Press.

    Google Scholar 

  • Lusthaus, C., Anderson, G., and Murphy, E. (1995). Institutional Assessment. Ottawa, Canada: International Development Research Centre (IDRC).

    Google Scholar 

  • Mintzberg, H. (1983). Designing effective organizations. Englewood Cliffs, NJ: Prentice-Hall.

    Google Scholar 

  • Mintzberg, H. and Walters, J. (1985). Of strategies, deliberate and emergent. Strategic Management Journal, 6:257–272.

    Article  Google Scholar 

  • Özgediz, S. (1991). Governance and management of the CGIAR centers. CGIAR Study Paper No. 27. Washington, D.C.: The World Bank.

    Google Scholar 

  • Özgediz, S. (1993). Organization and management of the CGIAR system: A review. Public Administration and Development, 13(3):217–231.

    Article  Google Scholar 

  • Porter, M. (1987). The state of strategic thinking. The Economist, May 23:17–22.

    Google Scholar 

  • Rossi, P.H. and Freeman, H.E. (1993). Evaluation: A systematic approach (5th ed.). Newburg Park, CA: Sage Publications.

    Google Scholar 

  • Tichy, N.M. (1983). Managing strategic change. New York: John Wiley.

    Google Scholar 

  • U.S. General Accounting Office (1991). Designing evaluations. Doc. no. GAO/PEMD-10.1.4. Washington, D.C.: U.S. General Accounting Office (GAO).

    Google Scholar 

  • Van de Ven, A.H. and Ferry, D.L. (1980). Measuring and assessing organizations. New York: John Wiley.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. CGIAR Secretariat, The World Bank, 1818 H Street, NW, 20433, Washington, D.C.

    Selçuk Özgediz (Management Adviser at the Executive Secretariat)

Authors
  1. Selçuk Özgediz
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Selçuk Özgediz.

Additional information

His recent work has concentrated on the governance and management of the CGIAR and the individual research centers it supports, including questions of evaluating management effectiveness. Prior to joining the World Bank in 1979, he was Assistant Professor of Political Science at Bogazici University (Istanbul) and Senior Research Director of Systems Research Incorporated (Lansing, Michigan).

Rights and permissions

Reprints and permissions

About this article

Cite this article

Özgediz, S. Evaluating research institutions: Lessons from the CGIAR. Know Techn Pol 11, 97–113 (1999). https://doi.org/10.1007/s12130-999-1005-5

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12130-999-1005-5

Keywords

Search

Navigation