Advertisement

Hague Journal on the Rule of Law

, Volume 8, Issue 1, pp 51–74 | Cite as

How, When and Why Do Governance, Justice and Rule of Law Indicators Fail Public Policy Decision Making in Practice?

  • Juan Carlos Botero
  • Angela Maria Pinzon-Rondon
  • Christine S. Pratt
Article

Abstract

Indicators are widely used tools for evidence-based decision-making today. Yet, even very sophisticated users of indicators often forget or deliberately disregard their limits. Stretching good indicators beyond their inherent limitations may lead to inadequate policy-making. This paper examines how several well-known indicators in the field of governance, justice and the rule of law are used for policy-making in different contexts. It builds from years of field observation, debate participation and meetings with politicians and experts from around the world. Drawing from time-tested social science research principles and methods, the paper concludes with suggestions on the adequate use of indicators for public policy decision making in the broad policy area covered by the newly adopted United Nations Sustainable Development Goal 16.

Keywords

Indicators Indices governance Justice Rule of law SDG Goal 16 

References

  1. Agrast M, Botero J, Ponce A (2011) WJP Rule of Law Index 2011. Washington, DC: The world justice project. http://www.worldjusticeproject.org/publication/rule-law-index-reports/rule-law-index-2011-report. Accessed 5 Jul 2015
  2. Botero J (2010) ‘Criminal prosecution of child abuse in the Pacific coast of Colombia—a case study on public health alternatives to criminal prosecution of ‘normal’ criminal behavior’, conceptualizing and measuring justice concept paper. Center for justice, law and society at George Mason University and the Washington institute for public affairs research at American University. http://www.american.edu/spa/wipar/measuring-justice-concept-papers.cfm. Accessed 5 Jul 2015
  3. Botero J, Ponce A (2010) ‘Measuring the rule of law’, WJP Working Paper No. 1. The world justice project (WJP). http://papers.ssrn.com/sol3/papers.cfm?abstract_id=1966257. Accessed 5 Jul 2015
  4. Botero J, Nelson R, Pratt C (2011) Indices and indicators of justice, governance, and the rule of law: an overview. Hague J Rule Law 3(2):153–169CrossRefGoogle Scholar
  5. Botero J, Martinez J, Ponce A, Pratt C (2012) The rule of law measurement revolution: complementarity between official statistics, qualitative assessments, and quantitative indicators of the rule of law. In: Botero et al (ed) Innovations in rule of law—a compilation of concise essays. HiiL and the World Justice Project. http://www.hiil.org/data/sitemanagement/media/HiiL_WJP_compilation_full_version(1).pdf
  6. Botero J, Ponce A, Shleifer A (2013) Education, complaints, and accountability. J Law Econ 56(4):959–996CrossRefGoogle Scholar
  7. Bryman A (2004) Social research methods. Oxford University Press, New YorkGoogle Scholar
  8. Davis K, Kingsbury B, Merry S (2015) Introduction. The local-global life of indicators: law, power and resistance. In: Merry S, Davis K, Kingsbury B (eds) The quiet power of indicators. Measuring governance, corruption and rule of law. Cambridge University Press, New York, pp 1–24Google Scholar
  9. de Vaus D (2002) Surveys in social research, 5th edn. Routledge, LondonGoogle Scholar
  10. de Vaus D (2006) Research design in social research. Sage Publications, LondonCrossRefGoogle Scholar
  11. DeShazo P, Primiani T, McLean P (2007) Back from the Brink. Evaluating progress in Colombia, 1999–2007, CSIS. https://csis.org/files/media/csis/pubs/071112-backfromthebrink-web.pdf. Accessed 25 Nov 2015
  12. Foglesong T, Stone C (2012) Strengthening the rule of law by measuring local practice, one rule at a time. In: Botero et al (eds) Innovations in rule of law—a compilation of concise essays. HiiL and the World Justice Project. http://www.hiil.org/data/sitemanagement/media/HiiL_WJP_compilation_full_version(1).pdf
  13. Ginsburg T (2011) Pitfalls of measuring the rule of law. Hague J Rule Law 3(2):269–280CrossRefGoogle Scholar
  14. Hennekens C, Buring J (1987) Epidemiology in medicine. Little, Brown & Co, BostonGoogle Scholar
  15. Human Rights Watch (2015) On their watch. evidence of senior army officers’ responsibility for false positive killings in Colombia. https://www.hrw.org/report/2015/06/24/their-watch/evidence-senior-army-officers-responsibility-false-positive-killings. Accessed 25 Nov 2015
  16. Kaufmann D, Kraay A, Zoido-Lobaton P (2007) ‘Governance Matters’, world bank policy research working paper no. 2196. http://papers.ssrn.com/sol3/papers.cfm?abstract_id=188568. Accessed 5 Jul 2015
  17. Morse R (2011) Methodology: best colleges ranking category definitions. U.S. news & world report. http://www.usnews.com/education/best-colleges/articles/2011/09/05/methodology-best-colleges-ranking-category-definitions. Accessed 5 Jul 2015
  18. Neuman L (2006) Social research methods: qualitative and quantitative approaches, 6th edn. Allyn & Bacon, BostonGoogle Scholar
  19. OECD (2008) Handbook on constructing composite indicators: methodology and user guide, resource document. organisation for economic co-operation and development. http://www.oecd.org/std/42495745.pdf. Accessed 5 Jul 2015
  20. Parsons J (2011) Developing clusters of indicators: an alternative approach to measuring the provision of justice. Hague J Rule Law 3(2):170–185CrossRefGoogle Scholar
  21. Pastrana A (2005) La palabra bajo fuego. Editorial Planeta, BogotaGoogle Scholar
  22. Patton MQ (2002) Qualitative research and evaluation methods, 3rd edn. Sage Publications, LondonGoogle Scholar
  23. Romero S (2008) Colombian Army is accused of killing poor civilians and labeling them insurgents. New York Times. http://www.nytimes.com/2008/10/29/world/americas/29iht-colombia.4.17352270.html?pagewanted=all&_r=0. Accessed 5 July 2015
  24. Ruane J (2005) Essentials of research methods. A guide to social science research. Blackwell Publishing, OxfordGoogle Scholar
  25. Saisana M, Saltelli A (2011) Rankings and ratings: instructions for use. Hague J Rule Law 3(2):247–268CrossRefGoogle Scholar
  26. Smith A (1893) The story of the Lord’s dealings with mrs. Amanda Smith. Mayer and Brother Publishers, ChicagoGoogle Scholar
  27. Stock J, Watson M (2008) Introduction to econometrics, brief edn. Pearson Education, BostonGoogle Scholar
  28. The international bank for reconstruction and development/the world bank, a decade of measuring the quality of governance: governance matters 2007—worldwide governance indicators 1996—2006, the international bank for reconstruction and development and the world bank, http://info.worldbank.org/governance/wgi/pdf/booklet_decade_of_measuring_governance.pdf, p. 1. Accessed 25 Nov 2015
  29. The World Bank (2007) A guide to the world bank, 2nd edn. The World Bank, Washington, DCCrossRefGoogle Scholar
  30. The world bank and the international finance corporation (2011) Doing business 2011: making a difference for entrepreneurs. http://www.doingbusiness.org/~/media/FPDKM/Doing%20Business/Documents/Annual-Reports/English/DB11-FullReport.pdf. Accessed 5 Jul 2015
  31. Uribe Velez A (2012) No lost causes. New America Library, New YorkGoogle Scholar
  32. Urueña R (2015) Indicators and the law: a case study of the rule of law index. In: Merry S, Davis K, Kingsbury B (eds) The quiet power of indicators. Measuring governance, corruption and rule of law. Cambridge University Press, New YorkGoogle Scholar

Copyright information

© T.M.C. Asser Press 2015

Authors and Affiliations

  • Juan Carlos Botero
    • 1
  • Angela Maria Pinzon-Rondon
    • 2
  • Christine S. Pratt
    • 1
  1. 1.The World Justice Project (WJP)Washington DCUSA
  2. 2.Universidad del Rosario School of MedicineBogotaColombia

Personalised recommendations