‘Outcome’ Assessment: What Exactly Are We Measuring? A Personal Reflection on Measuring the Outcomes from Competition Agencies’ Interventions
The UK and Dutch competition agencies were pioneers in Europe in publishing annual assessments of the ‘outcomes’ from their work. These countries had new competition laws to report on and a strong culture of public sector evaluation. Other countries have followed, with different approaches but enough common ground for OECD to develop a standard methodology. However, the measures are simplistic: they miss many important aspects of ‘outcomes’. I nonetheless argue that these assessments are worth carrying out but they should be recognised for what they are: a rather sophisticated measure of agency activity, rather than a simplistic assessment of outcomes.
KeywordsCompetition Evaluation Antitrust Impact assessment
JEL ClassificationL40 H83
- Alemani, E., Klein, C., Koske, I., Vitale, C., & Wanner, I. (2012). New indicators of competition law and policy in 2013 for OECD and non-OECD countries. OECD Economics Department Working Papers No. 1104.Google Scholar
- Audretsch, D. A. (1983). The effectiveness of antitrust policy towards horizontal mergers. Ann Arbor: UMI Research Press.Google Scholar
- Avdasheva, S., Tsytsulina, D., Golovanova, S., & Sidorova, Y. (2015). Discovering the miracle of large numbers of antitrust investigations in Russia: The role of competition agency incentives. National Research University Higher School of Economics, Working Paper.Google Scholar
- Better Regulation Executive. (2005). Measuring administrative costs: UK standard cost model manual. London: Cabinet Office.Google Scholar
- Bundeskartellamt: Annual report 2016 available at http://www.bundeskartellamt.de/SharedDocs/Publikation/EN/Jahresbericht/Jahresbericht_2016.pdf.
- Davies, S. W. (2010). A review of OFT’s impact estimation methods, Office of Fair Trading, OFT1164.Google Scholar
- Davies, S. W. (2013). Assessment of the impact of competition agencies’ activities. Available at http://www.oecd.org/officialdocuments/publicdisplaydocumentpdf/?cote=DAF/COMP/WP2(2013)1&docLanguage=En.
- Deloitte (2007). The deterrent effect of enforcement activity by the Office of Fair Trading, Office of Fair Trading report OFT 962. Available athttp://webarchive.nationalarchives.gov.uk/20140402181127/http://www.oft.gov.uk/shared_oft/reports/Evaluating-OFTs-work/oft962.pdf.
- Duso, T. (2012). A decade of ex-post merger policy evaluations: A progress report. In Pros and cons of merger control 2012, Konkurrensverket. Available at http://www.konkurrensverket.se/globalassets/english/research/more-pros-and-cons-of-merger-control.pdf.
- Geroski, P. (2006). Essays in competition policy. Available at http://www.regulation.org.uk/library/2006_geroski_essays.pdf.
- Global Competition Review. (2017). Rating enforcement 2017. Available at http://globalcompetitionreview.com/benchmarking/rating-enforcement-2017/1144770/introduction.
- Harberger, A. (1954). Monopoly and resource allocation. American Economic Review - Papers and Proceedings, 44, 77–87.Google Scholar
- Huschelrath, K. (2008). Is it worth all the trouble? The costs and benefits of antitrust enforcement. ZEW Working Paper No. 08-107.Google Scholar
- Huschelrath, K., & Leheyda, N. (2010). A methodology for the evaluation of competition policy. ZEW Discussion Paper No. 10-081.Google Scholar
- Kovacic, W. E. (2009). Rating the Competition Agencies: What Constitutes Good Performance? George Mason Law Review, 16, 903.Google Scholar
- Kwoka, J. (2015). Mergers, merger control, and remedies. Cambridge, MA: MIT Press.Google Scholar
- Lyons, B. (2003). Could politicians be more right than economists? A theory of welfare standards. EUI Working Papers 2003/14.Google Scholar
- Mariuzzo, F., Ormosi, P., & Havell, R. (2016). What can merger retrospectives tell us? An assessment of European mergers. CCP Working Paper 16-4.Google Scholar
- Murakozy, B., & Valentiny, P. (2014). Review of the ex-ante assessment of the welfare gains achieved by the GVH. Published by GVH at http://www.gvh.hu/en//data/cms1030092/GVH_Impact_Assessment_KRTK_ertekeles___final_PUBLIC_Eng.pdf.
- OECD. (2009). Regulatory impact analysis: A tool for policy coherence. Available at http://www.oecd.org/gov/regulatory-policy/ria-tool-for-policy-coherence.htm.
- OECD. (2012). Evaluation of competition enforcement and advocacy activities: The results of an OPECD survey. Available at http://www.oecd.org/officialdocuments/publicdisplaydocumentpdf/?cote=DAF/COMP/WP2(2012)7/FINAL&docLanguage=En.
- OECD. (2014). Guide for helping competition agencies assess the expected value of their activities. Available at http://www.oecd.org/daf/competition/guide-impact-assessment-competition-activities.htm.
- OECD. (2016). Reference guide on ex-post evaluation of competition agencies’ enforcement decisions. Available at http://www.oecd.org/daf/competition/reference-guide-on-ex-post-evaluation-of-enforcement-decisions.htm.
- Ormosi (2012). Evaluating the Impact of Competition Law enforcement, OECD. Available at http://www.oecd.org/officialdocuments/displaydocumentpdf?cote=DAF/COMP/WP2%282012%295&doclanguage=en.
- Schwab, K., & Salai-Martín, X. (2017). The global competitiveness report. World Economic Forum.Google Scholar
- Treasury, H. M. (2006). Productivity in the UK 6: Progress and new evidence. London: H.M. Treasury, HMSO.Google Scholar
- Treasury, H. M. (2011). The green book: Appraisal and evaluation in central government. London: H.M. Treasury, HMSO.Google Scholar
- Wright, J. D., & Diveley, A. M. (2012). Do expert agencies outperform generalist judges? Some preliminary evidence from the Federal Trade Commission. Journal of Antitrust Enforcement, 1–22.Google Scholar