Skip to main content

Advertisement

SpringerLink
Log in

Towards productive functions? A systematic review of institutional failure, its causes and consequences

  • Research Article
  • Published:
Policy Sciences Aims and scope Submit manuscript

Abstract

Recognised as an integral part of the political process, the topic of institutional failure has recently received increased attention in the literature, particularly with respect to policy failure. Nevertheless, the difference between various types and aspects of failure is unclear conceptually, hampering the development of cumulative theory building into its causes and consequences. Furthermore, while ample attention has been paid to negative consequences, insights into the possibly ‘productive functions’ of failure are scattered and largely remain on the fringes of existing research. The present paper offers a systematic review of the failure literature, particularly its definitions, causes and consequences, setting existing research in the different scholarly fields in relation to each other. Special emphasis is placed on the ways failure may serve to advance the effectiveness and efficacy of public policy and the wider political system, opening ‘windows of opportunity’ as leverage points for institutional change. In doing so, we identify a number of factors which may facilitate or hinder the activation of this productive potential on an individual, institutional, and societal level.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

Notes

  1. Similar typologies of learning appear throughout the literature, all based on the depth of learning (see Dunlop 2017b).

References

  • Abson, D. J., Fischer, J., Leventon, J., Newig, J., Schomerus, T., Vilsmaier, U., et al. (2017). Leverage points for sustainability transformation. Ambio, 46(1), 30–39.

    Article  Google Scholar 

  • Acheson, J. M. (2006). Institutional failure in resource management. Annual Review of Anthropology, 35, 117–134.

    Article  Google Scholar 

  • Alink, F., Boin, A., & Hart, P. T. (2001). Institutional crises and reforms in policy sectors: The case of asylum policy in Europe. Journal of European Public Policy, 8(2), 286–306.

    Article  Google Scholar 

  • Andrew, B. (2008). Market failure, government failure and externalities in climate change mitigation: The case for a carbon tax. Public Administration and Development, 28(5), 393–401.

    Article  Google Scholar 

  • Backhouse, R. E., & Medema, S. G. (2012). Economists and the analysis of government failure: Fallacies in the Chicago and Virginia interpretations of Cambridge welfare economics. Cambridge Journal of Economics, 36(4), 981–994.

    Article  Google Scholar 

  • Ball, A. (2005). Environmental accounting and change in UK local government. Accounting, Auditing and Accountability Journal, 18(3), 346–373.

    Article  Google Scholar 

  • Benitez, D., Estache, A., & Søreide, T. (2012). Infrastructure policy and governance failures. CMI Working Paper (Vol. 5). Bergen: Chr. Michelsen Institute (CMI).

  • Ber, I. (2013). Governmental strategies towards poorly-performing municipalities: From narrow perceptions to ineffective policies. Lex Localis—Journal of Local Self-Government, 11(1), 33–52.

    Article  Google Scholar 

  • Boin, A., McConnell, A., & Hart, P. T. (2008). Governing after crisis. The politics of investigation, accountability and learning. Cambridge: Cambridge University Press.

    Book  Google Scholar 

  • Bovens, M., & Hart, P. T. (1995). Frame multiplicity and policy fiascoes: Limits to explanation. Knowledge and Policy, 8(4), 61–82.

    Article  Google Scholar 

  • Bovens, M., & Hart, P. T. (2016). Revisiting the study of policy failures. Journal of European Public Policy, 23(5), 653–666.

    Article  Google Scholar 

  • Brändström, A., & Kuipers, S. (2003). From ‘normal incidents’ to political crises: Understanding the selective politicization of policy failures. Government and Opposition, 38(3), 279–305.

    Article  Google Scholar 

  • Bressers, N., van Twist, M., & ten Heuvelhof, E. (2013). Exploring the temporal dimension in policy evaluation studies. Policy Sciences, 46(1), 23–37.

    Article  Google Scholar 

  • Brummer, K. (2016). ‘Fiasco prime ministers’: Leaders’ beliefs and personality traits as possible causes for policy fiascos. Journal of European Public Policy, 23(5), 702–717.

    Article  Google Scholar 

  • Crow, D. A., Albright, E. A., Ely, T., Koebele, E., & Lawhon, L. (2018). Do disasters lead to learning? Financial policy change in local government. Review of Policy Research, 35, 1–26.

    Article  Google Scholar 

  • Cullis, J. G., Jones, P. R., & Morrissey, O. (1993). The charge of the tax brigade. A case study of government failure and tax reforms. European Journal of Political Economy, 9(3), 407–425.

    Article  Google Scholar 

  • Dolfsma, W. (2011). Government failure—Four types. Journal of Economic Issues, 45(3), 593–604.

    Article  Google Scholar 

  • Dunlop, C. A. (2017a). Pathologies of policy learning: What are they and how do they contribute to policy failure? Policy and Politics, 45(1), 19–37.

    Article  Google Scholar 

  • Dunlop, C. A. (2017b). Policy learning and policy failure: Definitions, dimensions and intersections. Policy and Politics, 45(1), 3–18.

    Article  Google Scholar 

  • Farazmand, A. (2012). The future of public administration: Challenges and opportunities—A critical perspective. Administration and Society, 44(4), 487–517.

    Article  Google Scholar 

  • Fike, R., & Gwartney, J. (2015). Public choice, market failure, and government failure in principles textbooks. Journal of Economic Education, 46(2), 207–218.

    Article  Google Scholar 

  • Frese, M., & Keith, N. (2015). Action errors, error management, and learning in organizations. Annual Review of Psychology, 66, 661–687.

    Article  Google Scholar 

  • Gibb, K. (2015). The multiple policy failures of the UK bedroom tax. International Journal of Housing Policy, 15(2), 148–166.

    Article  Google Scholar 

  • Giest, S. (2017). Overcoming the failure of ‘silicon somewheres’: Learning in policy transfer processes. Policy and Politics, 45(1), 39–54.

    Article  Google Scholar 

  • Griffin, D. M. (1987). Implementation failure caused by institutional problems. Mountain Research and Development, 7(3), 250–253.

    Article  Google Scholar 

  • Grossman, P. Z. (2015). Energy shocks, crises and the policy process: A review of theory and application. Energy Policy, 77(1), 56–69.

    Article  Google Scholar 

  • Hajnal, G. (2010). Failing policies or failing politicians? Policy failures in Hungary. World Political Science Review. https://doi.org/10.2202/1935-6226.1089

    Article  Google Scholar 

  • Hall, C. M. (2011). Policy learning and policy failure in sustainable tourism governance: From first- and second-order to third-order change? Journal of Sustainable Tourism, 19(4–5), 649–671.

    Article  Google Scholar 

  • Hansen, S. B. (1983). Public policy analysis: Some recent developments and current problems. Policy Studies Journal, 12(1), 14–42.

    Article  Google Scholar 

  • Harris, E. (2007). Historical regulation of Victoria’s water sector: A case of government failure? Australian Journal of Agricultural and Resource Economics, 51(3), 343–352.

    Article  Google Scholar 

  • Helm, D. (2010). Government failure, rent-seeking, and capture: The design of climate change policy. Oxford Review of Economic Policy, 26(2), 182–196.

    Article  Google Scholar 

  • Hinterleitner, M. (2018). Policy failures, blame games and changes to policy practice. Journal of Public Policy, 38(2), 221–242.

    Article  Google Scholar 

  • Howlett, M. (2012). The lessons of failure: Learning and blame avoidance in public policy-making. International Political Science Review, 33(5), 539–555.

    Article  Google Scholar 

  • Howlett, M. (2014). Why are policy innovations rare and so often negative? Blame avoidance and problem denial in climate change policy-making. Global Environmental Change, 29, 395–403.

    Article  Google Scholar 

  • Howlett, M., & Ramesh, M. (2014). The two orders of governance failure: Design mismatches and policy capacity issues in modern governance. Policy and Society, 33(4), 317–327.

    Article  Google Scholar 

  • Howlett, M., Ramesh, M., & Wu, X. (2015). Understanding the persistence of policy failures: The role of politics, governance and uncertainty. Public Policy and Administration, 30(3–4), 209–220.

    Article  Google Scholar 

  • Hulme, R., & Hulme, M. (2012). Policy learning? Crisis, evidence and reinvention in the making of public policy. Policy and Politics, 40(4), 473–489.

    Article  Google Scholar 

  • Jessop, B. (1998). The rise of governance and the risks of failure: The case of economic development. International Social Science Journal, 50(155), 29–45.

    Article  Google Scholar 

  • Juhasz, F. (1989). Water: Is there a crisis? OECD Observer, 160, 4–9.

    Google Scholar 

  • Kay, A. (2017). Policy failures, policy learning and institutional change: The case of Australian health insurance policy change. Policy and Politics, 45(1), 87–101.

    Article  Google Scholar 

  • Kay, A., & Boxall, A.-M. (2015). Success and failure in public policy: Twin imposters or avenues for reform? Selected evidence from 40 years of health-care reform in Australia. Australian Journal of Public Administration, 74(1), 33–41.

    Article  Google Scholar 

  • Keech, W. R., & Munger, M. C. (2015). The anatomy of government failure. Public Choice, 164(1–2), 1–42.

    Article  Google Scholar 

  • King, A., & Crewe, I. (2013). The lunders of our governments. London: Oneworld.

    Google Scholar 

  • Kingdon, J. W. (1984). Agendas, alternatives, and public policies. Harlow: Pearson.

    Google Scholar 

  • Kirkpatrick, D. D. (2012). As Clashes Continue, Egypt Soccer Riot Becomes Metaphor for Government Failure. (2012, 03.02.2012). The New York Times.

  • Kortt, M. A., & Dollery, B. E. (2012). Australian government failure and the Green Loans Program. International Journal of Public Administration, 35(2), 150–158.

    Article  Google Scholar 

  • Kotrusová, M., & Výborná, K. (2015). A policy fiasco: The institutional (non-)reform of Czech public employment services in 2011. Central European Journal of Public Policy, 9(1), 148–168.

    Article  Google Scholar 

  • Leong, C., & House, S. R. (2012). Rethinking policy success: The normative basis for public action. Journal of Asian Public Policy, 5(1), 3–22.

    Article  Google Scholar 

  • Marsh, D., & McConnell, A. (2010). Towards a framework for establishing policy success. Public Administration, 88(2), 564–583.

    Article  Google Scholar 

  • Marsh, D., & Sharman, J. C. (2009). Policy diffusion and policy transfer. Policy Studies, 30(3), 269–288.

    Article  Google Scholar 

  • May, P. J. (1992). Policy learning and failure. Journal of Public Policy, 12(4), 331–354.

    Article  Google Scholar 

  • May, P. J. (2015). Implementation failures revisited: Policy regime perspectives. Public Policy and Administration, 30(3–4), 277–299.

    Article  Google Scholar 

  • May, P. J., & Jochim, A. E. (2013). Policy regime perspectives: Policies, politics, and governing. Policy Studies Journal, 41(3), 426–452.

    Article  Google Scholar 

  • McConnell, A. (2010). Policy success, policy failure and grey areas in-between. Journal of Public Policy, 30(3), 345–362.

    Article  Google Scholar 

  • McConnell, A. (2015). What is policy failure? A primer to help navigate the maze. Public Policy and Administration, 30(3–4), 221–242.

    Article  Google Scholar 

  • McConnell, A. (2016). A public policy approach to understanding the nature and causes of foreign policy failure. Journal of European Public Policy, 23(5), 667–684.

    Article  Google Scholar 

  • McConnell, A., Gauja, A., & Botterill, L. C. (2008). Policy fiascos, blame management and AWB limited: The Howard government’s escape from the Iraq wheat scandal. Australian Journal of Political Science, 43(4), 599–616.

    Article  Google Scholar 

  • Meier, K. J., & Bohte, J. (2003). Not with a bang, but a whimper. Explaining organizational failures. Administration and Society, 35(1), 104–121.

    Article  Google Scholar 

  • Mitchell, W. C., & Simmons, R. T. (1995). Pathological politics: The anatomy of government failure. Society, 32(6), 30–38.

    Article  Google Scholar 

  • Moher, D., Liberati, A., Tetzlaff, J., Altman, D. J., & The PRISMA Group. (2009). Preferred reporting items for systematic reveiws and meta-analyses: The PRISMA Statement. PLOS Medicine, 6(7), e1000097.

    Article  Google Scholar 

  • Mol, A. P. J. (2009). Environmental deinstitutionalization in Russia. Journal of Environmental Policy & Planning, 11(3), 223–241.

    Article  Google Scholar 

  • Mone, M. A., McKinley, W., & Barker, V. L. (1998). Organizational decline and innovation: A contingency framework. Academy of Management Review, 23(1), 115–132.

    Article  Google Scholar 

  • Murray, D., & Dollery, B. (2005). Institutional breakdown? An exploratory taxonomy of Australian University failure. Prometheus, 23(4), 385–398.

    Article  Google Scholar 

  • Nair, S., & Howlett, M. (2017). Policy myopia as a source of policy failure: Adaptation and policy learning under deep uncertainty. Policy and Politics, 45(1), 103–118.

    Article  Google Scholar 

  • Newig, J. (2013). Produktive Funktionen von Kollaps und Zerstörung für gesellschaftliche Transformationsprozesse in Richtung Nachhaltigkeit. In J. Rückert-John (Ed.), Soziale Innovation und Nachhaltigkeit. Perspektiven sozialen Wandels (pp. 133–149). Wiesbaden: Springer.

    Chapter  Google Scholar 

  • Newman, J., & Bird, M. G. (2017). British Columbia’s fast ferries and Sydney’s Airport Link: Partisan barriers to learning from policy failure. Policy and Politics, 45(1), 71–85.

    Article  Google Scholar 

  • Oppermann, K., & Spencer, A. (2016a). Studying fiascos: Bringing public and foreign policy together. Journal of European Public Policy, 23(5), 643–652.

    Article  Google Scholar 

  • Oppermann, K., & Spencer, A. (2016b). Telling stories of failure: Narrative constructions of foreign policy fiascos. Journal of European Public Policy, 23(5), 685–701.

    Article  Google Scholar 

  • Peters, B. G. (2015). State failure, governance failure and policy failure: Exploring the linkages. Public Policy and Administration, 30(3–4), 261–276.

    Article  Google Scholar 

  • Peters, B. G., Pierre, J., & Randma-Liiv, T. (2011). Global financial crisis, public administration and governance: Do new problems require new solutions? Public Organization Review, 11(1), 13–27.

    Article  Google Scholar 

  • Prakash, A., & Potoski, M. (2016). Dysfunctional institutions? Toward a new agenda in governance studies. Regulation and Governance, 10(2), 115–125.

    Article  Google Scholar 

  • Richardson, W. (2007). Public policy failure and fiasco in education: Perspectives on the British examinations crises of 2000–2002 and other episodes since 1975. Oxford Review of Education, 33(2), 143–160.

    Article  Google Scholar 

  • Rose, R. (1991). What is lesson-drawing? Journal of Public Policy, 11(1), 3–30.

    Article  Google Scholar 

  • Saurugger, S., & Terpan, F. (2016). Do crises lead to policy change? The multiple streams framework and the European Union’s economic governance instruments. Policy Sciences, 49(1), 35–53.

    Article  Google Scholar 

  • Schneider, A., Ingram, H., & Deleon, P. (2014). Democratic policy design: Social construction of target populations. Theories of the Policy Process, 3, 105–149.

    Google Scholar 

  • Schuck, P. H. (2014). Why government fails so often: And how it can do better. Princeton: Princeton University Press.

    Google Scholar 

  • Schumpeter, J. A. (1994). Capitalism, socialism and democracy. London: Routledge.

    Google Scholar 

  • Schwartz, R., & McConnell, A. (2009). Do crises help remedy regulatory failure? A comparative study of the Walkerton water and Jerusalem banquet hall disasters. Canadian Public Administration, 52(1), 91–112.

    Article  Google Scholar 

  • Schwartz, R., & Sulitzeanu-Kenan, R. (2004). Managerial values and accountability pressures. Challenges of crisis and disaster. Journal of Public Administration Research and Theory, 14(1), 79–102.

    Article  Google Scholar 

  • Short, J. L. (2013). Self-regulation in the regulatory void: “Blue Moon”or “Bad Moon”? Annals of the American Academy of Political and Social Science, 649(1), 22–34.

    Article  Google Scholar 

  • Sparrow, A. (2008). Government condemned for failure to tackle bribery (2008, 17.10.2008). The Guardian.

  • Stern, E. (1997). Crisis and learning: A conceptual balance sheet. Journal of Contingencies and Crisis Management, 5(2), 69–86.

    Article  Google Scholar 

  • Stone, D. (2017). Understanding the transfer of policy failure: Bricolage, experimentalism and translation. Policy and Politics, 45(1), 55–70.

    Article  Google Scholar 

  • Ugyel, L., & O’Flynn, J. (2017). Measuring policy success: Evaluating public sector reform in Bhutan. International Journal of Public Administration, 40(2), 115–125.

    Article  Google Scholar 

  • Van Assche, K., Beunen, R., & Duineveld, M. (2012). Performing success and failure in governance: Dutch planning experiences. Public Administration, 90(3), 567–581.

    Article  Google Scholar 

  • van der Steen, M., Scherpenisse, J., van Twist, M., & Hart, P. T. (2015). How to see failure: Attempts by the Inspectorate of Education to detect and disarm failure in Dutch education policy. Public Policy and Administration, 30(3–4), 320–341.

    Article  Google Scholar 

  • Venkatachalam, L. (2004). Sources of government failure and the environmental externality: Analysis of groundwater pollution in Tamil Nadu, India. Water Policy, 6(5), 413–426.

    Article  Google Scholar 

  • Vince, J. (2015). Integrated policy approaches and policy failure: The case of Australia’s Oceans Policy. Policy Sciences, 48(2), 159–180.

    Article  Google Scholar 

  • Vining, A. R., & Weimer, D. L. (1999). Inefficiency in public organizations. International Public Management Journal, 2(1), 1–24.

    Article  Google Scholar 

  • Walker, G. (2014). Water scarcity in England and Wales as a failure of (meta)governance. Water Alternatives, 7(2), 388–413.

    Google Scholar 

  • Wallis, J., & Dollery, B. (2002). Wolf’s model: Government failure and public sector reform in advanced industrial democracies. Review of Policy Research, 19(1), 177–203.

    Article  Google Scholar 

  • Walsh, J. I. (2006). Policy failure and policy change. British security policy after the cold war. Comparative Political Studies, 39(4), 490–518.

    Article  Google Scholar 

  • Wibe, S. (1992). Policy failures in managing forests. In R. K. Turner, S. Wibe (Eds.), Market and government failures in environmental management (pp. 45–82). Paris: OECD.

    Google Scholar 

  • Young, D. R. (1977). Consumer problems in the public sector: A framework for research. Journal of Consumer Policy, 1(3), 205–226.

    Article  Google Scholar 

  • Zittoun, P. (2015). Analysing policy failure as an argumentative strategy in the policymaking process: A pragmatist perspective. Public Policy and Administration, 30(3–4), 243–260.

    Article  Google Scholar 

Download references

Acknowledgements

This research was supported by the Volkswagenstiftung and the ‘Niedersächsisches Ministerium für Wissenschaft und Kultur’-funded project ‘Leverage Points for Sustainable Transformations: Institutions, People and Knowledge’ (Grant Number A112269). We thank the anonimous reviewers, whose constructive comments have helped to substantially improve the quality of the paper.

Author information

Authors and Affiliations

  1. Faculty of Sustainability, Leuphana University, Lüneburg, Germany

    Pim Derwort, Nicolas Jager & Jens Newig

  2. Research Group ‘Governance, Participation and Sustainability’, Institute of Sustainability Governance, Leuphana University, Lüneburg, Germany

    Pim Derwort, Nicolas Jager & Jens Newig

Authors
  1. Pim Derwort
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Nicolas Jager
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jens Newig
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Pim Derwort.

Electronic supplementary material

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Derwort, P., Jager, N. & Newig, J. Towards productive functions? A systematic review of institutional failure, its causes and consequences. Policy Sci 52, 281–298 (2019). https://doi.org/10.1007/s11077-018-9339-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11077-018-9339-z

Keywords

Search

Navigation