Skip to main content

Doing Policy Analysis

  • Chapter
  • First Online:
The Art and Craft of Policy Advising

Abstract

Doing policy analysis in practice is not as rational and systematic as many textbooks seem to suggest. To understand this, we need to unpack the relationships between science, policy and politics, and between evidence, emotions and values in public persuasion and political decision-making. Public policy-making is incremental social problem-solving. The most important contribution policy analysis makes is crafting the right questions and facilitating collective thinking to support problem-solving.

This chapter introduces:

  • Relationships between science, policy and politics;

  • Policy analysis as crafting the right questions to facilitate collective social problem-solving;

  • The roles of evidence, emotions and values in public persuasion;

  • A fair go framework for public policy;

  • Collective thinking and the technique of storyboarding;

  • Multi-criteria decision analysis, as a tool to supplement cost-benefit analysis; and

  • Some further reflections on free and frank advice.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 84.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Majone (1989) usefully distinguishes between data, information and evidence. Evidence is “information selected from the available stock and introduced at a specific point in the argument in order to persuade a particular audience of the truth or falsity of a statement. Selecting inappropriate data or models, placing them at a wrong point in the argument, or choosing a style of presentation that is not suitable for the intended audience, can destroy the effectiveness of information used as evidence, regardless of its intrinsic cognitive value. Thus, criteria for assessing evidence are different from those used for assessing facts. Facts can be evaluated in terms of more or less objective canons, but evidence must be evaluated in accordance with a number of factors peculiar to a given situation, such as the specific nature of the case, the type of audience, the prevailing rules of evidence, or the credibility of the analyst” (pp. 10–11).

  2. 2.

    The concept of Grand Challenges has been applied for some years in both science and policy. It refers to challenges that are complex in at least three dimensions (technical, temporal and societal). These are major long-term challenges faced by society (e.g., climate change mitigation, overpopulation, food security, water supply and infectious diseases) whose costs will increase over time and which (globally) influence the lives of people in very different ways (Stiftung Mercator, 2015, p. 32).

  3. 3.

    On theoretical approaches to public policy, see Althaus et al., (2013, pp. 32–37), Brans et al. (2017), Cairney (2016, 2021), Fischer et al. (2019), Howlett et al., (2009, Chaps. 2 and 6), Sabatier (1991), Scott & Baehler (2010, pp. 26–41).

  4. 4.

    Van Zwanenberg and Millstone also distinguish a fifth model (a risk-management model), which I have included in this summary as a variation on the inverted decisionist model.

  5. 5.

    Wilkinson and Pickett (2010) do not merely report evidence. They present evidence in an attempt to warrant a normative argument about what developed nations ought to do. Admittedly, they present their argument in relatively straightforward consequentialist terms with little reference to ideas of justice, but as Marquez (2011) has noted, it is clear that Wilkinson and Pickett do think that income inequality is unjust, at least on account of its consequences.

  6. 6.

    This model is sometimes called a Pragmatic-Enlightened Model, building on the philosophical tradition of American pragmatism (Kowarsch & Edenhofer, 2015, p. 118).

  7. 7.

    See also Gluckman & Bardsley, (2021), Gluckman et al. (2021).

  8. 8.

    On policy implementation planning, see Weimer and Vining (2016, Chap. 12).

  9. 9.

    On dynamic change and the adaptive state, see Cunliffe (2021). On better public policy via feedback thinking, see English (2021).

  10. 10.

    For a brief genealogy of evidence-based policy and the linear model of the relationship between evidence and policy, see Freiberg and Carson (2010, pp. 153–56), St John & Dale (2012, pp. 39–40). Head (2010, 2015) usefully summarises key issues and challenges in reconsidering evidence-based policy and promoting evidence-informed policy-making. On “big data”, analytics, policy and governance, see Bachner et al. (2017).

  11. 11.

    Logically one can derive a moral “ought” from an “is”, but only if the “is” expresses a truth about a reality that embodies a moral norm. Grisez et al. (1987) provide an example: “Thus, from ‘This is the act an honest person would do’ one can deduce ‘This act ought to be done’” (p. 102). See also Jonas (1984, esp. pp. 130–35).

  12. 12.

    The application of behavioural insights to public administration is promising but requires careful reflection if it is not to lead back to a technocratic application of science to policy-making. See, for example, John et al. (2011), Strassheim and Korinek (2015), Thaler and Sunstein (2009).

  13. 13.

    Wilson was subsequently recalled to prison in February 2013 following a breach of his parole conditions. He was granted parole again in December 2014 and released to live in a house on the grounds of Whanganui Prison where he was subject to GPS monitoring and supervision if he left the house. In 2018, he was sentenced to two years and four months’ imprisonment for further historical rape charges. He died of natural causes in October 2021, aged 74 years.

  14. 14.

    Pluralist societies also host unreasonable doctrines that generate different and more difficult questions about the limits of liberal tolerance. See further Bromell (2019, Chap. 4).

  15. 15.

    On the idea of an overlapping consensus, see Rawls (1971, pp. 387–88, 517, 580–81; 1987; 2001, pp. 37, 26–38; 2005).

  16. 16.

    Transit New Zealand was a Crown entity responsible for operating and planning the state highway network from 1989 to 2008. It was merged with Land Transport New Zealand in 2008 to form the New Zealand Transport Agency | Waka Kotahi.

  17. 17.

    Hubert Heinelt (2019, p. 102) reflects that in governing democratically, time resources are increasingly constrained (due to the increasing speed of technical and social innovations, pressure to make an increasing number of necessary decisions and a shrinking horizon of predictability), while the time horizon is expanding (the range of decision-making effects is growing, planning per decision is increasing as a result of growing contingencies, and the cultural and social basis of decision-making is increasing the time required for making decisions that are accepted by majorities).

  18. 18.

    Appeal to public reason does not restrict us to logos (evidence and reasoned argument), to the exclusion of pathos and ethos from the public sphere (cf. Section 4.2.2). The important contrast, Barry notes, is with authority, prescription, revelation or coercion: “In this context, ‘reason’ means reasoned argument, from premises that are in principle open to everyone to accept. We can add a contemporary gloss to this by saying that these are premises which reasonable people, seeking to reach free, uncoerced agreement with others, would accept” (Barry, 1995, p. 7). Sen (2009a) has similarly noted that: “Rationality is in fact a rather permissive discipline, which demands the test of reasoning, but allows reasoned scrutiny to take quite different forms, without necessarily imposing any great uniformity of criteria. If rationality were a church, it would be a rather broad church” (p. 195).

  19. 19.

    On a capabilities approach to well-being and human development, see Dalziel et al. (2018), Nussbaum (2000, 2011), Robeyns & Byskov (2021), Sen (1999, 2005, 2009a).

  20. 20.

    The Living Standards Framework Dashboard (N.Z. Treasury, 2021b) is a measurement tool to inform the Treasury’s advice to Government and its production of a Well-being Report that the Treasury is required to publish before the end of 2022 and then at intervals not exceeding four years (Public Finance Act 1989, Subsect. 26NB). See also Karacaoglu et al. (2019).

  21. 21.

    The 12 domains of individual and collective well-being are health; knowledge and skills; cultural capability and belonging; work, care and volunteering; engagement and voice; income, consumption and wealth; housing; environmental amenity; leisure and play; family and friends; safety; and subjective wellbeing.

  22. 22.

    In arguing contra Rawls (1971, pp. 65, 101–04) that “justice itself requires us to reward superior performance in a suitable manner”, Harsanyi nevertheless concurs with Rawls that “we must not create needless economic and social inequalities”. He maintains that “such a policy would be fully compatible with significantly smaller economic and social inequalities than we have today” (Harsanyi, 2008, p. 76).

  23. 23.

    On equity, see further Stone (2012, Chap. 2).

  24. 24.

    On efficiency, see further Stone (2012, Chap. 3).

  25. 25.

    Majone (1989) notes that because analysis cannot produce conclusive proofs, only more or less convincing arguments, analysis should be done in two stages: “the first stage to find out what the analyst wants to recommend, and a second stage to make the recommendation convincing even to a hostile and disbelieving audience” (pp. 40–41). See further Chap. 5.

  26. 26.

    See Mintrom (2003, pp. 164–169) on brainstorming and analytical discussions.

  27. 27.

    Bardach & Patashnik (2019) encourage us not to characterise the status quo as “do nothing”, although we could think of it as “do nothing different”. They comment: “It is not possible to do nothing or to ‘not decide’. Most of the trends in motion will probably persist and alter the problem, whether for better or for worse” (p. 23).

  28. 28.

    Criteria for assessment may include abstract principles or concrete effects (consequences). See Scott & Baehler (2010, pp. 131–36).

  29. 29.

    On projecting outcomes, see Bardach & Patashnik, 2019, pp. 49–70.

  30. 30.

    Anneliese Parkin (2021) reflects that ministers are “often much more aware of how problems play out in the real world than officials are. Ministers tend to come from a more diverse range of backgrounds than officials, and electorate MPs in particular do get regular insights into problems faced by communities through their electorate-office work” (p. 194).

  31. 31.

    Kibblewhite (2015, pp. 5–6) specifically referenced the 2013 amendments to the State Sector Act 1988 (Sect. 32) which elevated “free and frank” from a convention to a legislative obligation, as well as the State Services Commission’s Standards of Integrity and Conduct, the Cabinet Manual and the Official Information Act 1982. See also the N.Z. State Services Commission’s (2017) guidance on free and frank advice and policy stewardship. The Public Service Act 2020 repealed and replaced the State Sector Act 1988, and re-named the State Services Commission as Te Kawa Mataaho | the Public Service Commission. The Public Service Act para. 12(1)(b) stipulates as a public service principle: “when giving advice to Ministers, to do so in a free and frank manner”. New Zealand’s Local Government Act 2002 does not use the term “free and frank” but does require local authority decision-making to: (a) seek to identify all reasonably practicable options for the achievement of the objective of a decision; and (b) assess the options in terms of their advantages and disadvantages; and (c) if any of the options identified involves a significant decision in relation to land or a body of water, take into account the relationship of Māori and their culture and traditions with their ancestral land, water, sites, waahi tapu [places or things that are sacred or spiritually endowed and held in the highest regard], valued flora and fauna, and other taonga [treasured possessions] (Sect. 77).

References

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to David Bromell .

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Bromell, D. (2022). Doing Policy Analysis. In: The Art and Craft of Policy Advising. Springer, Cham. https://doi.org/10.1007/978-3-030-99562-1_4

Download citation

Publish with us

Policies and ethics