Skip to main content

Multi-criteria Evaluation in Public Economics and Policy

  • Chapter
  • First Online:
New Perspectives in Multiple Criteria Decision Making

Part of the book series: Multiple Criteria Decision Making ((MCDM))

Abstract

Public administrations need to assess policy options before their implementation; often there is some uncertainty if cost-benefit analysis (CBA) or multi-criteria evaluation (MCE) should be used. This Chapter aims at showing that MCE may help economics at overcoming some of its current difficulties in the empirical assessment of public policy options; thus MCE has to be placed in the future of welfare economics with no doubt. To corroborate this conclusion, a structured comparison of the main distinguishing features of CBA and MCE is carried out according to the following ten comparison criteria: efficiency, fairness, democratic basis, effectiveness, problem structuring, alternatives taken into account, policy consequences, comprehensiveness, transparency and mathematical aggregation rule.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    May, 2018, more than 300 readers commented the initial debate between Tom Clark, editor of Prospect Magazine and Chris Giles, the FT’s economics editor.

  2. 2.

    See e.g. comments by Maurice Obstfeld, director of the International Monetary Fund research department and Tony Yates, former monetary economist at the Bank of England.

  3. 3.

    Statement due to Martin Wolf, FT’s chief economics commentator.

  4. 4.

    Statement due to Gavin Jackson FT’s economics reporter.

  5. 5.

    Mariana Mazzucato, professor at University College London.

  6. 6.

    Diana Coyle, professor at University of Cambridge.

  7. 7.

    From the technical point of view, one should note that the fact that intensity of preference is taken into account inside a linear aggregation rule, has the consequence that weights must be considered as trade-offs. A question then arises: in their standard use, are distributional weights used as importance coefficients or as trade-offs? The basic idea underlying all the different weighting methods can be summarized by quoting the following sentence: “if the decision-maker considers individual 2 more “deserving” than individual 1 he will weight 2’s losses more heavily than 1’s gains i.e. 2 > 1” (Dasgupta and Pearce 1972, p. 65), thus weights should be considered as importance coefficients. Unfortunately, since CBA is based on a completely compensatory mathematical model, weights can only have the meaning of a trade-off ratio, as a consequence a theoretical inconsistency exists (see Munda 1996 for more details on this issue).

  8. 8.

    It has to be clarified that the concept of fairness is different from the one of an equal distribution of income. A society could have a fair inequality if the economic system promotes and rewards individual efforts. Clearly ethical connotations are there; this implies that people, social scientists and governments differ significantly on what they consider to be fair. Overall there is agreement on the fact that evaluation of fairness should be linked to the social process leading to a certain outcome and not to the outcome itself (i.e. when differences in the final income distribution of a society exist, this does not mean that the society has unfair rules).

  9. 9.

    Late lessons from early warnings: the precautionary principle 1896–2000, European Environment Agency, Environmental issue report, No. 22, 2001.

  10. 10.

    Arrow’s axiom of “the independence of irrelevant alternatives” states that the choice made in a given set of alternatives A depends only on the ordering made with respect to the alternatives in that set. Alternatives outside A (irrelevant since the choice must be made within A) should not affect the choice inside A.

  11. 11.

    This property is a necessary condition for the existence of a linear aggregation rule. From an operational point of view this means that an additive aggregation function permits the assessment of the marginal contribution of each cost and benefit separately. Each marginal contribution can then be added together to yield a total value. This implies that among the different aspects of a policy option there are no phenomena of synergy or conflict, this is rather unrealistic from a scientific point of view.

  12. 12.

    Complete compensability is not desirable for the problem we are dealing with, since it implies that e.g. a good performance on efficiency would offset a very bad one on effectiveness or vice versa. It has to be noted that CBA always allows the highest degree of compensability since it is explicitly based on the Kaldor-Hicks compensation principle and costs and benefits are aggregated linearly (and thus in a compensatory fashion).

  13. 13.

    This relates to the famous bald paradox in Greek philosophy (how many hairs one has to cut off to transform a person with hairs to a bald one?), later on Poincaré (1935, p. 69) and finally Luce (1956) made the point that the transitivity of indifference relation is incompatible with the existence of a sensibility threshold below which an agent either does not sense the difference between two objects, or refuses to declare a preference for one or the other. Luce was the first one to discuss this issue formally in the framework of preference modelling. Mathematical characterizations of preference modelling with thresholds can be found in Roubens and Vincke (1985).

  14. 14.

    This of course applies to discrete methods only and implies that the aggregation rules belong to the family of non-frontier methods.

  15. 15.

    In social choice, the reaction to Arrow’s theorem has been the search for less ambitious voting structures; there is a need to keep a few basic requirements only. These basic requirements are generally three:

    1. Anonymity: all criteria must be treated equally.

    2. Neutrality: all alternatives must be treated equally.

    3. Monotonicity: more support for an alternative cannot jeopardize its success.

    One should note that, while anonymity is clearly essential in the case of voters, it is not so in the multi-criterion problem since criterion weights can be normally introduced.

References

  • Agasisti, T., Hippe, R., & Munda, G. (2017). Efficiency of investment in compulsory education: Empirical analyses in Europe; EUR 28607 EN. Luxembourg (Luxembourg): Publications Office of the European Union; JRC106678. https://doi.org/10.2760/975369.

  • Aldred, J. (2009). Ethics and climate change cost-benefit analysis: Stern and after. New Political Economy, 14(4), 469–488.

    Article  Google Scholar 

  • Arrow, K. J. (1963). Social choice and individual values (2d ed.). New York: Wiley.

    Google Scholar 

  • Arrow, K. J., & Raynaud, H. (1986). Social choice and multicriterion decision making. Cambridge: M.I.T Press.

    Google Scholar 

  • Banville, C., Landry, M., Martel, J. M., & Boulaire, C. (1998). A stakeholder approach to MCDA. Systems Research and Behavioral Science, 15, 15–32.

    Article  Google Scholar 

  • Bell, M. L., Hobbs, B. F., & Ellis, H. (2003). The use of multi-criteria decision-making methods in the integrated assessment of climate change: Implications for IA practitioners. Socio-Economic Planning Sciences, 37(4), 289–316.

    Article  Google Scholar 

  • Bojo, J., Maler, K. G., & Unemo, L. (1990). Environment and development: An economic approach. Dordrecht: Kluwer.

    Book  Google Scholar 

  • Burgenmeier, B. (1994). The misperception of Walras. American Economic Review, 84(1), 342–352.

    Google Scholar 

  • Cerreta, M., & De Toro, P. (2010). Integrated spatial assessment for a creative decision-making process: A combined methodological approach to strategic environmental assessment. International Journal of Sustainable Development, 13(1–2), 17–30.

    Article  Google Scholar 

  • Copp, D. (1987). The justice and rationale of cost-benefit analysis. Theory and Decision, 23(1), 65–87.

    Article  Google Scholar 

  • Dasgupta, P. (2001). Valuing objects and evaluating policies in imperfect economies. Economic Journal, 111(May), C1–C29.

    Article  Google Scholar 

  • Emrouznejad, A., & Yang, G.-L. (2018). A survey and analysis of the first 40 years of scholarly literature in DEA: 1978–2016. Socio-Economic Planning Sciences, 61, 4–8.

    Article  Google Scholar 

  • Figueira, J., Greco, S., & Ehrgott, M. (Eds.) (2016). Multiple-criteria decision analysis. State of the art surveys. Springer International Series in Operations Research and Management Science, New York.

    Google Scholar 

  • Frame, B., & O’Connor, M. (2011). Integrating valuation and deliberation: The purpose of sustainability assessment. Environmental Science & Policy, 14, 1–10.

    Article  Google Scholar 

  • Frey, B. S. (1986). Economists favour the price system who else does? Kyklos, 39(4), 537–563.

    Article  Google Scholar 

  • Funtowicz, S. O., & Ravetz, J. R. (1991). A new scientific methodology for global environmental issues. In R. Costanza (Ed.), Ecological economics (pp. 137–152). New York: Columbia.

    Google Scholar 

  • Fusco Girard, L. (1986). The complex social value of the architectural heritage. Icomos Information, 1, 19–22.

    Google Scholar 

  • Gamboa, G. (2006). Social multi-criteria evaluation of different development scenarios of the Aysén region, Chile. Ecological Economics, 59(1), 157–170.

    Article  Google Scholar 

  • Gamboa, G., & Munda, G. (2007). The problem of wind-park location: A social multi-criteria evaluation framework. Energy Policy, 35(3), 1564–1583.

    Article  Google Scholar 

  • Garmendia, E., & Stagl, S. (2010). Public participation for sustainability and social learning: Concepts and lessons from three case studies in Europe. Ecological Economics, 69(8), 1712–1722.

    Google Scholar 

  • Grüne-Yanoff, T. (2009). Mismeasuring the value of statistical life. Journal of Economic Methodology, 16(2), 109–123.

    Article  Google Scholar 

  • Guimarães-Pereira, A., Guedes, S., & Tognetti, S. (Eds.). (2006). Interfaces between science and society. Sheffield: Greenleaf Publishing.

    Google Scholar 

  • Hammitt, J. K. (2013). Positive versus normative justifications for benefit-cost analysis: Implications for interpretation and policy. Review of Environmental Economics and Policy, 7(2), 199–218.

    Article  Google Scholar 

  • Hansen, F. (2011). The Stern review and its critics: Economics at work in an interdisciplinary setting. Journal of Economic Methodology, 18(3), 255–270.

    Article  Google Scholar 

  • Hansson, S. O. (2007). Philosophical problems in cost-benefit analysis. Economics and Philosophy, 23, 163–183.

    Article  Google Scholar 

  • Hicks, J. R. (1939). The foundations of welfare economics. Economic Journal, 49(196), 696–712.

    Article  Google Scholar 

  • Ishizaka, A., & Nemery, P. (2013). Multi-criteria decision analysis: Methods and software. Wiley.

    Google Scholar 

  • Kaldor, N. (1939). Welfare comparison of economics and interpersonal comparisons of utility. Economic Journal, 49(195), 549–552.

    Article  Google Scholar 

  • Keeney, R., & Raiffa, H. (1976). Decision with multiple objectives: Preferences and value trade-offs. New York: Wiley.

    Google Scholar 

  • Laffont, J. J. (2000). Incentives and political economy. Oxford: Oxford University Press.

    Google Scholar 

  • Lerche, N., Wilkens, I., Schmehl, M., Eigner-Thiel, S., & Geldermann, J. (2017). Using methods of multi-criteria decision making to provide decision support concerning local bioenergy projects. Socio-Economic Planning Sciences. ISSN 0038-0121. https://doi.org/10.1016/j.seps.2017.08.002.

  • Lo, A. Y., & Spash, C. L. (2013). Deliberative monetary valuation: In search of a democratic and value plural approach to environmental policy. Journal of Economic Surveys, 27(4), 768–789.

    Article  Google Scholar 

  • Luce, R. D. (1956). Semiorders and a theory of utility discrimination. Econometrica, 24, 178–191.

    Article  Google Scholar 

  • Martinez-Alier, J., Munda, G., & O’Neill, J. (1998). Weak comparability of values as a foundation for ecological economics. Ecological Economics, 26, 277–286.

    Article  Google Scholar 

  • Mishan, E. J. (1971). Cost-benefit analysis. London: Allen and Unwin.

    Google Scholar 

  • Monterroso, I., Binimelis, R., & Rodríguez-Labajos, B. (2011). New methods for the analysis of invasion processes: Multi-criteria evaluation of the invasion of Hydrilla verticillata in Guatemala. Journal of Environmental Management, 92(3), 494–507.

    Article  Google Scholar 

  • Munda G., Nijkamp P., & Rietveld P. (1995). Monetary and non-monetary evaluation methods in sustainable development planning. Economie Appliquée, XLVIII(2), 145–162.

    Google Scholar 

  • Munda, G. (1996). Cost-benefit analysis in integrated environmental assessment: Some methodological issues. Ecological Economics, 19(2), 157–168.

    Article  Google Scholar 

  • Munda, G. (2004). Social multi-criteria evaluation (SMCE): Methodological foundations and operational consequences. European Journal of Operational Research, 158(3), 662–677.

    Article  Google Scholar 

  • Munda, G. (2008). Social multi-criteria evaluation for a sustainable economy. Heidelberg, New York: Springer.

    Book  Google Scholar 

  • Munda, G. (2014). Economic democracy, political democracy and evaluation frameworks, BDC. Bollettino del Centro Calza Bini, 14(2), 267–284. Universita‘ degli Studi di Napoli Federico II.

    Google Scholar 

  • Munda, G. (2016). Beyond welfare economics: Some methodological issues. Journal of Economic Methodology, 23(2), 185–202.

    Article  Google Scholar 

  • Musgrave, A. (1981). Unreal assumptions in economic theory: The F-twist untwisted. Kyklos, 34, 377–387.

    Article  Google Scholar 

  • O’Neill, J. (1993). Ecology, policy and politics. London: Routledge.

    Google Scholar 

  • O’Neill, J. (2001). Representing people, representing nature, representing the world. Environment and Planning C: Government and Policy, 19(4), 483–500.

    Article  Google Scholar 

  • Özkaynak, B. (2008). Globalisation and local resistance: Alternative city developmental scenarios on capital’s global frontier-the case of Yalova, Turkey. Progress in Planning, 70(2), 45–97.

    Article  Google Scholar 

  • Pearce, D. W., & Nash, C. A. (1989). The social appraisal of projects. London: MacMillan.

    Google Scholar 

  • Poincaré, H. (1935). La valeur de la science. Flammarion.

    Google Scholar 

  • Roubens, M., & Vincke, P. H. (1985). Preference modelling. Heidelberg: Springer.

    Book  Google Scholar 

  • Roy, B. (1996). Multicriteria methodology for decision analysis. Dordrecht: Kluwer.

    Book  Google Scholar 

  • Sagoff, M. (1988). Some problems with environmental economics. Environmental Ethics, 10, 55–74.

    Article  Google Scholar 

  • Scolobig, A., Broto, V. C., & Zabala, A. (2008). Integrating multiple perspectives in social multicriteria evaluation of flood-mitigation alternatives: The case of Malborghetto-Valbruna. Environment and Planning C: Government and Policy, 26(6), 1143–1161.

    Article  Google Scholar 

  • Simon, H. A. (1976). From substantive to procedural rationality. In J. S. Latsis (Ed.), Methods and appraisal in economics. Cambridge: Cambridge University Press.

    Google Scholar 

  • Soma, K., & Vatn, A. (2009). Local democracy implications for coastal zone management-A case study in southern Norway. Land Use Policy, 26(3), 755–762.

    Article  Google Scholar 

  • Spash, C. L. (2008). Deliberative monetary valuation and the evidence for a new value theory. Land Economics, 84(3), 469–488.

    Article  Google Scholar 

  • Stiglitz, J. E. (2002). New perspectives on public finance: Recent achievements and future challenges. Journal of Public Economics, 86, 341–360.

    Article  Google Scholar 

  • Straton, A. T., Jackson, S., Marinoni, O., Proctor, W., & Woodward, E. (2010). Exploring and evaluating scenarios for a river catchment in Northern Australia using scenario development, multi-criteria analysis and a deliberative process as a tool for water planning. Water Resources Management, 25(1), 141–164.

    Article  Google Scholar 

  • Vatn, A., & Bromley, D. W. (1994). Choices without prices without apologies. Journal of Environmental Economics and Management, 26, 129–148.

    Article  Google Scholar 

  • Zendehdel, K., Rademaker, M., De Baets, B., & Van Huylenbroeck, G. (2010). Environmental decision making with conflicting social groups: A case study of the Lar rangeland in Iran. Journal of Arid Environments, 74(3), 394–402.

    Google Scholar 

Download references

Acknowledgements

This research has been developed in the context of the activities of the Competence Centre on Modelling. Comments by Leen Hordijk are gratefully acknowledged. The views expressed are purely those of the writer and may not in any circumstances be regarded as stating an official position of the European Commission.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Giuseppe Munda .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Munda, G. (2019). Multi-criteria Evaluation in Public Economics and Policy. In: Doumpos, M., Figueira, J., Greco, S., Zopounidis, C. (eds) New Perspectives in Multiple Criteria Decision Making. Multiple Criteria Decision Making. Springer, Cham. https://doi.org/10.1007/978-3-030-11482-4_11

Download citation

Publish with us

Policies and ethics