Skip to main content
Log in

Composite Indicators between Analysis and Advocacy

  • Published:
Social Indicators Research Aims and scope Submit manuscript

Abstract

We explore to what extent composite indicators, capable of aggregating multi-dimensional processes into simplified, stylised concepts, are up to the task of underpinning the development of data-based narratives for political advocacy. A recent OECD working paper (Nardo et al., 2005, Handbook on constructing composite indicators: methodology and user guide, OECD statistics working paper, STD/DOC(2005)3) offering ‘recommended practices’ for the construction of composite indicators is briefly illustrated, together with ‘pros’ and ‘cons’ associated with the use of aggregated statistical information. An attempt is made to summarise the terms of the controversy surrounding the use of composite indicators with practical and applied examples, as well as the mostly advocacy-driven spread of these measures in recent years. As an example, we focus on desirable narratives in support of the so-called Lisbon strategy and its ongoing revision, following one of the recommendations of a recent EU study [Kok: 2004, The High Level Group on Lisbon Strategy chaired by Wim Kok, Facing the Challenge, European Communities, Luxembourg, 2004 on how to streamline and reinvigorate the EU’s Lisbon Agenda. Finally we try to establish a link between the use of composite, even for analytic purposes, and the development of a robust culture of evaluation of policies based on information [Messerlin: 2005, 35th Wincott Lecture, October 3, 2005]. Of these, we try to offer stylised examples – also from the recent literature [Sapir: 2005, Globalisation and the Reform of European Social Models, 2005, http://www.bruegel.org/] where composite indicators are used.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  • Alesina, A. and R. Perotti: 2004, ‘The European Union: a politically incorrect view’, NBER Working papers Series, Working Paper 10342, http://www.nber.org/papers/w10342

  • Center for Global Development’s Commitment to development index, CDI, http://www.cgdev.org/

  • Cherchye, L., C.A. Knox Lowell, W. Moesen and T. Van Puynbroeck: 2005, ‘One market, one number? A composite indicator assessment of EU internal market dynamics’, Internal Paper of the KEI (Knowledge Economy Indicators) Project, University of Leuven

  • EC, 2004: Brussels, 20.2.2004, Report from the commission to the Spring European Council. Delivering Lisbon reforms for the enlarged union, COM (2004) 29 final/2, http://europa.eu.int/growthandjobs/pdf/COM2004_029_en.pdf

  • EC: 2005a, ‘Communication from President Barroso to the Spring European Council – Working together for growth and jobs. A new start for the Lisbon Strategy’, COM (2005) 24

  • EC: 2005b, Information Note on STRUCTURAL INDICATORS, Directorate General Economic and Financial Affairs, 2005

  • EC – DG RTD: 2005, Key Figures 2005 on Science, Technology and Innovation towards a European knowledge area, July 2005, see http://www.cordis.lu/indicators/publications.htm

  • Funtowicz S.O. and Ravetz J.R. (1990). Uncertainty and Quality in Science for Policy. Kluwer Academic Publishers, Dordrecht, NL

    Google Scholar 

  • Giles, C. and S. Daneshkhu: 2004, ‘International economy: failure to cut deficits “will sacrifice young”’, Financial Times; Dec 01, 2004

  • JRC: 2006, ‘Information server on composite indicators’, http://farmweb.jrc.cec.eu.int/CI/

  • Kok, W.: 2004, The High Level Group on Lisbon Strategy (chaired by Wim Kok) (2004) – Facing the Challenge, European Communities, Luxembourg

  • Messerlin, P.A.: 2005, ‘A European economic agenda after the NO votes’, 35th Wincott Lecture, October 3, 2005. See also Wolf, M., 2005, Brussels must scrutinise its failures, Financial Times, October 4, 2005

  • Monti, M.: 2005, ‘Toughen up EU reform agenda and make it count’, Financial Times, Published: March 21, 2005

  • Munda G. (2004). Social multi-criteria evaluation (SMCE): methodological foundations and operational consequences. European Journal of Operational Research 158(3): 662–677

    Article  Google Scholar 

  • Nardo, M., S. Tarantola, A. Saltelli, C. Andropoulos, R. Buescher, G. Karageorgos, A. Latvala and F. Noel: 2004, ‘The e-business readiness composite indicator for 2003: a pilot study’, EUR 21294EN

  • Nardo, M., M. Saisana, A. Saltelli, S. Tarantola, A. Hoffman and E. Giovannini: 2005a, ‘Handbook on constructing composite indicators: methodology and user guide’, OECD Statistics Working Paper by, STD/DOC(2005) 3, see Publications and Documents at http://www.oecd.org/

  • Nardo M., Saisana M., Saltelli A. and Tarantola S. (2005b). Tools for Composite Indicators Building. European Commission, report EUR 21682 EN. Joint Research Centre, Ispra, Italy

    Google Scholar 

  • Nicoletti G., S. Scarpetta and O. Boylaud: 2000, ‘Summary indicators of product market regulation with an extension to employment protection legislation’, OECD, Economics Department Working Papers No. 226, ECO/WKP(99)18. http://www.oecd.org/eco/eco

  • OECD PISA: Programme for International Student Assessment, www.pisa.oecd.org

  • Olson, M.: 1984, The Rise and Decline of Nations: Economic Growth, Stagflation, and Social Rigidities (Yale University Press)

  • Rifkin J. (2004). The European Dream. Tarcher-Penguin, New York

    Google Scholar 

  • Rosen, R.: 1991, Life Itself: A Comprehensive Inquiry into Nature, Origin, and Fabrication of Life (Columbia University Press)

  • Rosling, H., A. Rosling Rönnlund and O. Rosling: 2005, ‘New software brings statistics beyond the eye’, OECD World Forum on Key Indicators, Palermo, 10–13 November 2004, http://www.oecd.org/dataoecd/39/48/33843977.doc

  • Saisana M., Saltelli A. and Tarantola S. (2005). Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators. Journal of the Royal Statistical Society A 168(2): 1–17

    Article  Google Scholar 

  • Saisana, M. and S. Tarantola: 2002, ‘State-of-the-art report on current methodologies and practices for composite indicator development’, EUR 20408 EN

  • Saltelli, A., M. Nardo, M. Saisana and S. Tarantola: 2004, ‘Composite indicators – the controversy and the way forward’, OECD World Forum on Key Indicators, Palermo, 10–13 November 2004, http://www.oecd.org/dataoecd/40/50/33841312.doc

  • Saltelli, A., S. Funtowicz, A. Guimarães-Pereira, J.-P. Malingreau, G. Munda and M. Giampietro: 2005, ‘Developing effective lisbon strategy narratives’, EUR 21644 EN

  • Sapir, A.: 2005, Globalisation and the Reform of European Social Models, 2005, http://www.bruegel.org/

  • Sarewitz D. (2004). How science makes environmental controversies worse. Environmental Science & Policy 7: 385–403

    Article  Google Scholar 

  • Sen A. (1989). Development as capabilities expansion. Journal of Development Planning 19: 41–58

    Google Scholar 

  • Sharpe, A.: 2004, Literature Review of Frameworks for Macro-Indicators (Centre for the Study of Living Standards, Ottawa, Canada)

  • SI: 2005, EUROSTAT’s Structural Indicators database, see http://europa.eu.int/comm/eurostat/structuralindicators

  • Tarantola, S., M. Saisana, A. Saltelli, F. Schmiedel and N. Leapman: 2002, ‘Statistical techniques and participatory approaches for the composition of the European Internal Market Index 1992–2001’, EUR 20547 EN

  • Transparency International’s Corruption Index, http://www.transparency.org/cpi/2004/cpi2004.en.html#cpi2004

  • Wolf, M.: 2005, Why Globalisation, Yale Nota Bene Series

  • World Economic Forum’s World Competitiveness Index, www.weforum.org/gcr

  • World Economic Forum’s Environmental Sustainability Index, www.yale.edu/esi/

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Andrea Saltelli.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Saltelli, A. Composite Indicators between Analysis and Advocacy. Soc Indic Res 81, 65–77 (2007). https://doi.org/10.1007/s11205-006-0024-9

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11205-006-0024-9

Key words

Navigation