Composite Indicators between Analysis and Advocacy

Abstract

We explore to what extent composite indicators, capable of aggregating multi-dimensional processes into simplified, stylised concepts, are up to the task of underpinning the development of data-based narratives for political advocacy. A recent OECD working paper (Nardo et al., 2005, Handbook on constructing composite indicators: methodology and user guide, OECD statistics working paper, STD/DOC(2005)3) offering ‘recommended practices’ for the construction of composite indicators is briefly illustrated, together with ‘pros’ and ‘cons’ associated with the use of aggregated statistical information. An attempt is made to summarise the terms of the controversy surrounding the use of composite indicators with practical and applied examples, as well as the mostly advocacy-driven spread of these measures in recent years. As an example, we focus on desirable narratives in support of the so-called Lisbon strategy and its ongoing revision, following one of the recommendations of a recent EU study [Kok: 2004, The High Level Group on Lisbon Strategy chaired by Wim Kok, Facing the Challenge, European Communities, Luxembourg, 2004 on how to streamline and reinvigorate the EU’s Lisbon Agenda. Finally we try to establish a link between the use of composite, even for analytic purposes, and the development of a robust culture of evaluation of policies based on information [Messerlin: 2005, 35th Wincott Lecture, October 3, 2005]. Of these, we try to offer stylised examples – also from the recent literature [Sapir: 2005, Globalisation and the Reform of European Social Models, 2005, http://www.bruegel.org/] where composite indicators are used.

This is a preview of subscription content, access via your institution.

References

  1. Alesina, A. and R. Perotti: 2004, ‘The European Union: a politically incorrect view’, NBER Working papers Series, Working Paper 10342, http://www.nber.org/papers/w10342

  2. Center for Global Development’s Commitment to development index, CDI, http://www.cgdev.org/

  3. Cherchye, L., C.A. Knox Lowell, W. Moesen and T. Van Puynbroeck: 2005, ‘One market, one number? A composite indicator assessment of EU internal market dynamics’, Internal Paper of the KEI (Knowledge Economy Indicators) Project, University of Leuven

  4. EC, 2004: Brussels, 20.2.2004, Report from the commission to the Spring European Council. Delivering Lisbon reforms for the enlarged union, COM (2004) 29 final/2, http://europa.eu.int/growthandjobs/pdf/COM2004_029_en.pdf

  5. EC: 2005a, ‘Communication from President Barroso to the Spring European Council – Working together for growth and jobs. A new start for the Lisbon Strategy’, COM (2005) 24

  6. EC: 2005b, Information Note on STRUCTURAL INDICATORS, Directorate General Economic and Financial Affairs, 2005

  7. EC – DG RTD: 2005, Key Figures 2005 on Science, Technology and Innovation towards a European knowledge area, July 2005, see http://www.cordis.lu/indicators/publications.htm

  8. Funtowicz S.O. and Ravetz J.R. (1990). Uncertainty and Quality in Science for Policy. Kluwer Academic Publishers, Dordrecht, NL

    Google Scholar 

  9. Giles, C. and S. Daneshkhu: 2004, ‘International economy: failure to cut deficits “will sacrifice young”’, Financial Times; Dec 01, 2004

  10. JRC: 2006, ‘Information server on composite indicators’, http://farmweb.jrc.cec.eu.int/CI/

  11. Kok, W.: 2004, The High Level Group on Lisbon Strategy (chaired by Wim Kok) (2004) – Facing the Challenge, European Communities, Luxembourg

  12. Messerlin, P.A.: 2005, ‘A European economic agenda after the NO votes’, 35th Wincott Lecture, October 3, 2005. See also Wolf, M., 2005, Brussels must scrutinise its failures, Financial Times, October 4, 2005

  13. Monti, M.: 2005, ‘Toughen up EU reform agenda and make it count’, Financial Times, Published: March 21, 2005

  14. Munda G. (2004). Social multi-criteria evaluation (SMCE): methodological foundations and operational consequences. European Journal of Operational Research 158(3): 662–677

    Article  Google Scholar 

  15. Nardo, M., S. Tarantola, A. Saltelli, C. Andropoulos, R. Buescher, G. Karageorgos, A. Latvala and F. Noel: 2004, ‘The e-business readiness composite indicator for 2003: a pilot study’, EUR 21294EN

  16. Nardo, M., M. Saisana, A. Saltelli, S. Tarantola, A. Hoffman and E. Giovannini: 2005a, ‘Handbook on constructing composite indicators: methodology and user guide’, OECD Statistics Working Paper by, STD/DOC(2005) 3, see Publications and Documents at http://www.oecd.org/

  17. Nardo M., Saisana M., Saltelli A. and Tarantola S. (2005b). Tools for Composite Indicators Building. European Commission, report EUR 21682 EN. Joint Research Centre, Ispra, Italy

    Google Scholar 

  18. Nicoletti G., S. Scarpetta and O. Boylaud: 2000, ‘Summary indicators of product market regulation with an extension to employment protection legislation’, OECD, Economics Department Working Papers No. 226, ECO/WKP(99)18. http://www.oecd.org/eco/eco

  19. OECD PISA: Programme for International Student Assessment, www.pisa.oecd.org

  20. Olson, M.: 1984, The Rise and Decline of Nations: Economic Growth, Stagflation, and Social Rigidities (Yale University Press)

  21. Rifkin J. (2004). The European Dream. Tarcher-Penguin, New York

    Google Scholar 

  22. Rosen, R.: 1991, Life Itself: A Comprehensive Inquiry into Nature, Origin, and Fabrication of Life (Columbia University Press)

  23. Rosling, H., A. Rosling Rönnlund and O. Rosling: 2005, ‘New software brings statistics beyond the eye’, OECD World Forum on Key Indicators, Palermo, 10–13 November 2004, http://www.oecd.org/dataoecd/39/48/33843977.doc

  24. Saisana M., Saltelli A. and Tarantola S. (2005). Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators. Journal of the Royal Statistical Society A 168(2): 1–17

    Article  Google Scholar 

  25. Saisana, M. and S. Tarantola: 2002, ‘State-of-the-art report on current methodologies and practices for composite indicator development’, EUR 20408 EN

  26. Saltelli, A., M. Nardo, M. Saisana and S. Tarantola: 2004, ‘Composite indicators – the controversy and the way forward’, OECD World Forum on Key Indicators, Palermo, 10–13 November 2004, http://www.oecd.org/dataoecd/40/50/33841312.doc

  27. Saltelli, A., S. Funtowicz, A. Guimarães-Pereira, J.-P. Malingreau, G. Munda and M. Giampietro: 2005, ‘Developing effective lisbon strategy narratives’, EUR 21644 EN

  28. Sapir, A.: 2005, Globalisation and the Reform of European Social Models, 2005, http://www.bruegel.org/

  29. Sarewitz D. (2004). How science makes environmental controversies worse. Environmental Science & Policy 7: 385–403

    Article  Google Scholar 

  30. Sen A. (1989). Development as capabilities expansion. Journal of Development Planning 19: 41–58

    Google Scholar 

  31. Sharpe, A.: 2004, Literature Review of Frameworks for Macro-Indicators (Centre for the Study of Living Standards, Ottawa, Canada)

  32. SI: 2005, EUROSTAT’s Structural Indicators database, see http://europa.eu.int/comm/eurostat/structuralindicators

  33. Tarantola, S., M. Saisana, A. Saltelli, F. Schmiedel and N. Leapman: 2002, ‘Statistical techniques and participatory approaches for the composition of the European Internal Market Index 1992–2001’, EUR 20547 EN

  34. Transparency International’s Corruption Index, http://www.transparency.org/cpi/2004/cpi2004.en.html#cpi2004

  35. Wolf, M.: 2005, Why Globalisation, Yale Nota Bene Series

  36. World Economic Forum’s World Competitiveness Index, www.weforum.org/gcr

  37. World Economic Forum’s Environmental Sustainability Index, www.yale.edu/esi/

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to Andrea Saltelli.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Saltelli, A. Composite Indicators between Analysis and Advocacy. Soc Indic Res 81, 65–77 (2007). https://doi.org/10.1007/s11205-006-0024-9

Download citation

Key words

  • composite indicator
  • narrative
  • advocacy
  • Lisbon objectives