Abstract
We explore to what extent composite indicators, capable of aggregating multi-dimensional processes into simplified, stylised concepts, are up to the task of underpinning the development of data-based narratives for political advocacy. A recent OECD working paper (Nardo et al., 2005, Handbook on constructing composite indicators: methodology and user guide, OECD statistics working paper, STD/DOC(2005)3) offering ‘recommended practices’ for the construction of composite indicators is briefly illustrated, together with ‘pros’ and ‘cons’ associated with the use of aggregated statistical information. An attempt is made to summarise the terms of the controversy surrounding the use of composite indicators with practical and applied examples, as well as the mostly advocacy-driven spread of these measures in recent years. As an example, we focus on desirable narratives in support of the so-called Lisbon strategy and its ongoing revision, following one of the recommendations of a recent EU study [Kok: 2004, The High Level Group on Lisbon Strategy chaired by Wim Kok, Facing the Challenge, European Communities, Luxembourg, 2004 on how to streamline and reinvigorate the EU’s Lisbon Agenda. Finally we try to establish a link between the use of composite, even for analytic purposes, and the development of a robust culture of evaluation of policies based on information [Messerlin: 2005, 35th Wincott Lecture, October 3, 2005]. Of these, we try to offer stylised examples – also from the recent literature [Sapir: 2005, Globalisation and the Reform of European Social Models, 2005, http://www.bruegel.org/] where composite indicators are used.
Similar content being viewed by others
References
Alesina, A. and R. Perotti: 2004, ‘The European Union: a politically incorrect view’, NBER Working papers Series, Working Paper 10342, http://www.nber.org/papers/w10342
Center for Global Development’s Commitment to development index, CDI, http://www.cgdev.org/
Cherchye, L., C.A. Knox Lowell, W. Moesen and T. Van Puynbroeck: 2005, ‘One market, one number? A composite indicator assessment of EU internal market dynamics’, Internal Paper of the KEI (Knowledge Economy Indicators) Project, University of Leuven
EC, 2004: Brussels, 20.2.2004, Report from the commission to the Spring European Council. Delivering Lisbon reforms for the enlarged union, COM (2004) 29 final/2, http://europa.eu.int/growthandjobs/pdf/COM2004_029_en.pdf
EC: 2005a, ‘Communication from President Barroso to the Spring European Council – Working together for growth and jobs. A new start for the Lisbon Strategy’, COM (2005) 24
EC: 2005b, Information Note on STRUCTURAL INDICATORS, Directorate General Economic and Financial Affairs, 2005
EC – DG RTD: 2005, Key Figures 2005 on Science, Technology and Innovation towards a European knowledge area, July 2005, see http://www.cordis.lu/indicators/publications.htm
Funtowicz S.O. and Ravetz J.R. (1990). Uncertainty and Quality in Science for Policy. Kluwer Academic Publishers, Dordrecht, NL
Giles, C. and S. Daneshkhu: 2004, ‘International economy: failure to cut deficits “will sacrifice young”’, Financial Times; Dec 01, 2004
JRC: 2006, ‘Information server on composite indicators’, http://farmweb.jrc.cec.eu.int/CI/
Kok, W.: 2004, The High Level Group on Lisbon Strategy (chaired by Wim Kok) (2004) – Facing the Challenge, European Communities, Luxembourg
Messerlin, P.A.: 2005, ‘A European economic agenda after the NO votes’, 35th Wincott Lecture, October 3, 2005. See also Wolf, M., 2005, Brussels must scrutinise its failures, Financial Times, October 4, 2005
Monti, M.: 2005, ‘Toughen up EU reform agenda and make it count’, Financial Times, Published: March 21, 2005
Munda G. (2004). Social multi-criteria evaluation (SMCE): methodological foundations and operational consequences. European Journal of Operational Research 158(3): 662–677
Nardo, M., S. Tarantola, A. Saltelli, C. Andropoulos, R. Buescher, G. Karageorgos, A. Latvala and F. Noel: 2004, ‘The e-business readiness composite indicator for 2003: a pilot study’, EUR 21294EN
Nardo, M., M. Saisana, A. Saltelli, S. Tarantola, A. Hoffman and E. Giovannini: 2005a, ‘Handbook on constructing composite indicators: methodology and user guide’, OECD Statistics Working Paper by, STD/DOC(2005) 3, see Publications and Documents at http://www.oecd.org/
Nardo M., Saisana M., Saltelli A. and Tarantola S. (2005b). Tools for Composite Indicators Building. European Commission, report EUR 21682 EN. Joint Research Centre, Ispra, Italy
Nicoletti G., S. Scarpetta and O. Boylaud: 2000, ‘Summary indicators of product market regulation with an extension to employment protection legislation’, OECD, Economics Department Working Papers No. 226, ECO/WKP(99)18. http://www.oecd.org/eco/eco
OECD PISA: Programme for International Student Assessment, www.pisa.oecd.org
Olson, M.: 1984, The Rise and Decline of Nations: Economic Growth, Stagflation, and Social Rigidities (Yale University Press)
Rifkin J. (2004). The European Dream. Tarcher-Penguin, New York
Rosen, R.: 1991, Life Itself: A Comprehensive Inquiry into Nature, Origin, and Fabrication of Life (Columbia University Press)
Rosling, H., A. Rosling Rönnlund and O. Rosling: 2005, ‘New software brings statistics beyond the eye’, OECD World Forum on Key Indicators, Palermo, 10–13 November 2004, http://www.oecd.org/dataoecd/39/48/33843977.doc
Saisana M., Saltelli A. and Tarantola S. (2005). Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators. Journal of the Royal Statistical Society A 168(2): 1–17
Saisana, M. and S. Tarantola: 2002, ‘State-of-the-art report on current methodologies and practices for composite indicator development’, EUR 20408 EN
Saltelli, A., M. Nardo, M. Saisana and S. Tarantola: 2004, ‘Composite indicators – the controversy and the way forward’, OECD World Forum on Key Indicators, Palermo, 10–13 November 2004, http://www.oecd.org/dataoecd/40/50/33841312.doc
Saltelli, A., S. Funtowicz, A. Guimarães-Pereira, J.-P. Malingreau, G. Munda and M. Giampietro: 2005, ‘Developing effective lisbon strategy narratives’, EUR 21644 EN
Sapir, A.: 2005, Globalisation and the Reform of European Social Models, 2005, http://www.bruegel.org/
Sarewitz D. (2004). How science makes environmental controversies worse. Environmental Science & Policy 7: 385–403
Sen A. (1989). Development as capabilities expansion. Journal of Development Planning 19: 41–58
Sharpe, A.: 2004, Literature Review of Frameworks for Macro-Indicators (Centre for the Study of Living Standards, Ottawa, Canada)
SI: 2005, EUROSTAT’s Structural Indicators database, see http://europa.eu.int/comm/eurostat/structuralindicators
Tarantola, S., M. Saisana, A. Saltelli, F. Schmiedel and N. Leapman: 2002, ‘Statistical techniques and participatory approaches for the composition of the European Internal Market Index 1992–2001’, EUR 20547 EN
Transparency International’s Corruption Index, http://www.transparency.org/cpi/2004/cpi2004.en.html#cpi2004
Wolf, M.: 2005, Why Globalisation, Yale Nota Bene Series
World Economic Forum’s World Competitiveness Index, www.weforum.org/gcr
World Economic Forum’s Environmental Sustainability Index, www.yale.edu/esi/
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Saltelli, A. Composite Indicators between Analysis and Advocacy. Soc Indic Res 81, 65–77 (2007). https://doi.org/10.1007/s11205-006-0024-9
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11205-006-0024-9