Skip to main content
Springer Nature Link
Log in

The Stability of Rankings Derived From Composite Indicators: Analysis of the “IL Sole 24 Ore” Quality of Life Report

  • Published:
Social Indicators Research Aims and scope Submit manuscript

Abstract

The calculation of composite indicators and the derivation of respective rankings is a common method used to benchmark countries or regions. However, although the statistical robustness of these rankings is often criticised, they often still spark off heated political debate. Here, we assess the sensitivity of the province ranking published by the Italian economics newspaper “Il Sole 24 Ore”. For this purpose, various weighting, normalising and aggregation schemes were compared. Furthermore, to assess the accuracy of the underlying model, confidence intervals were calculated for the indicator values. The dynamic properties of the rankings were also analysed by evaluating the short- and long-term forecast properties of the rankings.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
€32.70 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Finland)

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Anderson J.E., Roy A.G., Shoemaker P.A. (2003). ‘Confidence intervals for the suits index’. National Tax Journal LVI (i, Part 1). pp. 81–90

  • R.A. Becker L. Denby R. McGill A.R. Wilks (1987) ArticleTitle‘Analysis of data from the places rated almanac’ The American Statistician 41 IssueID3 169–186 Occurrence Handle10.2307/2685098

    Article  Google Scholar 

  • F. Booysen (2002) ArticleTitle‘An overview and evaluation of composite indices of development’ Social Indicator Research 59 115–151 Occurrence Handle10.1023/A:1016275505152

    Article  Google Scholar 

  • P. Dasgupta (1993) An Inquiry into Well-Being and Destitution Oxford University Press New York

    Google Scholar 

  • I.D. Dichev (1999) ArticleTitle‘How good are business school rankings?’ Journal of Business 72 IssueID2 201–213 Occurrence Handle10.1086/209610

    Article  Google Scholar 

  • B. Efron R. Tibshirani (1998) An Introduction to the Bootstrap Chapman & Hall New York

    Google Scholar 

  • European Union. (2004). ‘The Internal Market Index 2004’. DG MARKT, http://europa.eu.int/comm/internal_market/score/docs/relateddocs/2004-im-index_en.pdf

  • J. Fagerberg (2001) Europe at the crossroads: The challenge from innovation-based growth B. Lundvall D. Archibugi (Eds) Globalising Learning Economy Oxford University Press New York

    Google Scholar 

  • Freudenberg, M. (2003). ‘Composite indicators of country performance: a critical assessment’. OECD-STI working paper, DSTI/DOC(2003)16

  • Gbur E., M. Lynch and L. Weidman. (1986). ‘An analysis of nine rating criteria on 329 US metropolitan areas’. Proceedings of the Section on Statistical Graphics (American Statistical Association). pp. 104–109

  • J.F. Hair R.E. Anderson R.L. Tatham W.C. Black (1995) Multivariate Data Analysis Prentice-Hall Englewood Cliffs, NJ

    Google Scholar 

  • I. Ivanova F.J. Arcelus G. Srinivasan (1998) ArticleTitle‘Assessment of the competitiveness position of the Latin American countries’ International Journal of Commerce and Management 8 IssueID2 7–32 Occurrence Handle10.1108/eb047366

    Article  Google Scholar 

  • Kladroba, A. (2000). ‘The problem of aggregation arising in the process of building rankings; some remarks with the example of the Formula 1 Championship 1998’. Jahrbücher f. Nationalökonomie u. Statistik 220/3, pp. 302–314

  • Lippe, P. von der and A. Kladroba. (2004). ‘Measuring complex variables by sums of scores; a popular and questionable method of measurement without theory’. Jahrbücher f. Nationalökonomie u. Statistik 224/1, pp. 115–134

  • D.N. Politis J.P. Romano M. Wolf (1999) Subsampling Springer New York

    Google Scholar 

  • M. Qizilbash (2001) ArticleTitle‘Sustainable development: Concepts and rankings’ The Journal of Development Studies 37 IssueID3 134–161 Occurrence Handle10.1080/00220380412331322001

    Article  Google Scholar 

  • Saisana, M. and S. Tarantola. (2002). ‘State-of-the-art Report on Current Methodologies and Practices for Composite Indicator Development’. EUR 20408 EN, EC Joint Research Centre (JRC)

  • Saisana M., Saltelli A., Tarantola S. (2002). ‘Uncertainty and Sensitivity Analysis Techniques as Tools for the Quality Assessment of Composite Indicators’. European Commission-Joint Research Centre, Ispra Italy

  • United Nations. (2001). ‘Human Development Report’. http://www.undp.org

  • Wackernagel, M.: 2001, ‘Shortcomings of the Environmental Sustainability Index’. Redefining Progress, Feb. 2, 2001, http://www.rprogress.org/about/

  • World Economic Forum: 2005, ‘Environmental Sustainability Index’. http://www.ciesin.columbia.edu/indicators/ESI

Download references

Author information

Authors and Affiliations

  1. EURAC research, Viale Druso/Drususallee 1, 39100, Bolzano/Bozen, Italy

    G. Lun & D. Holzer

  2. Department of Economic Theory Economic Policy and Economic History, University of Innsbruck, Universitätsstraße 15, 6020, Innsbruck, Austria

    G. Tappeiner

  3. Institute of Botany, University of Innsbruck and EURAC research, Sternwartestraße 15, 6020, Innsbruck, Austria

    U. Tappeiner

Authors
  1. G. Lun
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. D. Holzer
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. G. Tappeiner
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. U. Tappeiner
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to U. Tappeiner.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Lun, G., Holzer, D., Tappeiner, G. et al. The Stability of Rankings Derived From Composite Indicators: Analysis of the “IL Sole 24 Ore” Quality of Life Report. Soc Indic Res 77, 307–331 (2006). https://doi.org/10.1007/s11205-005-4505-z

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11205-005-4505-z

Keywords

Search

Navigation