Avoid common mistakes on your manuscript.
In an article in this journal, Pereira et al. (2018) use radar plots to communicate the sustainability performance of industrial activities. Their Fig. 1 presents, for three alternatives, the (normalized) score on six impact categories (energy consumption, emissions, toxicity potential, risk potential, material consumption and soil use). This format is taken from BASF’s eco-efficiency plots (Saling et al. 2002). Those authors use it for displaying graphical information, and they could alternatively have used a bar chart or another non-circular presentation. To Pereira et al. (2018), however, the circular aspect is crucial, because these authors add a metric to the diagram, in terms of the area enclosed by the polygon, for each alternative. Through this, they reduce the multi-dimensional problem to a single-dimensional metric, facilitating a ranking of options. That is a convenient result, but the validity of that result clearly depends on the scientific acceptability of the dimensionality reduction procedure. Below we will give two arguments why the approach is wrong, and its application must be rejected.
The first argument is the fact that the area of the polygon depends on the order in which the axes have been introduced. A simple example may demonstrate this. In an analysis in 6-dimensional space, a product with coordinates \(\left(\text{1,0},\text{1,0},\text{1,0}\right)\) defines a polygon with an area \(0\). But if we change the order of the coordinates, such that the product is at \(\left(\text{1,1},\text{1,0},\text{0,0}\right)\), the area is approximately \(0.87\) (Pereira et al. 2018). This dependence on the position of the axes was raised before (Feldman 2013; Albo et al. 2016), but unfortunately it is not yet common knowledge.
The second argument is based on the fact that in the radar plot all dimensions are normalized, such that the highest score is 1. Through this, it is possible that the addition or removal of irrelevant options influences the ranking of the relevant options. An example is given in Table 1, and the corresponding radar plots are in Fig. 1. Also this issue has been discussed before (Arrow 1963). In relation to the fingerprint that is used by Pereira et al. (2018), it has been discussed by Dyckhoff et al. (2015).
There are even more arguments; we refer to earlier studies (Draper et al. 2009; Zhou n.d.) for a critical treatment. Altogether, we dare to doubt the conclusion by Pereira et al. (2018) that “the results have evidenced that the [Eco-efficiency Comparison Index] is a useful tool for eco-efficiency analysis”. Usefulness can not be established without the consideration of methodological consistency.
References
Albo Y, Lanir J, Bak P, Rafaeli S (2016) Off the radar. Comparative evaluation of radial visualization solutions for composite indicators. IEEE Trans Visual Comp Graph 22:569–578. DOI https://doi.org/10.1109/tvcg.2015.2467322
Arrow K (1963) Social choice and individual values, 2nd edn. Yale University Press, Yale
Draper GM, Livnat Y, Riesenfeld RF (2009) A survey of radial methods for information visualization. IEEE Trans on Visual Comp Graph 15:759–776. DOI https://doi.org/10.1109/tvcg.2009.23
Dyckhoff H, Quandel A, Waletzke K (2015) Rationality of eco-efficiency methods. Is the BASF analysis dependent on irrelevant alternatives? Int J Life Cycle Assess 20:1557–1567. DOI https://doi.org/10.1007/s11367-015-0957-9
Feldman R (2013) Filled radar charts should not be used to compare social indicators. Soc Ind Res 111:709–712. DOI https://doi.org/10.1007/s11205-012-0028-6
Pereira CP, Prata DM, Santos LS, Monteiro LPC (2018) Development of eco-efficiency comparison index through eco-indicators for industrial applications. Braz J Chem Eng 35:69–89. DOI https://doi.org/10.1590/0104-6632.20180351s20160370
Saling P, Kicherer A, Dittrich-Krämer B, Wittlinger R, Zombik W, Schmidt I, Schrott W, Schmidt S (2002) Eco-efficiency analysis by BASF: the method. Int J Life Cycle Assess 7:203–218. DOI https://doi.org/10.1007/BF02978875
Zhou G (n.d.) Radial visualization of multidimensional/multivariate data. A survey. https://www.cs.ubc.ca/~tmm/courses/547-19/projects/gabriel/finalreport.pdf. Accessed 12 May 2022
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Heijungs, R. Two arguments against the use of radar plots for constructing composite indicators. Braz. J. Chem. Eng. 39, 885–886 (2022). https://doi.org/10.1007/s43153-022-00247-1
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s43153-022-00247-1