Abstract
We present a group decision making framework for evaluating sustainability of the insulating materials. We tested thirteen materials on a model that was applied to retrofit a traditional rural building through roof’s insulation. To evaluate the materials from the socioeconomic and environmental viewpoints, we combined life cycle costing and assessment with an adaptive comfort evaluation. In this way, the performances of each coating material were measured in terms of an incurred reduction of costs and consumption of resources, maintenance of the cultural and historic significance of buildings, and a guaranteed indoor thermal comfort. The comprehensive assessment of the materials involved their assignment to one of the three preferenceordered sustainability classes. For this purpose, we used a multiple criteria decision analysis approach that accounted for preferences of a few tens of rural buildings’ owners. The proposed methodological framework incorporated an outrankingbased preference model to compare the insulating materials with the characteristic class profiles while using the weights derived from the revised Simos procedure. The initial sorting recommendation for each material was validated against the outcomes of robustness analysis that combined the preferences of individual stakeholders either at the output or at the input level. The analysis revealed that the most favorable materials in terms of their overall sustainability were glass wool, hemp fibres, kenaf fibres, polystyrene foam, polyurethane, and rock wool.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
This paper presents a group decision framework for evaluating sustainability of the insulating materials to retrofit traditional rural buildings. The importance of this research derives from the previous studies on both retrofitting solutions tailored to traditional rural buildings as well as judging an overall desirability of coating materials (see, e.g., Krarti 2015; Fabbri et al. 2012; Ma et al. 2012; Yung and Chan 2012; MartínezMolina et al. 2016). These studies prove that energy efficiency and thermal comfort are crucial for the maintenance of historic buildings.
The context of the study is that of a typical farmhouse in central Italy. The incorporated building model derives from the analysis of over 800 farmhouses surveyed by the census of the scattered rural buildings of the municipality of Perugia (Umbria region). The high landscape values of traditional buildings and the legislation about their preservation prevent external alterations (Mazzarella 2015). Therefore, the most viable solutions are to intervene on the roof of these structures, increasing their thermal inertia with coating materials (Verbeeck and Hens 2005; Kumar and Suman 2013; Taylor et al. 2000).
We comprehensively evaluate the materials for the roof insulation by considering economic, social, and environmental viewpoints. For this purpose, we incorporate a life cycle costing (LCC) approach, a life cycle assessment (LCA), and a dynamic thermal simulation for the evaluation of energy savings and thermal comfort. As such, we aim at identifying the materials that guarantee the indoor thermal comfort, at the same time reducing the consumption of resources in their entire life cycle as well as maintaining cultural and historic significance of the buildings. In this perspective, we differentiate from the vast majority of previous studies concerning coating materials which incorporate a monodisciplinary approach (Copiello 2017).
To provide an overall sustainability assessment of coating materials, we incorporate Multiple Criteria Decision Analysis (MCDA). MCDA offers a diversity of approaches designed for providing the decision makers (DMs) with a recommendation concerning a set of alternatives evaluated in terms of multiple conflicting points of view. Few applications of MCDA methods for the evaluation of building materials, which are reported in the literature (Ginevicius et al. 2008) deal mainly with the environmental sustainability of materials (Papadopoulos and Giama 2007; Khoshnava et al. 2016). Some combinations of LCA and MCDA were considered by Santos et al. (2017) and Piombo et al. (2016). Applications which included both LCC and LCA for the definition of criteria to be used in MCDA are still rare (Piombo et al. 2016). Decision analysis methods used in the abovementioned studies involved different variants of AHP (Motuziene et al. 2016; Khoshnava et al. 2016), PROMETHEE II (Kumar et al. 2017), Weighted Sum, TOPSIS (Čuláková et al. 2013), VIKOR, and COPRAS (Ginevicius et al. 2008).
From the viewpoint of MCDA, our study differs from the aforementioned ones in terms of the following major aspects:

We formulate the considered problem in terms of multiple criteria sorting, thus aiming at assigning the materials to a set of predefined and ordered sustainability classes (categories) rather than at ordering them from the best to the worst;

We assess the insulating materials while taking into account preferences of multiple DMs (owners of rural houses), thus incorporating group decision making tools into the evaluation framework;

The adopted assignment procedure builds upon outrankingbased comparison of the insulating materials with the characteristic profiles composed of the perclass most representative performances on all criteria (Kadziński et al. 2015b);

The research results are validated against the outcomes of robustness analysis that takes into account all sets of weights compatible with either the ranking of criteria provided by each DM within the revised Simos (SRF) procedure (Figueira and Roy 2002) or a group compromise ranking of criteria that is constructed with an original procedure proposed in this paper.
The remainder of the paper is organized in the following way. In the next section, we review the existing group decision making methods for multiple criteria sorting. Section 3 describes a threestage decision aiding method that has been used to evaluate the insulating materials while taking into account preferences of a group of stakeholders. Section 4 exhibits comprehensive results of multiple criteria assessment of the insulating materials. The last section concludes.
2 Review of Multiple Criteria Sorting Group Decision Methods
The objective of the case study presented in this paper is to give an easily interpretable comprehensive assessment of the insulating materials’ sustainability. This is achieved by assigning them to a set of predefined and ordered decision classes based on their performances on multiple criteria (Kadziński et al. 2015b). While computing the sorting recommendation, we account for the preferences of a group of experts and stakeholders. This requires implementation of a group decision making framework.
As realworld situations often involve multiple stakeholders, some methods have been proposed to support groups in making collective sorting decisions (Daher and Almeida 2010). These approaches can be distinguished at different levels. In particular, they differ in terms of a preference model employed to represent preferences of the DMs. Furthermore, an underlying classification rule may involve analysis of a single preference model instance or all sets of parameters compatible with the DMs’ preference information. Moreover, sorting methods can be divided with respect to the level on which individual viewpoints are aggregated (Dias and Climaco 2000). Finally, some approaches account for the importance degrees of the involved DMs, while other methods assume that all DMs play the same role in the committee.
Among multiple criteria sorting group decision methods, outrankingbased approaches are prevailing. Most decision support systems in this stream incorporate Electre TRIB (Yu 1992; Roy 1996). For example, Dias and Climaco (2000) proposed an approach that admits each DM to specify imprecise constraints on the parameters of an outranking model, then exploits a set of compatible parameters using robust assignment rule, and finally aggregates individual perspectives in a disjunctive or conjunctive manner (thus, not accounting for the DMs’ powers). The former accepts an assignment if it is justified by at least one DM, whereas the latter confirms some classification only if it is consistent with the preferences of all DMs. In this way, a group may agree on some result even if its members do not share the same model parameters. This idea was extended by Damart et al. (2007) to an interactive preference disaggregation approach that accepts assignment examples provided by different DMs. The method incorporates robustness analysis by deriving for each DM the possible class assignments (confirmed by at least one compatible preference model instance) and guides the group on sorting exemplary alternatives by exhibiting the levels of consensus between the DMs. Analogously, Shen et al. (2016) developed an adaptive approach under intuitionistic fuzzy environment that allows to reach a classification with an acceptable individual and group consensus levels. Moreover, de Morais Bezerra et al. (2017) enriched Electre TRIB with the tools for visualizing the comparison of individual results and procedures for guiding the changes of model parameters for deriving a better consensus.
Furthermore, Jabeur and Martel (2007) proposed a framework, which derives a collective sorting decision at the output level from the individual nonrobust classifications by additionally accounting for the relative importance of group members. Then, Morais et al. (2014) used a stochastic variant of Electre TRIB, called SMAATRI, to consider uncertainty in criteria weights and to derive for each DM the shares of the relevant parameter vectors that assign a given alternative to a certain category. An overview of thus obtained individual results leads to a collective recommendation. Conversely, Cailloux et al. (2012) employed assignment examples provided by multiple DMs for reaching an agreement at the input level. In particular, they proposed some linear programming models for deriving a joint set of boundary class profiles and veto thresholds.
As far as outrankingbased sorting approaches incorporating a model typical for PROMETHEE are concerned, Nemery (2008) extended the FlowSort method to group decision making. His proposal derives an assignment for each alternative from its relative comparison (strength and weakness) against the boundary or central class profiles specified by each individual DM. A similar idea was implemented by Lolli et al. (2015) in FlowSortGDSS. The underlying procedure derives class assignments by comparing comprehensive (global) net flows of alternatives and reference profiles. The proposed sorting rules distinguish between scenarios in which analysis of the individual assignments leads to either univocal or nonunanimous recommendation. Although the viewpoints of different DMs are aggregated at the output level, the method defines some consistency conditions on the preference information (in particular, reference profiles) provided by the individual DMs.
The majority of existing valuebased approaches derive a sorting recommendation incorporating robustness analysis and not differentiating between the roles played by the DMs. In particular, the \(\hbox {UTADIS}^\mathrm{GMS}\)GROUP method (Greco et al. 2012) accounts for the assignment examples provided by each DM and derives collective results that concern two levels of certainty. The first level refers to the necessary and possible consequences of individual preference information, which is typical for Robust Ordinal Regression (ROR) (Greco et al. 2010; Kadziński et al. 2015b). The other level is related to the necessity or possibility of a support that a particular assignment is given in the set of DMs. This method was further adapted by Liu et al. (2015) to account for the uncertain evaluations represented with the evidential reasoning approach, to provide some measures on the agreement between the DMs, and to derive a collective univocal assignment.
Conversely, Kadziński et al. (2013) aimed at a joint representation of assignment examples provided by all DMs by a set of additive value functions and investigating the necessary and possible consequences of applying the latter on the set of alternatives. When there is no value function compatible with preferences of all DMs, some linear programming techniques can be used to remove a minimal subset of inconsistent assignment examples. A similar approach was proposed by Cai et al. (2012), though additionally accounting for the DMs’ priorities. The latter ones intervene in the selection of a representative value function and in resolving inconsistency in the provided assignment examples. These priorities are updated with the progressive preference elicitation process to reflect the preciseness, quantity and consistency of the example decisions supplied by each DM.
Finally, when it comes to using “if ...then ...” decision rules for representing preferences of the DMs, one proposed various extensions of the Dominancebased Rough Set Approach (DRSA) (Greco et al. 2001). These accept preference information in form of individual assignment examples. First, Greco et al. (2006) introduced some concepts (e.g., multiunion and megaunion) related to dominance with respect to minimal profiles of evaluations provided by different DMs. Then, Chen et al. (2012) proposed to aggregate the recommendations suggested by individual linguistic decision rules into an overall assignment be means of a Dempster–Shafer Theory. The crucial concepts incorporated in the DRSA sorting method proposed by Sun and Ma (2015) are a dominance relation on the set of multiple sorting decisions (each provided by an individual DM) and a multiagent conflict analysis framework. Furthermore, Chakhar and Saad (2012) and Chakhar et al. (2016) illustrated how to combine individual approximations of class unions and derive collective decision rules that permit classification of all alternatives in a way consistent with the judgments of all DMs. These approaches measure the contribution of each expert to the collective assignment in terms of the individual quality of classification. Finally, Kadziński et al. (2016) adapted the principle of ROR to a group decision framework with DRSA, thus considering all sets of rules compatible with the individual assignment examples and combining their indications only at the output level.
In this paper, we propose an outrankingbased group decision approach that incorporates Electre TRIrC. Thus, it derives the assignments by comparing alternatives with the characteristic class profiles rather than with the boundary profiles as in Electre TRIB. The basic procedure we use takes into account a single preference model instance (incorporating criteria weights derived from the SRF procedure) for each DM and aggregates the individual viewpoints at the output level. While still aggregating the preferences at the output level, we extend the basic framework to offer results of robustness analysis with multiple sets of parameters compatible with the DMs’ value systems. Additionally, we propose a new algorithm for constructing a group compromise ranking of criteria, hence offering aggregation of the individual viewpoints also at the input level. At all stages, we assume that the involved stakeholders have the same importance degrees. Moreover, instead of providing precise assignments, our framework offers acceptability indices indicating the support that is given to the assignment of each alternative to various classes by different DMs and/or preference model instances compatible with their preferences.
3 Multiple Criteria Decision Analysis Method for the Assessment of Insulating Materials
This section describes a threestage multiple criteria decision analysis method that has been used to evaluate the insulating materials while taking into account preferences of a group of stakeholders. Firstly, we discuss the Electre TRIrC method (Kadziński et al. 2015b) that has been employed to assign the materials to a set of predefined and ordered classes. It incorporates the SRF procedure to compute the criteria weights (Figueira and Roy 2002). The method has been extended to a group decision setting to derive for each material some group class acceptability indices, which indicate the proportion of stakeholders that accept an assignment of the material to a given class. Secondly, we have adapted Stochastic Multicriteria Acceptability Analysis (SMAA; Lahdelma and Salminen 2001; Tervonen and Figueira 2008; Tervonen et al. 2007) to the context of Electre TRIrC and SRF procedure. It has been used to conduct robustness analysis (Roy 2010) for the results obtained in the first part, i.e., to validate their certainty while avoiding the arbitrary choice of criteria weights, which is conducted by the SRF procedure. Thirdly, we have proposed an algorithm for constructing a group compromise ranking of criteria based on the orders provided by the individual DMs. This ranking of criteria has been used as an input for SMAA to offer yet another view on the stability of computed results.
Let us use the following notation (Kadziński et al. 2015a):

\(A=\left\{ {a_1 ,a_2 ,\ldots ,a_n } \right\} \) is a set of alternatives (insulating materials);

\(G=\left\{ {g_1 ,g_2 ,\ldots ,g_m } \right\} \) is a family of evaluation criteria that represent relevant points of view on the quality of assessed alternatives;

\(g_j \left( a \right) \) is the performance of alternative a with respect to criterion \(g_j \), \(j=1,\ldots ,m\) (when presenting the method, without loss of generality, we assume that all criteria are of gain type, i.e., the greater the performance, the better);

\(C_1 ,C_2 ,\ldots ,C_p \) are the preference ordered classes to which alternatives should be assigned; we assume that \(C_h \) is preferred to \(C_{h1} \) for \(h=2,\ldots ,p\).
3.1 Assessment of Insulating Materials Within a Group Decision Framework Incorporating Electre TRIrC and the SRF Procedure
In this section, we present the Electre TRIrC method (Kadziński et al. 2015b) that is used to assign the materials to a set of predefined and ordered classes. The method derives for each material a possibly imprecise assignment by constructing and exploiting an outranking relation S (Figueira et al. 2013). This relation quantifies an outcome of the comparison between the materials and a set of characteristic class profiles (Rezaei et al. 2017). In what follows, we discuss the main steps of the incorporated approach.
Step 1 For each class \(C_h \), provide the most typical (representative) performances on all criteria \(g_j , j=1,\ldots ,m,\) thus specifying the characteristic profiles \(b_h \), \(h=1,\ldots ,p\) (Almeida Dias et al. 2010). Defining such profiles was found intuitive and manageable by the involved experts, which was the main reason for incorporating Electre TRIrC in the study. The set of all characteristic profiles is denoted by B.
Steps 2–7 are conducted separately for each Decision Maker (\(DM_k \), \(k=1,\ldots ,K)\) in \(\partial ^{\mathrm{K}}=\left\{ {DM_1 ,DM_2 ,\ldots ,DM_K } \right\} \).
Step 2 Determine the weight \(w_j^k \) of each criterion \(g_j \), \(j=1,\ldots ,m,\) using the SRF procedure (Figueira and Roy 2002). This method expects \(DM_k \) to:

Assign some importance rank \(l^{k}\left( j \right) \) to each criterion \(g_j \); this is attained by ordering the cards with criteria names from the least to the most important (the greater \(l^{k}\left( j \right) \), the greater \(w_j^k \); some criteria can be assigned the same rank, thus being judged indifferent);

Quantify a difference between importance coefficients of the successive groups of criteria judged as indifferent, \(L_s^k \) and \(L_{s+1}^k \), by inserting \(e_s^k \) white (empty) cards between them (the greater \(e_s^k \), the greater the difference between the weights assigned to the criteria contained in \(L_{s+1}^k \) and \(L_s^k )\);

Specify ratio \(Z^{k}\) between the importances of the most and the least significant criteria denoted by \(L_{v\left( k \right) }^k \) and \(L_1^k \).
These inputs are used to derive the criteria weights as follows (Figueira and Roy 2002; Corrente et al. 2016):
Steps 3–6 are conducted for each pair consisting of alternative a and profile \(b_h \).
Step 3 For each criterion \(g_j \) compute a marginal concordance index \(c_j^k \left( {a,b_h } \right) \) defined as follows:
The index quantifies a degree to which a is at least as good as \(b_h \) on \(g_j \). Let us remark that in our study the experts defined the performances of characteristic profiles on all criteria by selecting them from the performances of the considered materials. This facilitated the preference elicitation process when dealing with a set of criteria with heterogeneous performance scales. In this perspective, when comparing the alternatives with the characteristic class profiles, we decided to exploit only the ordinal character of criteria and not use the discrimination (indifference and preference) thresholds, which can be, in general, employed in Electre. That is, in our application, the outranking of alternative a over profile \(b_h \) on \(g_j \) means that \(g_j \left( a \right) \) is at least as good as the most typical (representative) performance for class \(C_h \) on \(g_j \) of some considered material.
Step 4 Compute a comprehensive concordance index \(\sigma ^{k}\left( {a,b_h } \right) \) defined in the following way:
The index quantifies a joint strength of a subset of criteria supporting the hypothesis about a outranking \(b_h \) (\(aS^{k}b_h )\). Note that in our study, no criterion was judged strong enough to be attributed a power to veto against the outranking relation. Thus, no discordance effect has been considered.
Step 5 Specify the cutting level \(\lambda ^{k}\) (also called majority threshold), and compare \(\sigma ^{k}\left( {a,b_h } \right) \) with \(\lambda ^{k}\) to verify the truth of a crisp outranking relation \(aS^{k}b_h \) in the following way:
The truth of relation \(b_h S^{k}a\) can be verified analogously.
Step 6 Use information on the truth or falsity of \(aS^{k}b_h \) and \(b_h S^{k}a\) to check the validity of:

a being preferred to \(b_h \) (\(aS^{k}b_h \wedge not\left( {b_h S^{k}a} \right) \Rightarrow a\succ _k b_h )\);

\(b_h \) being preferred to a (\(b_h S^{k}a\wedge not\left( {aS^{k}b_h } \right) \Rightarrow b_h \succ _k a)\);

a being indifferent with \(b_h \) (\(aS^{k}b_h \wedge b_h S^{k}a \Rightarrow a\sim _k b_h )\);

a being incomparable with \(b_h \) (\(not\left( {aS^{k}b_h } \right) \wedge not\left( {b_h S^{k}a} \right) \Rightarrow a?_k b_h )\).
Step 7 For alternative a determine its desired class interval \(C^{k}\left( a \right) =\left[ {C_L^k \left( a \right) ,C_R^k \left( a \right) } \right] \) by applying the assignment rules of ELECTRE TRIrC (Kadziński et al. 2015b). To compute the worst class \(C_L^k \left( a \right) \), compare a successively to \(b_h \), for \(h=p1,\ldots ,1\), seeking the first (i.e., the best) characteristic profile \(b_h \) such that:
and select \(C_L^k \left( a \right) =C_{h+1} \). When no such a profile is found, \(C_L^k \left( a \right) =C_1 \).
To compute the best class \(C_R^k \left( a \right) \), compare a successively to \(b_h \), for \(h=2,\ldots ,p\), seeking the first (i.e., the worst) characteristic profile \(b_h \) such that:
and select \(C_R^k \left( a \right) =C_{h1} \). In case no such a profile is found, \(C_R^k \left( a \right) =C_p \).
Step 8 Combine the individual class assignments for all DMs into group class acceptability indices \(E^{\partial }\left( {a,h} \right) \) (Damart et al. 2007; Kadziński et al. 2016). These are defined as the proportion of DMs (stakeholders) that accept an assignment of alternative a to class \(C_h \), i.e.:
where for \(k=1,\ldots ,K\):
This measure indicates a cumulative support given to the assignment of a to \(C_h \) by all group members.
3.2 Stochastic Multicriteria Acceptability Analysis with Electre TRIrC
The SRF procedure derives the precise weight values from the ranking of criteria, intensities of preference, and ratio between the most and the least important criteria provided by \(DM_{k}\) applying some arbitrary rule (Figueira and Roy 2002). However, there exist multiple weight vectors compatible with such incomplete preference information. Recently, many researchers have raised the robustness concern in view of the SRF procedure to quantify the impact of uncertainty in the selection of an arbitrary weight vector on the stability of computed recommendation. In particular, Siskos and Tsotsolas (2015) proposed a set of robustness rules for the SRF procedure to obtain tangible and adequately supported results. Then, Govindan et al. (2017) suggested to exploit the whole set of compatible weight vectors to construct the necessary and possible results being confirmed by, respectively, all or at least one compatible vector. Further, Corrente et al. (2017) adapted the stochastic analysis of recommendation with the SRF procedure to the context of Electre III. We follow the latter research direction and integrate Stochastic Multicriteria Acceptability Analysis (Lahdelma and Salminen 2001; Tervonen et al. 2007) to handle possibly imprecise weight values compatible with the ranking of criteria and to derive robust recommendation with Electre TRIrC.
SMAA applies the Monte Carlo simulation to provide each DM with the acceptability indices which measure the variety of different preferences (in particular, weight vectors) that confirm the validity of particular elements of the recommendation. In our case, the space \(w^{k}(SRF)\) of weight vectors compatible with preferences of \(DM_{k}\) is defined by the following constraint set \(E^{k}(SRF)\) :
where the interpretation of different constraints is as follows:

\(\left[ {O1} \right] \) ensures that criteria ranked better by \(DM_k\) will be assigned greater weight;

\(\left[ {O2} \right] \) guarantees that criteria deemed indifferent by \(DM_k \) will be assigned equal weights;

\(\left[ {O3} \right] \) sets the ratio Z between weights of the most and the least significant criteria;

\(\left[ {O4} \right] \) respects the intensities of preference for different pairs of criteria that have been quantified with the number of inserted empty cards;

\(\left[ {O5} \right] \) normalizes the weights.
These constraints also ensure that all weights are positive. For each \(DM_k \), each weight vector \(w\in w^{k}\left( {SRF} \right) \) and each alternative \(a\in A\), we compute the resulting class assignment \(C_w^k \left( a \right) =\left[ {C_{w,L}^k \left( a \right) ,C_{w,R}^k \left( a \right) } \right] \) with Electre TRIrC.
We define the class range stochastic acceptability index \(CRSAI^{k}\left( {a,\left[ {L,R} \right] } \right) \) (Kadziński et al. 2013) on a range of classes \(\left[ {C_L^k \left( a \right) ,\ldots ,C_R^k \left( a \right) } \right] \) with \(L\le R\) as the proportion of compatible weights \(w\in w^{k}\left( {SRF} \right) \) that assign alternative a precisely to the range of classes \(\left[ {C_L^k \left( a \right) ,\ldots ,C_R^k \left( a \right) } \right] \). Formally, the index is computed as follows:
where \(m\left( {w,a,\left[ {h_L ,h_R } \right] } \right) \) is the class range membership function:
Further, we compute the proportion of \(w\in w^{k}\left( {SRF} \right) \) for which \(C_h \) is within \(\left[ {C_{w,L}^k \left( a \right) ,C_{w,R}^k \left( a \right) } \right] \), i.e., the proportion of weights that either precisely or imprecisely assign a to \(C_h \) (Kadziński and Tervonen 2013; Kadziński et al. 2014). Let us define such a cumulative class stochastic acceptability index \(CuCSAI^{k}\left( {a,h} \right) \) as:
We estimate CRSAIs with acceptable error bounds by sampling the space \(w^{k}\left( {SRF} \right) \) with the HitAndRun (HAR) algorithm (Tervonen et al. 2013). Overall, \(CRSAI^{k}( a,[ h_L ,h_R ] )\) and \(CuCSAI^{k}\left( {a,h} \right) \) can be interpreted as a support given by \(DM_k \) to the assignment of a to, respectively, \(\left[ {C_{h_L } ,C_{h_R } } \right] \) or \(C_h \).
To measure a cumulative support given to the assignment of a to \(C_h \) by all DMs in \(\partial ^{\mathrm{K}}\), we consider a cumulative group class stochastic acceptability index \(CuCSAI^{\partial ^{\mathrm{K}}}\left( {a,h} \right) \), defined as follows (Kadziński et al. 2016, 2018):
3.3 Selection of a Group Compromise Ranking of Criteria
In this section, we introduce a procedure for deriving a compromise complete ranking of criteria based on the rankings provided individually by each \(DM_k\) within the SRF procedure. The procedure builds on the algorithm that was introduced by Govindan et al. (2017) for constructing a utilitarian ranking of alternatives. Hence, we adopt an idea of minimizing a sum of of distances between the compromise ranking and all individual rankings.
When considering a complete ranking of criteria for \(DM_k \), for each pair \((g_j ,g_l )\) one of the three relations holds: \(g_j \) is preferred to \(g_l \quad (g_j \succ _k g_l )\), or \(g_j \) is indifferent with \(g_l \quad (g_j \sim _k g_l )\), or \(g_l \) is preferred to \(g_j \quad (g_j \prec _k g_l )\). Let \(R_{k^{\prime }}^{jl} \) and \(R_{k^{\prime \prime }}^{jl} \) denote the relations holding between \(g_j \) and \(g_l \) in the rankings provided by, respectively, \(DM_{k^{\prime }} \) and \(DM_{k^{\prime \prime }} \) (e.g., \(R_{k^{\prime }}^{jl} \) is \(\succ _{k^{\prime }}^{jl} \) or \(\sim _{k^{\prime }}^{jl} \) or \(\prec _{k^{\prime }}^{jl} )\). The distances \(\delta (R_{k^{\prime }}^{jl} ,R_{k^{\prime \prime }}^{jl} )\) between \(R_{k^{\prime }}^{jl}\) and \(R_{k^{\prime \prime }}^{jl} \) are provided in Table 1 (for a detailed justification of these values, see Roy and Słowiński 1993). A distance between two rankings of criteria provided by \(DM_{k^{\prime }} \) and \(DM_{k^{\prime \prime }} \) involving all ordered pairs of criteria \((g_j ,g_l )\) is defined as follows:
In what follows, we present a Binary Linear Program (BLP) for constructing a compromise ranking of criteria for group \(\partial ^{\mathrm{K}}\) involving K DMs. Following Govindan et al. (2017), for each pair of criteria \((g_j ,g_l )\), we introduce two binary variables \(p_\partial ^{jl} \) and \(i_\partial ^{jl} \) (see constraint \(\left[ {R1} \right] \) in \(E^{\partial }\left( {SFR} \right) )\) with the following interpretation:

\(p_\partial ^{jl} \) represents a weak preference of \(g_j \) over \(g_l \) in the compromise ranking (i.e., in case \(p_\partial ^{jl} =1\), then \(g_j \succ _\partial g_l \) or \(g_j \sim _\partial g_l )\); note that \(p_\partial ^{jl} \) and \(p_\partial ^{lj} \) can be used to instantiate one of the three relations \(\succ _\partial ^{jl} \), \(\sim _\partial ^{jl} \), or \(\prec _\partial ^{jl} \) for \(g_j \) and \(g_l \); that is, if \(p_\partial ^{jl} \hbox {}=1\) and \(p_\partial ^{lj} =0\), then \(g_j \succ _\partial g_l \); if \(p_\partial ^{jl} =0\) and \(p_\partial ^{lj} =1\), then \(g_j \prec _\partial g_l \); if \(p_\partial ^{jl} =1\) and \(p_\partial ^{lj} =1\), then \(g_j \sim _\partial g_l \);

\(i_\partial ^{jl} \) represents an indifference \(\sim _\partial \) between \(g_j \) and \(g_l \) (i.e., in case \(p_\partial ^{jl} =1\) and \(p_\partial ^{lj} =1\), then \(i_\partial ^{jl} =1\) and \(g_j \sim _\partial g_l \); see [R3]).
Since we impose completeness and transitivity on a weak preference relation, we require that \(p_\partial ^{jl} \hbox {}=1\) or \(p_\partial ^{lj} =1\) (see \(\left[ {R2} \right] )\) and that \(p_\partial ^{jr} =1\) and \(p_\partial ^{rl} =1\) imply \(p_\partial ^{jl} =1\) (see \(\left[ {R4} \right] )\). When constructing a utilitarian complete ranking of criteria, we aim at minimizing a comprehensive distance between relations (\(\succ _\partial \), \(\prec _\partial \), or \(\sim _\partial )\) instantiated for all pairs of criteria in the compromise ranking and relations observed for these pairs in the individual DMs’ rankings (for \(DM_k \), the relation between \(g_j \) and \(g_l \) (\(j<l)\) is denoted by \(R_k^{jl} )\):
If \(g_j \succ _\partial g_l \) (\(p_\partial ^{jl} =1, \quad p_\partial ^{lj} =0\), and \(i_\partial ^{jl} =0)\), \(g_j \prec _\partial g_l \) (\(p_\partial ^{jl} =0, \quad p_\partial ^{lj} =1\), \(i_\partial ^{jl} =0)\), or \(g_j \sim _\partial g_l \) (\(p_\partial ^{jl} =1, \quad p_\partial ^{lj} =1\), \(i_\partial ^{jl} =1)\) has been instantiated in the compromise ranking, it contributes with, respectively, \(\mathop \sum \nolimits _{k=1}^K \delta \left( {R_k^{jl} ,\succ _\partial ^{jl} } \right) \), \(\mathop \sum \nolimits _{k=1}^K \delta \left( {R_k^{jl} ,\prec _\partial ^{jl} } \right) \) or \(\mathop \sum \nolimits _{k=1}^K \delta \left( {R_k^{jl} ,\sim _\partial ^{jl} } \right) \) to a value of the objective function (for a detailed explanation, see Govindan et al. 2017).
Once a group compromise ranking of criteria is constructed, we conduct robustness analysis with SMAA in the same way as described in the previous section for an individual DM. This leads us to deriving cumulative group compromise class stochastic acceptability indices \(CuCCSAI^{\partial ^{\mathrm{K}}}\left( {a,h} \right) \).
3.4 Decision Aiding with the Proposed Approach
Multiple criteria sorting decisions can be aided with the proposed group decision making framework through the process illustrated in Fig. 1. It starts with specifying the sets of alternatives, criteria, and ordered classes as well as the alternatives’ evaluations (performances) on the criteria.
Then, the preference information is elicited from the involved experts and/or stakeholders. Each stakeholder is required to provide a cutting level as well as a ranking of criteria that incorporates the intensities of preference and the ratio between the importance coefficients of the most and the least significant criteria, as required by the SRF procedure. Moreover, the experts are expected to define a characteristic profile for each class. In our study, the profiles were agreed by multiple experts, but, in general, the methodological framework admits that each stakeholder provides his/her individual set of profiles.
Further, the method derives three types of results. These indicate a support that is given to the assignment of considered alternatives to different classes via the application of Electre TRIrC for different sets of weights and cutting levels compatible with the preferences of the involved experts. In two cases, the preferences of the individual stakeholders are aggregated only at the output level. Depending on whether these individual preferences are processed using the SRF procedure or the Monte Carlo simulation, the method computes, respectively, group class acceptability indices or cumulative group class stochastic acceptability indices. In the third case, the preferences are aggregated at the input level by constructing a group compromise ranking of criteria. Then, the method applies SMAA to derive cumulative group compromise class stochastic acceptability indices.
Finally, these three types of outcomes should be analyzed and combined into the recommended assignments. This is straightforward in case the support given to the assignment of alternatives to decision classes by different results is similar. In case of ambiguous indications by different procedures, the inconsistency needs to be raised by a decision analyst.
Obviously, it is not required to use all three types of procedures and respective results for each study. This may be useful when offering different viewpoints on the robustness of sorting recommendation is desired. Otherwise, one can employ just a single procedure for processing the experts’ preferences depending on whether they should be aggregated at the input or output level and whether the robustness analysis should be incorporated into a particular study.
4 Results of Multiple Criteria Assessment of Insulating Materials with the Outranking Preference Model and Characteristic Class Profiles
The study aims at evaluating overall sustainability of coating materials used in buildings retrofitting. We consider 13 materials listed in Table 2 (they are denoted by \(A=\left\{ {a_1 ,a_2 ,\ldots ,a_{13} } \right\} )\). All materials having a thickness of 15cm were placed internally on the roof of a model building typical for central Italy, and evaluated from the socioeconomic and environmental viewpoints. The six relevant criteria which have been used to assess the materials are: hour of discomfort (\(g_1 \); DH),\(\hbox {CO}_{2}\) avoidance (\(g_2\)); Net Present Value (\(g_3\); NPV), human health (\(g_4\)); ecosystem quality (\(g_5\)), and consumed resources (\(g_6\)). In what follows, we explain their meaning.
Discomfort degree Hour (\(g_1 \); the less, the better) evaluates a thermal performance of a building on an annual basis (CEN 2007) in accordance with the EN 15251 standard. Thus defined, it serves as a measure of comfort. The performance on \(g_1 \) is quantified as an overall time during which the temperature falls outside the second comfort category that was considered in the study (Carlucci and Pagliano 2012), and then weighing it by how much the limit has been exceeded. For this purpose, we have used the following equation:
where \(CC_2 \) is the lower or upper limit of the assumed comfort category, \(OT_i \) is the operative temperature at hour ì, and the multiplier \(\frac{10}{60}\) refers to an employed time step of 10 minutes.
\(\hbox {CO}_{2}\) avoidance (\(g_2 \); the more, the better) measures the energy saved during the building life by using a particular insulating material when compared to the case of no insulation in the following way:
where ES is the estimated Energy Saved in GJ at time t with a time horizon of 25 years, 277.78 is a conversion factor to GJ in kWH, while 406.31 is the conversion factor for Italy from kWH to kg of \(\hbox {CO}_{2}\) per year (EIA, 2015). Therefore, the \(\hbox {CO}_{2}\) avoided refers only to the use phase, which is not considered in the LCA study.
Net present value (\(g_3\); the more, the better) is the difference between the present values of cash outflows and inflows. On one hand, the outflows involve Primary Energy Input (PEI) cost, installation cost I at time t = 0, and the dismissing cost \(EL_T \) after the lifespan T of the investment (25 years). On the other hand, the inflows refer to the Cost of Energy Saved \(ES_t \) in different time periods t. Overall, we have computed NPV as follows:
where i is the discount rate. For a detailed justification of this measure, see Menconi and Grohmann (2014). Thus defined, NPV can be seen as an outcome of Life Cycle Costing, which is an economic methodology for assessing the profitability of using different alternatives by taking into account the costs they incur at different stages of a life cycle (e.g., construction, operations, and maintenance).
For the assessment of environmental impacts, we have used the Ecoindicator 99 method (Goedkoop and Spriensma 2001) implemented in the SimaPro software (Product Ecology Consultants 1990). The method aggregates the results of Life Cycle Assessment into a set of parameters that can be interpreted as damage categories. In general, LCA is useful for identifying the environmental implications of a given alternative through the quantification of consumed resources (e.g., energy, raw materials, water) and related emissions (e.g., emissions into the air, water and soil, waste and coproducts) (Paolotti et al. 2017). We used the following three environmental Ecoindicators expressed on a dedicated point scale:

Human health (\(g_4 \); the less, the better) which is derived from the analysis of the following normalized impact categories: carcinogens, respiratory organics and inorganics, climate change, radiation, and ozone layer;

Ecosystem quality (\(g_5 \); the less, the better) which is made up by the following three normalized impact categories: ecotoxicity, acidification/eutrophication, and land use;

Resources (\(g_6 \); the less, the better) which aggregates two normalized impact categories: minerals and fossil fuels.
The LCA focused on the production phase, starting from the production of a raw material to the obtaining of its complete version. We omitted the use and disposal phases, hence implementing an LCA “from cradle to gate” (Paolotti et al. 2016). All the impacts were calculated considering a functional unit of 1 m\(^{3}\) of insulating material.
The performances of 13 insulating materials with respect to 6 criteria are provided in Table 2. For all materials but hemp fibres, Ecoinvent Database (Ecoinvent 2010) was used as a source of foreground and background data related to both production and assembly processes as well as to the transport, electricity and fuel consumption. Instead, for the hemp processes the underlying data was derived from Zampori et al. (2013).
The objective of the case study is to give an easily interpretable comprehensive assessment of the materials’ sustainability. This is achieved by assigning them to a set of three predefined and ordered classes: \(C_1\) (low sustainability), \(C_2\) (medium sustainability), and \(C_3\) (high sustainability).
The study involved elicitation of preferences from the two groups of stakeholders. On one hand, a characteristic profile \(b_h\) for each class \(C_h\), \(h=1,2,3\), has been collectively specified by the experts from the universitybased engineering team specialized in the materials and retrofitting of rural buildings. On the other hand, the preferences on the importance of individual criteria have been elicited individually from multiple stakeholders who were owners of rural buildings interested in a renovation of their houses for improving the energetic performance. Thus, they can be perceived as potential consumers of the insulating materials.
When it comes to the characteristic profiles, the experts decided to define them by indicating one of the performances observed in the set of materials. The consensus between the experts on the most typical performance levels for each class has been reached during an interactive focus group. These levels are summarized in Table 3.
4.1 Results of Multiple Criteria Assessment of the Insulating Materials Within a Group Decision Framework Incorporating Electre TRIrC and the SRF Procedure
The weights representing the importance of individual criteria have been elicited from the rural buildings’ owner. In what follows, we call them stakeholders. Overall, we approached 63 owners by explaining them the characteristics of different materials, the interpretation of all criteria and their relation to different phases of the materials’ life cycle. Among them, 38 stakeholders (let us denote them by \(\partial ^{\mathrm{K}}=\left\{ {DM_1 ,DM_2 ,\ldots ,DM_{38}}\right\} )\) claimed to understand the meaning and role of different criteria, and expressing their willingness to provide preferences on the criteria importance.
In Table 4, we present the incomplete preference information required by the SRF procedure, which was provided by three selected stakeholders. We also report the computed weights \(w_j^k \) and cutting level \(\lambda ^{k}\). All stakeholders agreed that \(\lambda ^{k}\) should be equal to the sum of weights of the three most important criteria. The complete data for all group members is provided in the supplementary material available as an eAppendix (the same remark applies to the results discussed in the following sections).
The results of a comprehensive comparison between 13 materials and 3 characteristic profiles are quantified with the comprehensive concordance indices. In Table 5, we present such indices for four exemplary materials for \(DM_1 \). Table 5 exhibits also the justification of delivered assignment for the exemplary materials. For instance, a precise assignment of \(a_{6}\) to \(C_1 \) can be explained with \(b_2 \) being preferred to \(a_{6}\) and there existing sufficiently strong support in favor of \(b_{1}\) outranking \(a_6 \) (\(\sigma ^{1}\left( {a_6 ,b_2 } \right) =0.000<\sigma ^{1}\left( {b_1 ,a_6 } \right) =0.524)\).
In Table 6, we report the assignments obtained for all materials for different DMs. In particular, for \(DM_1\) there are 6 materials assigned to the best class (\(a_{5}, a_{7}, a_{8}, a_{11}, a_{12}, a_{13})\), 3 materials whose quality is evaluated as medium (\(a_{1}, a_{2}, a_{3})\), and 4 materials judged as bad (\(a_{4},a_{6}, a_{9}, a_{10})\). The assignments for \(DM_5\) are the same except for \(a_{4}\) being imprecisely assigned to [\(C_{1}\), \(C_{2}\)].
The spaces of consensus and disagreement with respect to the assignments obtained for all DMs are quantified with the group class acceptability indices \(E^{\partial }\left( {a,h} \right) \) (see Table 7). For example, for \(a_{1}\) none stakeholder confirmed its assignment to the worst class \(C_{1}\), 36 out of 38 stakeholders supported its assignment to the medium class \(C_{2}\), and 3 stakeholders suggested the assignment of \(a_{1}\) to the best class \(C_{3}\). These numbers have been translated to the following group acceptability indices: \(E^{\partial }\left( {a_1 ,1} \right) =\frac{0}{38}=0\), \(E^{\partial }\left( {a_1 ,2} \right) =\frac{36}{38}=0.95\), and \(E^{\partial }\left( {a_1 ,3} \right) =\frac{3}{38}=0\).08. On the contrary, for \(a_{2}\) all stakeholders agreed with respect to its assignment to \(C_{2}\) (\(E^{\partial }\left( {a_2 ,2} \right) =\frac{38}{38}=1.0)\), while the results obtained for 6 of them additionally indicated hesitation in terms of its assignment to \(C_{1 }(E^{\partial }\left( {a_2 ,1} \right) =\frac{6}{38}=0.16)\).
The analysis of \(E^{\partial }\left( {a,h} \right) \) leads to indicating the assignments which are necessary (in case \(E^{\partial }\left( {a,h} \right) =1)\), possible (if \(E^{\partial }\left( {a,h} \right) >0)\), and impossible (if \(E^{\partial }\left( {a,h} \right) =0)\) in terms of the support they are provided in the group of stakeholders. Additionally, these results clearly indicate the most and the least probable assignments. In particular, for each material we are able to indicate the class with the greatest support among all stakeholders. It is \(C_{1}\) for \(a_{6},a_{9}\) and \(a_{10}\), \(C_{2}\) for \(a_{1}, a_{2}, a_{3}\) and \(a_{4}\), or \(C_{3}\) for \(a_{5}, a_{7}, a_{8}\), \(a_{11}, a_{12}\), and \(a_{13}\). The support which is given to the assignment of the materials to other classes is significantly smaller. For clarity of presentation, in all tables exhibiting stochastic acceptability indices (Tables 7, 8, 9 and 11), the text in bold indicates the class with the greatest support for a given material.
4.2 Results of Stochastic Multicriteria Acceptability Analysis with Electre TRIrC
To validate the recommendation for insulating materials against the arbitrary choice of weights conducted with the SRF procedure, we applied SMAA. For each stakeholder, we considered a sample of 10000 uniformly distributed weight vectors compatible with the ranking of criteria (s)he provided within the SRF procedure.
The analysis of class range stochastic acceptability indices \(CRSAI^{k}\left( {a,\left[ {L,R} \right] } \right) \) and cumulative class stochastic acceptability indices \(CuCSAI^{k}\left( {a,h} \right) \) indicates the potential variability of the recommendation that can be obtained for each DM for different compatible weight vectors. For illustrative purpose, in Table 8 we provide these indices for \(DM_1 \). For some materials, all compatible weight vectors confirm the same assignment. These parts of the recommendation can be deemed as robust (e.g., \(CRSAI^{1}\left( {a_3 ,\left[ {2,2} \right] } \right) =1\) or \(CRSAI^{1}\left( {a_9 ,\left[ {1,1} \right] } \right) =1)\). The same conclusion can be derived from the analysis of the indices which are equal to zero, thus excluding the possibility of the respective assignment. Further, for some other materials the acceptability indices express hesitation with respect to the recommended class though often offering greater support to a particular assignment. For example, although both \(C_{2}\) and \(C_{3}\) are possible for \(a_1 \), the probability of the previous (\(C_{2})\) is significantly greater than of the latter (\(C_{3})\). Finally, the recommendation obtained for various compatible weight vectors can be different, but their intersection can be nonempty. Then, a robust recommendation is confirmed with \(CuCSAI^{1}\left( {a,h} \right) \)=1. It is the case for, e.g., \(a_{13}\) which is assigned imprecisely to [\(C_{2}\),\(C_{3}\)] or precisely to \(C_{3}\), thus always confirming \(C_{3}\) as the possible assignment.
When it comes to a group decision perspective, the cumulative group class stochastic acceptability indices \(CuCSAI^{\partial ^{\mathrm{K}}}\left( {a,h} \right) \) are presented in Table 9. Their values are very similar to the group class acceptability indices \(E^{\partial }\left( {a,h} \right) \) reported in the previous section. The main differences concern a slightly increased support given to the minority class for some alternatives (see, e.g., \(a_{1}\) to \(C_{3}\), or \(a_{2}\) to \(C_{1}\), \(a_{8}\), and \(a_{12}\) to \(C_{2})\).
Overall, the prevailing assignments for all materials are the same as in Sect. 4.1. In this regard, let us emphasize that \(CuCSAI^{\partial ^{\mathrm{K}}}\left( {a,h} \right) =1\) (see, e.g., \(a_{10}\) to \(C_{1}\), \(a_{3}\) to \(C_{2}\), or \(a_{5}\) to \(C_{3})\) confirms an agreement with respect to assignment of a to \(C_{h}\) for all weight vectors compatible with preferences of all stakeholders. Thus, such a recommendation needs to be treated with certainty. Conversely, \(CuCSAI^{\partial ^{\mathrm{K}}}\left( {a,h} \right) =0\) (e.g., \(a_{2}\) to \(C_{3}\), \(a_{3}\) to \(C_{1}\), or \(a_{9}\) to \(C_{3})\) indicates the no classification model of any stakeholder confirmed the respective assignment. This makes it excluded from the potential recommendation.
4.3 Results of Stochastic Multicriteria Acceptability Analysis for a Group Compromise Ranking of Criteria
The results presented in the previous sections were derived by aggregating the outcomes obtained individually for each stakeholder. In this section, we offer another perspective on the stability of results by searching for a compromise between different stakeholders already at the stage of provided preferences. In Table 10, we report the numbers of DMs indicating preference or indifference for all pairs of criteria in the ranking they provided for the purpose of applying the SRF procedure. For example, 14 out of 38 stakeholders preferred \(g_1\) to \(g_2\), 22 stakeholders opted for an inverse preference, and only 2 stakeholders judged this pair indifferent. Conversely, when comparing \(g_5\) to \(g_6\), 31 experts opted for an indifference, and only one claimed that \(g_5\) was more important than \(g_6\).
The information from the DMs’ individual rankings has been used as an input for the algorithm constructing a compromise utilitarian ranking of criteria, i.e., the one which is on average the closest to 38 individual rankings. In this way, the following group compromise order of criteria has been constructed:
Thus, the greatest importance has been attributed to ecosystem quality (\(g_5\)) and resources (\(g_6\)), while the least important criteria are NPV (\(g_3\)) and hour of discomfort (\(g_1\)). The relation instantiated for different pairs of criteria is consistent with the opinion expressed by the significant number of stakeholders. For example, 24 stakeholders ranked \(g_5\) and \(g_6\) as the two most important criteria, while 19 of them ranked this pair tied for the first place. Furthermore, 21 stakeholders judged \(g_3\) as the least important criterion.
Obviously, one needs to bear in mind that the compromise ranking of criteria minimizes the sum of distances between relations observed for all pairs of criteria in all individual rankings. In this perspective, it may not be considered representative by all individuals (see, e.g., \(DM_7, DM_9 \), \(DM_{12}, DM_{17}, DM_{19}, DM_{20},\) or \(DM_{36} )\) whose preferences are represented in the compromise ranking to a marginal degree (i.e., an overall distance between their ranking and the compromise one is substantial).
Such a compromise ranking of criteria has been used to simulate DMs’ joint preferences within SMAA. Consistently with the previous sections, the cutting level \(\lambda \) was assumed to be equal to the sum of weights of the three most significant criteria. The results of robustness analysis are materialized with the cumulative group compromise class stochastic acceptability indices \(CuCCSAI^{\partial ^{\mathrm{K}}}\left( {a,h} \right) \) (see Table 11).
For most materials, the variability of results is lesser than in case of deriving the recommendation by aggregating the individual viewpoints. Indeed, for 11 out of 13 materials there is some class which is recommended with certainty (then, \(CuCCSAI^{\partial ^{\mathrm{K}}}\left( {a,h} \right) \) = 1). Also, for all materials but \(a_{4}\) the class assignments with the greatest support have not changed with respect to those reported in the previous sections. The main differences concern a lesser support for the assignment of \(a_{1}\), \(a_{4}\) and \(a_{9}\) to \(C_{2}\) in favor of judging the quality of \(a_{1}\) as high (\(C_{3})\) and the quality of \(a_{4}\) or \(a_{9}\) as low (\(C_{1})\). Finally, although the assignments of \(a_{2}\) and \(a_{8}\) to, respectively, \(C_{2}\) and \(C_{3}\) are robust, the acceptability for their assignment to some worse classes (\(C_{1}\) and \(C_{2}\), respectively) has increased to 0.419.
4.4 Summary
In view of the results derived from an application of a threestage multiple criteria decision aiding method to our study (see Tables 7, 9, and 11), we recommended the following assignments for the insulating materials:

Low (\(C_1 )\): gypsum fibreboard (\(a_{6})\), mineralized wood (\(a_{9})\) and plywood (\(a_{10})\);

Low (\(C_1 )\) or medium (\(C_2 )\): fibreboard hard (\(a_{4})\);

Medium (\(C_2 )\): autoclave aerated complete (\(a_{1})\), corkslab (\(a_{2})\), and expanded perlite (\(a_{3})\);

High (\(C_3 )\): glass wool (\(a_{5})\), hemp fibres (\(a_{7})\), kenaf fibres (\(a_{8})\), polystyrene foam (\(a_{11})\), polyurethane (\(a_{12})\), and rock wool (\(a_{13})\).
The probability of other assignments was often nonnegligible though significantly lower than for the above indicated classes. Nevertheless, the results obtained from the stochastic analysis allowed to nullify the risk of a false declaration that some material was assigned to a class which was not confirmed by any compatible set of weights for any expert.
For each insulating material, the recommended decision can be justified by comparing its performances on different criteria with those of the characteristic class profiles. In Table 12, we indicate the subsets of criteria on which the materials outrank (i.e., are at least as good as) the characteristic profiles. In this regard, let us explicitly explain the most likely assignments suggested for some materials:

\(a_{10}\) is worse than \(b_{1}\) on all criteria, thus being assigned to the worst class \(C_{1}\); in the same spirit, \(a_{6}\) is worse than \(b_{1}\) on \(g_{2}\), \(g_{4}\), and \(g_{5 }\) (thus, on 3 out of 4 considered environmental criteria), and not better than \(b_{2}\) on any criterion, which makes \(C_{1}\) its most desired class;

\(a_{3}\) is better than \(b_{1}\) and worse than \(b_{3}\) on all criteria, which makes its performance vector typical for \(C_{2}\);

\(a_{12}\) and \(a_{13}\) are at least as good as \(b_{2}\) on all criteria and better than \(b_{3}\) on four criteria (\(g_1 \), \(g_2 \), \(g_3 \), \(g_5\) or \(g_1 \), \(g_2 \), \(g_3 \), \(g_6\), respectively (note that both scenarios include two accounted socioeconomic criteria, \(g_1 \) and \(g_3 ))\), which makes their assignment to \(C_{3}\) the most justified.
5 Conclusions
We considered a multiple criteria problem of sustainability assessment of insulating materials. We combined Life Cycle Costing, Life Cycle Assessment, and adaptive comfort evaluation to derive performances of these materials on six socioeconomic and environmental criteria. The comprehensive assessment of the materials involved their assignment to three preferenceordered sustainability classes. The classification was performed with a group decision counterpart of the Electre TRIrC method that compares alternatives with the characteristic class profiles defined by the experts.
To derive a recommendation that would reflect viewpoints of a wide spectrum of potential customers, we accounted for the preference information of a few tens of rural buildings’ owners being interested in the roof’s insulation. The initial recommendation was derived by computing the proportion of stakeholders who accepted an assignment of a particular material to a given class. These results were subsequently validated against the outcomes of a twofold robustness analysis realized with the Monte Carlo simulation. The latter exploited the space of all criteria weights compatible with either each stakeholder’s preference information provided in the SRF procedure or collective ranking of criteria that was derived with an original algorithm proposed in this paper.
The threestage analysis revealed that the most sustainable materials were glass wool, hemp fibres, kenaf fibres, polystyrene foam, polyurethane, and rock wool. This was mainly due to their favorable performances quantified with the Net Present Value and Ecoindicators. On the contrary, gypsum fibreboard, mineralized wood and plywood were assessed as the least sustainable materials. This can be justified in terms of their poor performances on thermal comfort, human health, and ecosystem quality. Overall, the proposed method provided greater clarity for decision making and guaranteed credibility in the eyes of the traditional rural houses’ owners. Moreover, all research results—concerning both materials’ performances on the individual criteria and comprehensive sorting recommendation—were well perceived by the experts on insulating materials in Italy.
The proposed framework can be applied to other decision contexts than that of a typical farmhouse in central Italy. This would require, however, accounting for a comfort model as well as warm and cold periods suitable to a particular geographical context, specification of a relevant lifespan for the investment, and adapting life cycle assessment to the reality of a particular study.
From the methodological viewpoint, we envisage the following future developments. Firstly, we plan to extend the SRF procedure to a group decision context so that it tolerates intensities of preference for different pairs of criteria and accepts information on different roles (weights) of the decision makers. Secondly, we aim at extending the proposed group decision framework to methods dealing with choice and ranking problems. This would require elaboration of the algorithms for deriving a compromise recommendation that would appropriately combine results of robustness analysis computed individually for each stakeholder.
References
Almeida Dias J, Figueira JR, Roy B (2010) Electre TriC: a multiple criteria sorting method based on characteristic reference actions. Eur J Oper Res 204(3):565–580
Cai FL, Liao X, Wang KL (2012) An interactive sorting approach based on the assignment examples of multiple decision makers with different priorities. Ann Oper Res 197(1):87–108
Cailloux O, Meyer P, Mousseau V (2012) Eliciting ELECTRE TRI category limits for a group of decision makers. Eur J Oper Res 223(1):133–140
Carlucci S, Pagliano L (2012) A review of indices for the longterm evaluation of the general thermal comfort conditions in buildings. Energy Build 53:194–205
CEN (2007) Indoor environmental input parameters for design and assessment of energy performance of buildings: addressing indoor air quality, thermal environment lighting, and acoustics. EN15251. Comite Europeen de Normalisation, Brussels
Chakhar S, Saad I (2012) Dominancebased rough set approach for groups in multicriteria classification. Decis Support Syst 54(1):372–380
Chakhar S, Ishizaka A, Labib A, Saad I (2016) Dominancebased rough set approach for group decisions. Eur J Oper Res 251(1):206–224
Chen Y, Kilgour D, Hipel K (2012) A decision rule aggregation approach to multiple criteriamultiple participant sorting. Group Decis Negot 21(5):727–745
Copiello S (2017) Building energy efficiency: a research branch made of paradoxes. Renew Sustain Energy Rev 69:1064–1076
Corrente S, Figueira JR, Greco S, Roy B, Słowiński R (2017) A robust ranking method extending ELECTRE III to hierarchy of interacting criteria, imprecise weights and stochastic analysis. Omega 73:1–17
Corrente S, Greco S, Słowiński R (2016) Multiple criteria hierarchy process for ELECTRE TRI. Eur J Oper Res 252(1):191–203
Čuláková M, Vilčeková S, Katunská J, Burdová EK (2013) Multicriteria analysis of material selection in order to reduce environmental impact. Chem Eng Trans 35:379–384
Damart S, Dias LC, Mousseau V (2007) Supporting groups in sorting decisions: methodology and use of a multicriteria aggregation/disaggregation DSS. Decis Support Syst 43(4):1464–1475
Daher SFD, Almeida AT (2010) Recent patents using group decision support systems: a short review. Recent Pat Comput Sci 3(2):81–90
de Morais Bezerra F, Melo P, Costa JP (2017) Reaching consensus with VICAELECTRE TRI: a case study. Group Decis Negot 26(6):1145–1171
Dias LC, Climaco JN (2000) Electre Tri for groups with imprecise information on parameter values. Group Decis Negot 9(5):355–377
Ecoinvent. (2010). Ecoinvent Data V2.2
Fabbri K, Zuppiroli M, Ambrogio K (2012) Heritage buildings and energy performance: mapping with GIS tools. Energy Build 48:137–145
Figueira JR, Greco S, Roy B, Słowiński R (2013) An overview of ELECTRE methods and their recent extensions. J MultiCriteria Decis Anal 20:61–85
Figueira JR, Roy B (2002) Determining the weights of criteria in the ELECTRE type methods with a revised Simos’ procedure. Eur J Oper Res 139(2):317–326
Ginevicius R, Podvezko V, Raslanas S (2008) Evaluating the alternative solutions of wall insulation by multicriteria methods. J Civ Eng Manag 14(4):217–226
Goedkoop, M, Spriensma, R (2001) The Ecoindicator 99–a damage oriented method for life cycle impact assessment. Methodology report third edition. (Product Ecology Consultants)
Govindan K, Kadziński M, Sivakumar R (2017) Application of a novel PROMETHEEbased method for construction of a group compromise ranking to prioritization of green suppliers in food supply chain. Omega 71:129–145
Greco S, Kadziński M, Mousseau V, Słowiński R (2012) Robust ordinal regression for multiple criteria group decision: \(UTA^{\rm GMS}\)GROUP and \(UTADIS^{\rm GMS}\)GROUP. Decis Support Syst 52(3):549–561
Greco S, Matarazzo B, Słowiński R (2001) Rough sets theory for multi criteria decision analysis. Eur J Oper Res 129(1):1–47
Greco S, Matarazzo B, Słowiński R (2006) Dominancebased rough set approach to decision involving multiple decision makers. In: Greco S, Hata Y, Hirano S, Inuiguchi M, Miyamoto S, Nguyen H, Słowiński R (eds) Proceedings of the 5th international conference rough sets and current trends in computing (RSCTC2006), Kobe, Japan, November 6–8, vol 4259. Lecture notes in artificial intelligence. SpringerVerlag, Berlin, pp 306–317
Greco S, Mousseau V, Słowiński R (2010) Multiple criteria sorting with a set of additive value functions. Eur J Oper Res 207(3):1455–1470
Jabeur K, Martel JM (2007) An ordinal sorting method for group decisionmaking. Eur J Oper Res 180(3):1272–1289
Kadziński M, Cinelli M, Ciomek K, Coles SR, Nadagouda MN, Varma RS, Kirwan K (2018) Stochastic ordinal regression for multiple criteria sorting problems. Eur J Oper Res 264(2):472–490
Kadziński M, Ciomek K, Słowiński R (2015a) Modeling assignmentbased pairwise comparisons within integrated framework for valuedriven multiple criteria sorting. Eur J Oper Res 241(3):830–841
Kadziński M, Greco S, Słowiński R (2013) Selection of a representative value function for robust ordinal regression in group decision making. Group Decis Negot 22(3):429–462
Kadziński M, Greco S, Słowiński R (2014) Robust ordinal regression for dominancebased rough set approach to multiple criteria sorting. Inf Sci 283:211–228
Kadziński M, Słowiński R, Greco S (2016) Robustness analysis for decision under uncertainty with rulebased preference model. Inf Sci 328:321–339
Kadziński M, Tervonen T (2013) Stochastic ordinal regression for multiple criteria sorting problems. Decis Support Syst 55(1):55–66
Kadziński M, Tervonen T, Figueira JF (2015b) Robust multicriteria sorting with the outranking preference model and characteristic profiles. Omega 55:126–140
Khoshnava SM, Rostami R, Valipour A, Ismail M, Rahmat AR (2016) Rank of the green building material criteria based on the three pillars of sustainability using the hybrid multi criteria decision making method. J Cleaner Prod. https://doi.org/10.1016/j.jclepro.2016.10.066
Krarti M (2015) Evaluation of large scale building energy efficiency retrofit program in Kuwait. Renew Sustain Energy Rev 50:1069–1080
Kumar A, Suman BM (2013) Experimental evaluation of insulation materials for walls and roofs and their impact on indoor thermal comfort under composite climate. Build Environ 59:635–643
Kumar V, Hewage K, Haider H, Sadiq R (2017) Sustainability evaluation framework for building cooling systems: a comparative study of snow storage and conventional chiller systems. Clean Technol Environ Policy 19(1):137–155
Lahdelma R, Salminen P (2001) SMAA2: stochastic multicriteria acceptability analysis for group decision making. Oper Res 49(3):444–454
Liu J, Liao X, Yang JB (2015) A group decisionmaking approach based on evidential reasoning for multiple criteria sorting problem with uncertainty. Eur J Oper Res 246(3):858–873
Lolli F, Ishizaka A, Gamberini R, Rimini B, Messori M (2015) FlowSortGDSS—A novel group multicriteria decision support system for sorting problems with application to FMEA. Expert Syst Appl 42(17–18):6342–6349
Ma Z, Cooper P, Daly D, Ledo L (2012) Existing building retrofits: methodology and stateoftheart. Energy Build 55:889–902
MartínezMolina A, TortAusina I, Cho S, Vivancos JL (2016) Energy efficiency and thermal comfort in historic buildings: a review. Renew Sustain Energy Rev 61:70–85
Mazzarella L (2015) Energy retrofit of historic and existing buildings. The legislative and regulatory point of view. Energy Build 95:23–31
Menconi ME, Grohmann D (2014) Model integrated of lifecycle costing and dynamic thermal simulation (MILD) to evaluate roof insulation materials for existing livestock buildings. Energy Build 81:48–58
Morais DC, de Almeida AT, Figueira JR (2014) A sorting model for group decision making: a case study of water losses in Brazil. Group Decis Negot 23(5):937–960
Motuziene V, Rogoza A, Lapinskiene V, Viletiene T (2016) Construction solutions for energy efficient singlefamily house based on its life cycle multicriteria analisys: a case study. J Clean Prod 112(1):532–541
Nemery, P (2008) Extensions of the FlowSort sorting method for group decisionmaking. In: 19th International conference on multiple criteria decision making (MCDM 2008), Auckland
Paolotti L, Boggia A, Castellini C, Rocchi L, Rosati A (2016) Combining livestock and tree crops to improve sustainability in agriculture: a case study using the life cycle assessment (LCA) approach. J Clean Prod 131:351–363
Paolotti L, Martino G, Marchini A, Boggia A (2017) Economic and environmental assessment of agroenergy wood biomass supply chains. Biomass Bioenerg 97:172–185
Papadopoulos AM, Giama E (2007) Environmental performance evaluation of thermal insulation materials and its impact on the building. Build Environ 42(5):2178–2187
Piombo O, Allacker K, Rivela B, Neila J (2016) Sustainability assessment of energy saving measures: a multicriteria approach for residential buildings retrofitting—a case study of the Spanish housing stock. Energy Build 116:384–394
Product Ecology Consultants. (1990) SimaPro LCA Software. Plotterweg
Rezaei J, Kadziński M, Vana C, Tavasszy L (2017) Embedding carbon impact assessment in multicriteria supplier segmentation using ELECTRE TRIrC. Ann Oper Res. https://doi.org/10.1007/s104790172454y
Roy B (1996) Multicriteria methodology for decision analysis. Kluwer, Dordrecht
Roy B (2010) Robustness in operation research and decision aiding: a multifaceted issue. Eur J Oper Res 200(3):629–639
Roy B, Słowiński R (1993) Criterion of distance between technical programming and socioeconomic priority. RAIRO Oper Res Recherche Operationnelle 27(1):45–60
Santos J, Flintsch G, Ferreira A (2017) Environmental and economic assessment of pavement construction and management practices for enhancing pavement sustainability. Resour Conserv Recycl 116:15–31
Shen F, Xu J, Xu Z (2016) An outranking sorting method for multicriteria group decision making using intuitionistic fuzzy sets. Inf Sci 334–335:338–353
Siskos E, Tsotsolas N (2015) Elicitation of criteria importance weights through the Simos method: a robustness concern. Eur J Oper Res 246(2):543–553
Sun B, Ma W (2015) Rough approximation of a preference relation by multidecision dominance for a multiagent conflict analysis problem. Inf Sci 315:39–53
Taylor PB, Mathews EH, Kleingeld M, Taljaard GW (2000) The effect of ceiling insulation on indoor comfort. Build Environ 35(4):339–346
Tervonen T, Figueira J (2008) A survey on stochastic multicriteria acceptability analysis methods. J MultiCriteria Decis Anal 15(1–2):1–14
Tervonen T, Lahdelma R, Almeida Dias J, Figueira J, Salminen P (2007) SMAATRI. In: Linkov I, Kiker GA, Wenning RJ (eds) Environmental security in harbors and coastal areas. NATO security through science series (series C: environmental security). Springer, Dordrecht
Tervonen T, van Valkenhoef G, Basturk N, Postmus D (2013) HitandRun enables efficient weight generation for simulationbased multiple criteria decision analysis. Eur J Oper Res 224(3):552–559
Verbeeck G, Hens H (2005) Energy savings in retrofitted dwellings: economically viable. Energy Build 37(7):747–754
Yu W (1992) ELECTRE TRI. Aspects méthodologiques et guide d’utilisation. Document du LAMSADE, vol 74. Université ParisDauphine, Paris
Yung EHK, Chan EHW (2012) Implementation challenges to the adaptive reuse of heritage buildings: towards the goals of sustainable, low carbon cities. Habitat Int 36(3):352–361
Zampori L, Dotelli G, Vernelli V (2013) Life cycle assessment of hemp cultivation and use of hempbased thermal insulator materials in buildings. Environ Sci Technol 47(13):7413–7420
Acknowledgements
The work of Miłosz Kadziński and Grzegorz Miebs was supported by the Polish Ministry of Science and Higher Education under the Iuventus Plus program in 2016–2019 Grant Number IP2015 029674  0296/IP2/2016/74.
Author information
Authors and Affiliations
Corresponding author
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Kadziński, M., Rocchi, L., Miebs, G. et al. Multiple Criteria Assessment of Insulating Materials with a Group Decision Framework Incorporating Outranking Preference Model and Characteristic Class Profiles. Group Decis Negot 27, 33–59 (2018). https://doi.org/10.1007/s1072601795493
Published:
Issue Date:
DOI: https://doi.org/10.1007/s1072601795493