A simple combined projection method for conservative decision-making

Machine learning and artificial intelligence based techniques have brought great convenience to human life but along with a series of algorithmic “black box”, discrimination and ethical issues. One of the solutions is to integrate human and machine like the expert evaluation based research of multi-attribute decision-making where “human brain intelligence” is used for the support of “artificial intelligence”. In this article, we proposed a new and effective method to evaluate and rank alternatives in multi-attribute decision-making. Different from many existing approaches, this proposed method employs both the projection lengths and the projection angles of alternatives to make decisions. It supports psychological desirableness of decision makers and uses a Relu function to further enhance the output qualities. This proposed method is very simple to construct and applicable for much wider situations than the existing similar methods.


Introduction
Artificial intelligence, machine learning and other big data technologies have gradually infiltrated and affected our daily life in a subtle way. However, its negative effects have also begun to receive increasing attentions from the public and media. For example, clinicians are often skeptical of the automatic image processing methods used in clinical, mainly because of the "black box" problem of these algorithms; marginalized groups or groups that are under-represented in training data may receive less attentions in some algorithms; some researchers argue that the opacity of the deep learning approach limits their scientific findings [1][2][3]. All these suggest that the decision algorithms should not only be limited to the demand of "accuracy", but also need to consider robustness and interpretability etc.
A multi-attribute decision algorithm, which requires the input of individual or group evaluation data, can reflects the wisdom of the "human brain" with interpretable process and results. However, in many application scenarios such as the preference selection of different schemes in urban planning, risk portfolio schemes in investment strategies, and the evaluation of commodities in personalized recommendation, we also find out that a few individual preferences are often as important as the majority group preferences because of the existences of certain political, social, and economic realities. Therefore, it is necessary to construct simple and fast multi-attribute decision-making algorithms that achieve fully ranked alternatives with stable and flexible mental expressions.
Related works: Multi-attribute decision-making refers to the process of choosing the most satisfactory plan among the alternatives containing multi-type attributes. Because of the inherent and cognitive limitations of the decision subject, the diversity and complexity of decision attributes, it is usually difficult to assign the accurate values for the right judgments. Therefore, how to flexibly express decision information becomes one of the core problems of multi-attribute decision-making. In 1965, Zadeh [4] proposed fuzzy sets, and then intuitionistic fuzzy sets, interval fuzzy sets, hesitant fuzzy sets, and other concepts to be expanded to describe information uncertainty [5][6][7][8][9][10][11]. Many of these theoretical concepts have been successfully used for solving practical decision-making problems. To comprehensively describe the non-deterministic information, Smarandache [12] used neutrosophic set to depict the truth, the indeterminacy, and the falsehood of a statement simultaneously. Researchers then subsequently developed various concepts and aggregation operators of single-valued neutrosophic set (SVNS) [13,14], interval neutrosophic sets (INS) [15], simplified neutrosophic sets (SNS) [16], multi-valued neutrosophic sets (MVNS) [17]. The study of multi-attribute decision-making methods based on neutrosophic set has been gradually developed, such as ELECTRE [18], VIKOR [19], TOPSIS [20,21], MULTIMOORA [22], TODIM [23]. Multi-attribute decision-making methods on SVNS have been used in medical diagnosis, e-learning, image processing, data mining, supplier selection and other fields [24][25][26].
Among the multi-attribute decision-making methods, Projection Method (PM) [27] and Vertical Projection Method (VPM) [28] have gained special attentions from researchers because of the simplicity and intuitiveness. These two methods make decisions by comparing the projection lengths. and have been widely used for various neutrosophic sets [29][30][31][32] to solve many practical problems [33][34][35][36][37]. Although the VPM has been widely used in decision making in the uncertain information environments, it can lead incomparable alternatives. Extended from VPM, the Bi-directional Projection Model (BPM) [38][39][40] solves the incomparable problem with more complicated calculations by also considering projection distances of alternatives to the negative ideal solution to form bilateral distances. But these two methods fail to flexibly describe the psychological tendency as illustrated in the following.
Incompatibility Problem: Similar to TOPSIS and VIKOR methods, VPM compares alternatives by simply considering their projection length and distances to the positive ideal solution, and thus may lead to incomparable to different alternatives. For example, we have observe that (a) and (b) in Fig. 1 represent the comparable and incomparable cases of two solutions under the VPM. Since the VPM is only compared by the distance of the orthogonal projection points of the alternative solutions from the positive ideal solution, it is impossible to judge the superiority of the two solutions when the orthogonal projection points of the two solutions in Fig. 1 (b) are the same.
Tendency Support: The two above mentioned projection methods can be difficult to flexibly describe the psychological tendency in decision making. Generally, these two models use supplementary elements to express psychological tendencies. For example, they represent an aggressive (or a conservative) decision preference by adding a maximum (or minimum) value respectively. However, since the supplementary attribute values solely rely on the original elements in the set and are rather rigid, this supplementary approach is hard to support a differentiated description of the subjective psychology of the decision maker in case all the values of the original data are of equal length and no additional elements are needed. More recently, Ding, et al. [40] extend BPM in the context of hesitant triangular fuzzy sets (HTFS) for the group emergency decision making. Ni, et al. [41] use dual hesitant fuzzy sets (DHFS) in BPM to weigh the attributes for rational decision results. Although these two most recent research results support decision makers' psychological mindset, they work on the different informative data sets with relatively heavier computation costs. These recent research endeavour also raised an open question: If VPM can be simply extended to eliminate the incompatibility and support psychological tendency? This motivates us for the research of this article and construct a new VPM-based method without the above mentioned two deficiencies.
Contributions: In this article, we shall consider how to improve the adaptability of VPM in the conservative decision making. We proposed a new simple Combined Projection Method (CPM) that eliminates the incompatibility among alternatives and can flexibly support the decision makers' psychology tendencies. CPM extends VPM through intensively using projection angles with simple structure and computation costs. Its ranking results match the actual decision requirements well in practical situations. The rest of the article is organized as follows: Section 2 briefly reviews two major projection methods and identifies their deficiency aspects; Section 3 proposes the Combined Projection Method (CPM) and describes its major procedures; Section 4 is a running example that demonstrates the rationality and effectiveness of CPM; Section 5 concludes this article.

Vertical projection method (VPM)
In this section, we briefly review Vertical Projection Method (VPM) and the relevant concepts. To evaluate the impacts of different alternatives, VPM needs to compare the distances of their vertical projection points to the positive ideal point. As shown in Fig. 1, let A 1 and A 2 be two alternatives. For the positive ideal solution A + and the negative ideal solution A − , vectors A + A 1 , A + A 2 and A + A − are used for ordering of A 1 and A 2 under VPM by the following 2 steps: Step 1. Calculate and compare the lengths of the projections of vectors A + A 1 and A + A 2 on vector A + A − : where | A + M 1 | and | A + A 1 | are the modules of the vectors A + M 1 and A + A 1 , cos(A + A 1 , A + A − ) is the cosine of the angle between vector A + A 1 and vector A + A − .
Step 2. Decide the order of alternatives: The essence of the VPM is to compare the orthogonal projection distances of two alternatives A 1 and A 2 on the vector A + A − , and the closer the projection point ( M 1 or M 2 ) is to the positive ideal solution, the better the solution is. Since | A + M 2 |<| A + M 1 | , point M 2 is closer to the positive ideal solution A + than that of M 1 . We therefore define A 2 ≻ A 1 indicating that A 2 is preferred to A 1 .
However, as shown in Fig. 1(b) when the vertical projection points of A 1 and A 2 on the A + A − vector are identical ( | A + M 2 |=| A + M 1 | ), VPM is hard to define the preferential order for the two different alternatives.
VPM only considers the one-side distance between the alternative A i and the positive ideal solution A + , leading to the incomparability problem. Although the Bi-directional Projection Model (BPM) extends VPM by solving the incomparability problem, it can be hard to extend to support risk preferences on neutrosophic set as explained in the following.
VPM and BPM models describe the risk preferences of decision makers generally by adding additional elements to shorter evaluation schemes. For example, suppose two schemes A 1 and A 2 with attribute values (0.5, 0.7) and (0.3, 0.4, 0.5) respectively, i.e., two hesitant fuzzy sets of unequal lengths. To make the attribute values (0.5, 0.7) of A 1 have the same length of A 2 , a complementary element is added to indicate conservative, aggressive, or neutral risk appetite of decision makers by picking up the minimum, the maximum or the mean of 0.5 and 0.7. That is, (0.5, 0.7) is transformed into (0.5, 0.5, 0.7), (0.5, 0.7, 0.7) or (0.5, 0.6, 0.7) respectively. However, in case of SVNS (Definition 1 in the following) where each attribute is expressed as (T, I, F) and does not need the complementary step, the decision makers' tendency cannot be flexibly expressed.
Definition 1 [14] Let X be the domain of points. A single valued neutrosophic set K on X is where 0 ≤ T K (x) ≤ 1 is a truth membership function, 0 ≤ I K (x) ≤ 1 is an indeterminacy membership function and 0 ≤ F K (x) ≤ 1 is a falsity membership function. If X has only one element, K = (T K (x), I K (x), F K (x)) is called a single-valued neutrosophic number (SVNN) and its complement K C is defined as

Combined projection method (CPM)
In this section, we propose the Combined Projection Method (CPM) to solve the above mentioned shortcomings. We will first briefly describe general idea of CPM. We then illustrate the major functional steps of CPM in subsections, including the comparison with VPM in rankings.
As mentioned above, this proposed model CPM uses both the projection length and the projection angle for decision making where the projection angle describes the decision maker's risk preference. With the belief that when the projection lengths are equal, a smaller projection angle implies a more stable evaluation result of the attribute values with less faced uncertain risk, our proposed CPM considers both the distances of projection points M 1 and M 2 of the two alternatives to the negative ideal solution A − (rather than to the positive ideal solution) and their angle 1 and 2 . To rank the alternatives of the same projection length, CPM selects the alternative of smaller projection angle under the conservative preference. As shown in Fig. 2, alternatives A 1 and A 2 have the same orthogonal projection points. To avert risk, the proposed model defines A 2 ≻ A 1 since angles 2 < 1 interpreting that A 2 is conservatively favorable.

Transform neutrosophic sets
In general, risk preferences can be classified as risk-loving (aggressive), risk-averse (conservative), and risk-neutral (neutral) based on individual differences in risk attitudes. For example, the management of a company selects investment projects A 1 and A 2 based on expert evaluations. The experts evaluate project A 1 as (10, 90) thinking that project A 1 has 10% worst possible return and 90% best possible return. Project A 2 is evaluated as (40,60) with 40% and 60% for the worst and best returns respectively. Although the average return of both alternatives is 50% , the conservative preference decision maker would prefer the alternative with less interval volatility, i.e.; choosing A 2 and dropping A 1 , in view of investment robustness. However, it can be much difficult to select alternatives in SVNS data where alternatives are generally expressed in triple form (T, I, F) of implied internal fluctuation.
For example, the evaluation of two solut i o n s A 1 = (T 1 , I 1 , F 1 ) = (0.3, 0, 5, 0.4) a n d A 2 = (T 2 , I 2 , F 2 ) = (0.2, 0.7, 0.3) . If the value of T is considered as the optimal solution and F as the worst solution, the fluctuation between the optimal and worst solutions is 0.1 in both A 1 and A 2 . The positivity (T) of A 1 is greater than that of A 2 , while its negativity (F) is also greater than that of A 2 . Therefore, it is difficult to judge the superiority of these two alternatives directly.
In this article, we use the conversion function of SVNS (Definition 2) to convert them into intervals. The fluctuations of the evaluation results are then expressed by the difference between the upper and lower limits of the intervals. The converted interval values of A 1 and A 2 are set to be , For example, let alternative A 1 and A 2 be single-valued neutrosophic sets (SVNS), each SVNS contains two SVNN: we have When the mean values of the intervals are the same or very close, the intervals with shorter lengths indicate more stable in attribute values and less uncertainty in decision making. To derive a reasonable ranking order, Z(A 1 ) and Z(A 2 ) need to be normalized with Relu function to reject unqualified values.

Filtering the unqualified values
In the actual decision-making process, decision makers may have the knowledge of allowable possible values for certain attributes, which are called decision eligible values. For example, if the evaluation of A 1 scheme is (− 20,120) and A 2 is (40,60), although the mean values of the evaluations are equal, the conservative decision maker will choose A 2 . This is because that the project cannot have the risk of loss and 0 is the lower-bound of decision eligible value. The mental eligibility value expresses the decision maker's risk-averse attitude toward the non-eligible scheme. The qualified reference value of attributes can be selected either subjectively or objectively. Subjective selection is generally based on experts' experience or according to the industry standards, while objective selection can be based on the actual situation using mean, median, expected value, or other methods. In this article, the Relu function (Formula (4)) is used to filter the unqualified values of alternatives that beyond the acceptable (or tolerable) degree of the decision subject. Let Let the qualified reference value of the lower limit attribute be a. Then the lower limit Relu function of the interval is defined as For the interval transformed from a neutrosophic set, its lower bound indicates the percentage of positive evaluations in the overall evaluation and needs to be constrained for a qualified output. Conservative decision makers tend to expect a higher degree of positive evaluations (certainty) for the alternatives and need to determine the value a of Formula (4) in practical applications.

Computing projection lengthes and angles
For any two alternatives A 1 and A 2 , The vector formed by the alternative solution A i and the negative ideal solution A − is A − A i , the vector formed by the negative ideal solution A − and the positive ideal solution A + is A − A + , and the cosine of the angle between the two vectors is where

Comparing rankings under VPM and CPM
Suppose A 1 and A 2 are two alternatives and each of them is evaluated by two attributes K 1 and K 2 . The original data and the transformed intervals Z(A 1 ) and Z(A 2 ) are shown in Table 1.    (5)(6)(7)(8)(9). Since the projection points of A 1 and A 2 are the same, these two schemes A 1 and A 2 have the same ranking under VPM. Under CPM, the ranking is the same as that of VPM if = 0 . However, when conservative risk preference is emphasized (i.e., = 0.5 or = 1 ), the ranking changes indicating that A 1 scheme is superior to that of A 2 . Clearly, this conclusion is not achievable just by simply observing the raw data. Observing that the mean values of the converted intervals of A 1 and A 2 are not significantly different and Z(A 1 ) is obviously less volatile than that of Z(A 2 ) . Thus, the decision maker will prefer A 1 if they prefer less uncertainty. For conservative decision makers, the ranking of A 1 scheme is higher than A 2 , which is obviously more reasonable.
In CPM, we employ the Relu function to filter out attribute values that do not satisfy the requirements. In the above example, if more than 10% certainty is required for the decision makers, the filtered attribute intervals by the Relu function are shown in Table 3 (depicted in bold), where A 1 is preferred in all situations regardless of the value of ( Table 4). When the difference between A 1 and A 2 is significant under VPM, the ranking of CPM always remains consistent with VPM despite of .

Computing procedures of CPM in general
Let A = A 1 , A 2 , ⋯ , A m be a set of alternatives, K = K 1 , K 2 , ⋯ , K n be a set of attribute, which may include both cost attribute and benefit attribute. W = w 1 , w 2 , ⋯ , w n T be a weight set of attribute satisfying ∑ n i=1 w i = 1 and w i ≥ 0(i = 1, 2, ⋯ n) . The computation steps of our proposed method as follows: Step 1. Construct the normalized matrix on benefit attribute set.
1. Uniform each attribute evaluation rule by transforming each cost attribute into benefit attribute using its complement (Formula (2)). Normalized matrix R = (a ij ) m×n is obtained by replacing each cost attribute K i with K i C ; 2. Transform the normalized attribute SVNS matrix to interval decision matrix. Each element in the attribute set (K) of alternative set (A) is transformed into a normalized interval of decision matrix R = ( s ij , b ij ) m×n (Formula (3)).
Step 2. Set the qualified reference value of attribute to form a new decision matrix by considering psychological acceptance. According to Formula (4), a qualified reference value is set for a specific attribute (or all attribute). A new interval decision matrix R � = ( s ij � , b ij � ) m×n is constructed to consider the psychological acceptance of decision-makers.
Step 3. Determine positive ideal and negative ideal. According to Formulae (6) and (7), compute positive ideal A + and negative ideal A − .
According to the article [43], the information entropy of the original attribute value is calculated to form the objective weight.

For each evaluation of the original data of SVNN calculation information measure is
where a ij = (T a ij , I a ij , F a ij ) = (a   Step 5. Compute the comprehensive value C i of alternatives from Formula (8)∼(9) and sort them according to their values.

The weight of each attribute is obtained by Lagrange multiplication
Step 6. Adjust the attitudinal parameter to determine the evaluation results. Assign attitudinal parameter to a value of [0, 1] to strength or weaken the conservative decision preferences.
Let m be the number of alternatives, and n be the number of attributes of an alternative. Since the time complexity of computing an m × n matrix and ordering m elements are O(mn) and O(m log m) respectively, the time complexity of our proposed algorithm is O (max{m log m, mn}) . In practical applications, decision makers can determine the time costs from the sizes of alternatives and attributes.

Case study
In this section, we use two examples to illustrate the advantages of Combined Projection Method (CPM).

Rating city credit
To improve the social trust in China, the Chinese government has been vigorously promoting the social credit system recently. As to how to evaluate the degree of credit of each city, the Chinese government proposes to focus on four attributes: governmental credit ( K 1 ), commercial credit ( K 2 ), social credit ( K 3 ), and judicial credit ( K 4 ): 1. K 1 : Governmental credit measures if the local government keeps the promise or not; 2. K 2 : Commercial credit measures if a local enterprise has many bad reviews or perceptions; 3. K 3 : Social credit measures if the local community members are honest or not; 4. K 4 : Judicial credit measures if local justice is fair or not.
In the above, K 2 is a cost attribute and the rest are the benefit attributes.
We conducted a questionnaire survey for four cities (A,B,C,D) in Zhejiang province. The answers to each question have three choices: yes, no, and unsure. Therefore, each answer on each attribute is a neutrosophic set. For example, the evaluation result on the government credit of CityA is expressed as eval (A, K 1 ) = (T A1 , I A1 , F A1 ) = (0.82, 0.63, 0.20) , indicating that there is 82% positive/true responding, 63% unsure/ hesitate answer, and 20% negative responding. The evaluation results of the four cities are shown in Table 5. Based on this table, we will rank these four cities in six steps as mentioned in previous section in the following.  Step 1. Since K 2 is a cost attribute, it needs to be converted into benefit attribute (as depicted in bold in Table 6).
Step 2. With Formula (3), each neutrosophic set is then transformed into interval set as shown in Table 7.
Step 3. According to the experts' opinions, among the four attributes from K 1 to K 4 , the local government credit K 1 is considered as the most important attribute in ranking and should have a minimum requirement on the alternatives (cities). In this example, we use the mean value of the lowbound alternatives at K 1 (0.48875 = 0.4970+0.4551+0.5000+0.5029 4 ) as the qualified reference value. We would readjust each lowbound alternatives of K 1 to be 0.0000 (as depicted in bold in Table 8) if it is less than the qualified reference value (i.e., the mean value).
Step 4. After the positive and negative ideal solutions are determined by using Formula (6) and (7), the weights of the four attributes are calculated and we can get the weight matrix: (0.2584, 0.2127, 0.2250, 0.3039) T .
Step 6. Comparing C i , we rank four cities as D ≻ A ≻ C ≻ B under CPM as depicted in Table 9.
The ranking results of CPM and VPM are listed in Table 9. We can see that the rank order of VPM is Actually, the rationality of CPM for ordering CityA and CityD can also be explained as follows: For K 1 in Table 6, we have Since both T D1 > T A1 and (I D1 + F D1 ) > (I A1 + F A1 ) hold, it can perceive neither CityD≻CityA nor CityA≻CityD. Similarly, for K 2 in Table 6 We have T D2 > T A2 , I D2 < I A2 , and F D2 < F A2 implying that CityD has a higher good review, a lower unsure review, and a lower bad review than that of CityA. Therefore, CityD≻ CityA holds in this situation. F o r K 3 , w e c a n h a v e T D3 > T A3 a n d (I D3 + F D3 ) < (I A3 + F A3 ) . This implies that CityD has a higher good review than that of CityA and the uncertainty review and bad review for CityA exceed those for CityD. These facts implicate that CityD≻CityA for conservative decision makers.
For K 4 , we can have T D4 > T A4 , I D4 < I A4 , and F D4 = F A4 implying that CityD has a higher good review and a lower unsure review than that of CityA. Thus, CityD≻CityA for K 4 .
Observed from Table 7, the evaluated fluctuational intervals of K 1 and K 4 for CityD are both included by those for CityA. Again, the interval values of K 2 and K 3 for CityD are significantly higher than those for CityA. Thus, it is reasonable to conclude that CityD ≻ CityA when the projection lengths are very close.
For the rank of CityB and CityC, we can see that the ranking order of these two cities remains the same in both CPM and VPM. Because Relu function limits K 1 , this leads to a large difference in the combined value (C i ) of CityB from the other cities. Thus, CityB always ranks as the worst for = 0, = 0.5 and = 1. This fact implies that CPM and VPM would output the same ranking results if the projection lengthes are sufficiently different. When the projection lengthes are very close, CPM can select favorable ranking through using risk attitudinal parameter 0 ≤ ≤ 1 and subsequently find the most reasonable one for conservative decision makers. This indicates that CPM is stable, consistent with and extended of VPM.

Selecting enterprise alliance
To be successful in an innovative project, an enterprise needs to seek a strategic alliance to alleviate innovation risks and synthesize its technical capacity. Suppose that experts need to evaluate the three potential enterprises ( E 1 , E 2 and E 3 ) in terms of innovation resources ( K 1 ), market capacity ( K 2 ), enterprise strength ( K 3 ), financial expectation ( K 4 ) and innovation risk ( K 5 ). Here, innovation risk ( K 5 ) is a cost attribute and needs to be need to be minimized and required normalized. Table 10 is the original evaluation results from experts. Following the previously mentioned Step 1 and Step 2, we have the normalized and transformed results as depicted in Tables 11 and 12 respectively. In Step 3, since the innovation resources ( K 1 ) dominate parties in the alliance, the certainty of the evaluation is expected to exceed 30%. Therefore, K 1 attribute of E 2 is filtered with Relu function as shown in Table 13. Through Step 4∼Step 6, weights and comprehensive attribute values under different parameters are calculated and the final results are shown in Table 14.
In Table 14, E 2 ≺ E 3 ≺ E 1 holds for both VPM and CPM when = 0 when the conservative psychology of decision-makers is emphasized ( ≠ 0 ), the ordering of  Table 13, it can be seen that among the five attribute values of K 1 ∼ K 5 , the interval values of K 1 , K 3 and K 5 of E 3 are significantly better than those of E 1 . Therefore, it is more reasonable to rank E 3 better than E 1 in terms of risk avoidance psychology. In Summary, the rationality and robustness of CPM have been verified in two examples with different data sets. Table 15 and Fig. 3 show the various effects of different projection angles and values. Through analyzing the results on diverse data sets, the rationality, stability and interpretability of our proposed method has been confirmed. When the projection angles are between 0 and 90 degree, the comprehensive values decrease as value goes up. This is used to measure the degrees of conservativeness.

Conclusions
In this paper, we proposed the Combined Projection Method (CPM) for decision making.
This new method can further distinguish risk preferences which are hard discriminative by the currently existing projection methods. It determines the order of alternatives with measured psychological intension by integrally considering projection length, angle and attitudinal parameter. Computationally, it is much simpler than that of the Bidirectional Projection Method(BPM). The proposed method convert a neutrosophic set (T, I, F) into an interval that well represents and interpreter the internal fluctuations of the attributes. The use of Relu function to constrain the lower bound of the interval can greatly support the requirements of conservative decision makers for certainty.
Although CPM has the above advantages over the VPM and BPM in conservative decision making, there are still some improvements that can be made. The proposed model uses the projection angle as the decision makers' risk preferences. It is not very clear how to use the angle combined with other fuzzy expressions. This needs to be explored in our further research work.

Appendix
In this Appendix, we compared PM, BPM, VPM and CPM methods by using the example in Section 3.4 with additional alternative A 3 as shown in Table 16. Table 17 depicts the ranking results of A 1 , A 2 and A 3 under PM, BPM, VPM and CPM. It can see that CPM and VPM have the most similar ranking results where A 3 is always ranked 1st. As described in Section 3.4, A 1 ≻ A 2 in CPM but they are incomparable in VPM.
A 1 and A 3 are ranked differently in CPM and BPM. Observing these two alternatives on attribute K 1 , we can see that their positive evaluation values are very close but the non-negative (positive + hesitant) evaluation value of A 3 is much higher than that of A 1 and the negative value of A 3 is lower than that of A 1 . Similarly, for attribute K 2 of alternatives A 1 and A 3 , their negative evaluation values are very close. The positive value of A 3 is higher than that of A 1 and the non-negative (positive + hesitant) evaluation value of A 3 is much higher than that of A 1 . Therefore, the ranking A 3 ≻ A 1 of CPM is reasonable.
In this example, we still select 10% as the qualifying reference value and filter the attribute values bywith the Relu function. The filtered attribute intervals by the Relu function (depicted in bold) are shown in Table 18. Table 19 lists In conclusion, since the alternative projection used in PM differs from that in BPM, VPM and CPM, the obtained ranking results can be very different to those of BPM, VPM and CPM. Nevertheless, the ranks of BPM are determined through measuring the closeness of two projections, which can be difficult to interpret cognitively. Our proposed CPM algorithm is structurally simple and interpretable.
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http:// creat iveco mmons. org/ licen ses/ by/4. 0/.