Abstract
This paper examines problems in decision theory where the number of alternatives and states of nature are finite. Previous studies have defined the concept of “the value of perfect information for the problem” (VPIP). This metric allows us to obtain an upper bound on the amount a decision-maker would be willing to pay for perfect information under the specific conditions of a problem. This bound is particularly important when the decision is unrepeatable, providing a more accurately adjusted measure than the one traditionally obtained with “the expected value of perfect information” (EVPI). Supported by linear programming, this work proposes a sensitivity analysis of these bounds by seeking to identify the intervals in which the problem values can vary without essentially modifying the structure of the problem. Specifically, the study aims to determine how this variation might affect the EVPI and VPIP bounds, as well as the difference in the price a decision-maker would be willing to pay for perfect information if any of the problem values were altered. By identifying alternatives and scenarios taking into account the role they play in the problem, this research classifies the data involved in a finite decision problem to ensure the conclusions can be understood as generally as possible. Although the proposed sensitivity analysis is applied to the oil-drilling problem, a classic in decision theory, the conclusions of this work have potential applications in improving environmental decision-making processes.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
Decisions in the field of environmental policy are sometimes difficult to repeat. For instance, allocating resources for biodiversity management in a specific protected area (Bolam et al. 2019) or deciding whether to invest in satellites to collect data on air quality or freshwater supply (Laxminarayan and Macauley 2012) are critical choices. Once made, these decisions often have long-term impacts and may not be easily revisited, necessitating thorough consideration to ensure the best possible outcomes. Value of information techniques have proven valuable and are used in environmental decision-making, which often involves uncertainty about both current and future states.
“The concept of the expected value of perfect information” (EVPI) oriented to finite decision problems was introduced in the 1960s. A formula was also proposed to calculate this value when the decision criterion used was the maximization of expected utility.
In 2018, in a paper examining the expected value of perfect information in unrepeatable decision-making (Boncompte 2018), the author demonstrated the need to define a concept to identify the amount a decision-maker would be willing to pay to have perfect information in finite decision problems. This would provide a more accurate amount than the one previously provided by EVPI. In so doing, and taking into account the specific conditions of each problem, the paper introduced “the value of perfect information for the problem” (VPIP) and described a method for calculating it. However, the study lacked a sensitivity analysis indicating whether a variation in the problem data implied a change in the EVPI and VPIP bounds. So far, no sensitivity analysis of theoretical EVPI has been proposed in relation to finite decision problems. Therefore, the purpose of this paper is to complete the VPIP study by performing a sensitivity analysis of both EVPI and VPIP values. This sensitivity analysis is conducted with the help of linear programming, which, despite being a widely used technique, is novel in this context and allows for a better understanding of the analysis.
Section 2 presents a synthesis of the works that gave rise to the concept of EVPI while indicating the articles that more recently have dealt with sensitivity analysis in decision problems and have related it to EVPI. Section 3 restates the prior definitions as used in this paper. Section 4 explains the origin of the present reflection based on a problem for which EVPI gives a surprising value that is unacceptable for a sensible decision-maker. Section 5 presents “the value of perfect information for the problem” (VPIP) and a method for calculating it. Section 6 constitutes the core of the present paper and reports the development of a sensitivity analysis of the EVPI and VPIP bounds. Given that modifying the values beyond the intervals presented would originate a different problem requiring a new approach, we present various premises to ensure that the problem keeps its essence. Furthermore, we classify the data according to the role they play in the decision problem, and present tables to summarize the results. We also illustrate the sensitivity analysis by its application to the oil-drilling problem and, finally, discuss the outcomes. Section 7 concludes.
2 Related literature
Studies on the value of information, and specifically on the value of EVPI, date back to 1926, when Ramsey (1926) wrote his note “Weight or the value of knowledge.” Almost thirty years later, Savage (1954) developed his Bayesian theory in “The Foundations of Statistics,” and it was in the 1960s that the concept of EVPI appeared. In fact, Chernoff and Moses (1959) spoke of a “crystal ball,” although they did not develop the concept of EVPI, remaining with “ideal action probabilities” and defining the risk of a strategy as its expected opportunity cost.
Next, Raiffa and Schlaiffer (1961) defined EVPI as the price of perfect information and calculated it for some examples in the continuous field. Howard (1966), in his paper “Information Value Theory,” coined the term “clairvoyance” and approached the EVPI concept eliminating uncertain parameters. A few years later, Howard (1971) related the “clairvoyance” to the risk aversion of the decision-maker.
Furthermore, Szaniawski (1967), in “The Value of Perfect Information,” also defined EVPI for finite problems and considered it for the different uncertainty criteria (Maximin, Minimax, Laplace, etc.).
An overview of the literature on sensitivity analysis shows that Felli and Hazen (1998) published an analysis concerning the formulation of the expected value of perfect information. This paper, which examines the decision-making process in medical field, studies how the values assigned by the decision-maker to the uncertain input parameters affect the final decision. On the one hand, the authors suggest abandoning the measures previously used; on the other, they recommend using EVPI to perform the sensitivity analysis. Felli and Hazen distinguish between value sensitivity and decision sensitivity; the former refers to a modification in the magnitude of a model’s optimal value, given a variation in the input parameters, and the latter refers to the change in the preferred alternative identified by the model.
A year later, Hazen and Sounderpandian (1999) observed the behavior of other information measures in the presence of an uncertainty X (“the buying price” \(BPI_{X}\), “the certainty equivalent” \(CE_{X}\), “the utility increase” \(EUI_{X}\), “the certainty equivalent increase” \(CEI_{X}\), “the selling price” \(SPI_{X}\), and “the probability price” \(PPI_{X}\)), their possible ordinal equivalence, and their relationships.
More recently, Keisler (2004) identified the conditions for which EVPI increases when mean and standard deviation are both linear functions of an exogenous variable. These results provide a generic map of “the value of information space” for a significant class of decisions. Moreover, Keisler et al. (2014) provided an interesting paper that reviews the prevalence of value of information (VoI) applications reported in peer-reviewed literature spanning two decades (1990–2011). Keisler (2014) offered some later references in the same special issue of the journal, which focused on “the value of information” (VoI), where several other articles applied VoI in environmental or ecological contexts; see, for example, Gradowska and Cooke (2014) and Hoang Le et al. (2014).
Many published articles use EVPI or some of its variants such as EVPPI (“the expected value of partial perfect information”) or EVSI (“the expected value of sample information”) to make decisions in different disciplines, especially in the medical field; see, for example, Yokota and Thompson (2004), and Ekwunife and Lhachimi (2017). Zafari et al. (2016) use EVPI to undertake a sensitivity analysis of the input parameters to decide which medical treatment to implement.
Among the peer-reviewed articles that apply value of information study techniques, specifically the concept of EVPI, to decision-making in environmental, biodiversity, or ecological contexts, we can cite Bolam et al. (2019) and Canessa et al. (2015), who also work with EVSI.
Recently, Haag et al. (2022) employed utility theory and EVPPI to measure the expected gain in utility if the optimal alternative was decided based on perfect information about a few uncertain parameters. Since data collection is time-consuming and expensive, they used information value analysis as a form of sensitivity analysis of the choice of new information. In a similar sense, Hazen et al. (2023) introduced a graphical information-based tool for sensitivity analysis, the information density, that conveys both direction and information value, and thereby simultaneously accounts for the direction and importance of input uncertainty.
In the present paper, we study how the EVPI and VPIP bounds vary in finite decision problems. The focus on such problems and the use of known a priori probabilities are what set this article apart from most of those quoted above. Our objective is to assess the difference in the price a decision-maker is willing to pay for perfect information if some value of the problem is altered. Thus, the purpose of this paper is not to analyze the sensitivity of the optimal value nor the optimal decision, but rather to perform a sensitivity analysis of the EVPI and VPIP bounds themselves, as well as to show that when dealing with monetary values, it is essential to work with the absolute values of the problem.
3 Notation and definitions
First, let us introduce the definitions and notations that we will use throughout the article.
A decision problem is defined (Szaniawski 1967) as the ordered triple \(<A,S,u>\), where A is the set of available alternatives (or actions) to the decision-maker, S is the set of states of nature (or scenarios) that determine the consequences of any action, and u is a real function defined on the cartesian product \(A\text {x}S\) representing the valuation of the consequences. We shall restrict our attention to finite decision problems: A and S have a finite number of elements. Moreover, the information on S will be categorical, i.e., the actual state of nature will simply be a variable X defined on S. It is assumed that exactly one of the statements \(X=S_{i}\) (read: the actual state of nature is \(S_{i}\)) is true, but the decision-maker does not know which one. We do not consider the case in which the information is probabilistic. In that case, the actual state of nature would vary randomly, and X would be a random variable.
According to these premises, the columns represent the different alternatives or actions \(A_{j}\) (\(1 \le j \le n\)), while the rows represent the scenarios or states of nature \(S_i\) (\(1 \le i \le m\)). The outcome of each alternative will depend on the scenario that occurs. The payoff with \(A_j\) in \(S_i\) will be denoted as \(x_{ij}\), and the probabilities \(p_i\) (\(1 \le i \le m\)) of occurrence of the different scenarios are known.
It is understood that the results of the alternatives represent the decision-maker’s profit and, therefore, the alternative with the highest expected value is the preferred alternative or the optimal action (\(A_{\tilde{j}}\)). If the preferred alternative offered the best outcome in all scenarios, there would be no decision problem (the solution would be trivial). It is when the optimal action may lead to an undesirable outcome that the decision problem makes sense. This scenario is known as “the worst scenario” since it is the one feared by the decision-maker.
Finally, we represent the best result achieved in each scenario \(S_i\) as \(\tilde{x}_i\), and the alternative in which this best result is obtained as \(A_{S_i}\).
Table 1 lists the notations that will be used in the present discussion.
4 The need to propose a tighter bound than EVPI
Boncompte (2018) examined the expected value of perfect information in unrepeatable decision-making and highlighted the requirement to define a concept to identify the amount a decision-maker would be willing to pay to have perfect information in finite decision problems.
The problem that gave rise to this discussion was a classic one in decision theory: the oil-drilling problem. This problem appeared in Raiffa and Schlaiffer (1961), but we will use the updated version in Hillier and Lieberman (2015), pp. 683–695:
The GOFERBROKE COMPANY owns a tract of land that may contain oil. A consulting geologist has reported to management that he believes there is one-in-four chance of striking oil. Because of this prospect, another oil company has offered to purchase the land for \(\$90,000\). However, Goferbroke is considering holding the land in order to drill for oil itself. The cost of drilling is \(\$100,000\). If oil is found, the resulting expected revenue will be \(\$800,000\), so the company’s expected profit (after deducting the cost of drilling) will be \(\$700,000\). A loss of \(\$100,000\) (the drilling cost) will be incurred if the land is dry (no oil).
Table 2 provides a summary of the problem.
To solve the situation, the manager calculates the expected values of the two alternatives: drilling and selling.
-
The expected drilling value = \(700,000*0.25-100,000*0.75=100,000\)
-
The expected selling value = 90, 000
Consequently, the manager will drill because drilling is the alternative with a higher expected value; then, the best expected value provided by alternatives (BEVA) is 100,000. So,
-
The preferred alternative: Drilling.
-
The worst scenario: Dry.
However, the manager believes that the geological study is not sufficient and requests a seismological one. The question is, if this study were completely reliable, how much would the manager be willing to pay for it?
The manager will be willing to pay EVPI, defined (Raiffa and Schlaiffer 1961) as the price of perfect information. It is calculated as usual (Szaniawski 1967): as the difference between the expected value when we have perfect information (EPI) and the best expected value without perfect information (BEVA). Note that the best expected value without perfect information is just the expected value of the best alternative.
In our problem, if we knew we would strike oil, then we would drill; an outcome that will occur in \(25\%\) of cases. In other contingencies, we would sell (\(75\%\)). Then, if we had perfect information, our expected value EPI would be
If we had no perfect information, our expected value would be the expected value of drilling (our preferred alternative). Then, we obtain
Consequently, considering EVPI, the answer is as follows: the manager would be willing to pay up to \(\$142,500\) for perfect information. However, he would be unlikely to pay $142,500 for a study that provides perfect information, as this value exceeds the cost of drilling, which supplies perfect information par excellence. If the decision-maker resorts to decision theory, it is due to the cost of drilling; otherwise, if drilling had no cost, the company would drill and no decision problem would arise.
It is true that this high value has its origin in the opportunity cost of the drilling alternative. As usual, we refer to the opportunity cost (\(Co_{ij}\)) of the alternative \(A_j\) in the scenario \(S_i\) as the difference between the best payoff in the scenario \(S_i\) and the payoff that takes place with alternative \(A_j\) in the scenario \(S_i\):
Thus, we obtain that EVPI can also be interpreted as “the expected value of the opportunity cost of the preferred alternative,” that is, the expected value of the amount that we lose with the preferred alternative compared to the best option in each scenario (Szaniawski 1967):
Table 3 presents the opportunity costs array associated with the problem.
It is verified that the opportunity cost of the drilling alternative is the same as the value of EVPI of the problem.
The value of EVPI is explained by the fact that, if the decision-maker drills and the land is dry, he loses not only the drilling expenses but also what could have been obtained from an hypothetical sale. However, even with this justification, does it make sense to pay \(\$142,500\) for the report? Boncompte (2018) highlighted that the simple calculation of EVPI could sometimes lead to unacceptable results for a decision-maker when it involves unrepeatable decisions. In that paper, she questioned the role of probability theory when applied to unrepeatable decision-making problems, since probability theory is based precisely on the study of the results obtained by repeating the same experiment a significant number of times. For this reason, she emphasized that the decision-maker has to use probability theory to initially discard the alternatives that probabilistically give the worst results, but, from then on, the decision-maker enters a second phase in which he must take into consideration the absolute values of the problem to accept an alternative and make a consistent decision.
5 The value of perfect information for the problem VPIP
In Boncompte (2018), a new bound called “the value of perfect information for the problem” (VPIP) is proposed. VPIP is defined as an upper bound of the set of all possible amounts that a decision-maker would be willing to pay in order to obtain perfect information considering the specific conditions of a problem. To ensure that the cost of the study is covered in all cases, VPIP takes into account not only EVPI but also the loss to be avoided (in the case of the oil-drilling problem, it will be, nominally at least, the drilling cost) and the most favorable payoff in the worst scenario (in the example problem, the selling price). So, to calculate VPIP, three parameters should be considered: EVPI, “the loss to be avoided” (L), and “the most favorable payoff in the worst scenario” (FPW):
The first value to consider has to be EVPI, that has already been discussed in Section (4).
The second value in the equation is “the loss to be avoided” (L). Indeed, the decision-maker is willing to pay for perfect information because the alternative that is probabilistically the best option could give an undesirable result in a certain scenario. It is precisely this outcome that leads the decision-maker to pay to know in what scenario he is really in. Logically, in no circumstances will the decision-maker pay an amount higher than the loss he wants to avoid. Boncompte (2018) provided a formula to determine the value of L relying not only on the worst payment associated with the preferred alternative but also on the payment corresponding to the decision-maker in the status quo (Pc). Note that, although the current payout could vary depending on the scenarios, the current payment in the worst-case scenario is the only one relevant for calculating the loss to be avoided.
In the oil-drilling problem, note that, according to Eq. 4, the problem of determining L is actually that of determining \(P_c\). If the decision-maker understands that at the current moment his payment is $0, then “the loss to be avoided” will be the drilling cost. Only if the decision-maker reckons that the sale of the land is a fact and considers that he has the $90,000 in his pocket, will “the loss to be avoided" be the $190,000 indicated by the opportunity cost, and, consequently, the decision-maker might be willing to pay $142,500 for perfect information.
The third value to consider is “the most favorable payoff in the worst scenario” (FPW). This value guarantees that, if the worst scenario were to occur, the amount the decision-maker would pay for perfect information would not exceed the best payoff he could obtain in that worst scenario. In other words, it is a way of ensuring that the cost of the study is covered in all scenarios.
In the oil-drilling problem, \(FPW=\$90,000\) because if the land was dry and the decision-maker had perfect information, the chosen alternative would be to sell, and the price obtained from the sale would have to cover the costs of the study.
Then,
It could be argued that, if the decision-maker’s utility function is correctly fitted with a sufficiently concave function to reflect his risk-averse attitude, there is no need to resort to the new VPIP bound; but even if we dispense with FPW as a more fine-tuned consideration, the absolute value of L should always be taken into account to verify that the value of EVPI obtained does not exceed L, with the chosen utility function. This is the same idea as in the previous section, which the authors wish to emphasize: when decision-making does not admit repetition, the absolute values of a problem cannot be relegated to second place.
Be aware that, of course, VPIP is still only an upper bound, since the decision-maker could identify other restrictions related to the problem that might further reduce the amount to pay for perfect information.
6 Sensitivity analysis
6.1 Approach
This section conducts a sensitivity analysis of the EVPI and VPIP bounds. By definition, this analysis involves “small” modifications that do not alter the core of the problem, as substantial changes would necessitate a re-evaluation from the start. Therefore, the following premises are suggested to maintain the problem’s identity.
-
1.
The preferred alternative should remain the same (\(A_{\tilde{j}}\)), even though its expected value could vary.
-
2.
The worst scenario should not vary (\(S_{\underline{i}}\)). This is the scenario that the decision-maker fears the most, and it is the origin of the decision problem.
-
3.
The alternative with the best result in the modified scenario should not change (\(A_S\)). In each scenario, the alternative that is originally the best should be preserved.
First, we examine how EVPI is affected by a variation in the problem data. Second, we analyze the effect of the modification on VPIP and the interval within which the data can vary while still fulfilling the established assumptions using linear programming.
Linear programming is a branch of optimization theory that studies problems in which all the functions involved are linear. It consists of a variety of methods and procedures aimed at identifying which points maximize or minimize the objective function value within a set of points that meet all the established constraints.
For this purpose, and given the Eq. 3, we formulate a maximization linear programming problem with two variables (x,y), where x variable represents the value of VPIP and y variable is the value modified.
In this way, a linear programming problem will initially arise with six inequality constraints (see Table 4). The first three are related to the x variable and are a consequence of how the VPIP is defined (see Eq. 3). The last three use the y variable and result from imposing the above-mentioned three premises. In some cases, an additional restriction must be imposed on the y variable to prevent a loss from becoming a gain or vice versa (this constraint is indicated with Neg or Pos as required).
By adopting this approach, a set of feasible solutions of two variables in \(\mathbb {R}^2\) is obtained. This outcome allows for the graphical representation of the maximum value of x for each value of y.
Sometimes, the maximum value of x is bounded by EVPI, while at other times it is constrained by L or FPW.
Bear in mind that the set of feasible solutions (x,y) corresponds to all possible variations of y in which the premises outlined above are respected. However, for each \(y_{0}\), the set of feasible solutions is represented as a horizontal ray where the y-coordinate is \(y_{0}\), and the objective is to maximize the x-coordinate.
This maximum value of x will be the VPIP amount, and therefore, also the minimum between the EVPI, L, and FPW values. The graphs illustrate how, for each value of y-coordinate \(y_{0}\), the x-coordinate can increase until it is constrained by the first intersecting line, whether it corresponds to EVPI, L, or FPW. At this point, the value of x-coordinate indicates VPIP.
6.2 Classification of alternatives and scenarios
Given a decision problem with a finite number of alternatives and states of nature, the values displayed in terms of alternatives correspond to
-
1.
The alternative with the best expected value; thus, the preferred alternative.
-
2.
Another alternative different from the preferred alternative.
Among the columns representing the different alternatives, there is one that represents the preferred alternative. According to the established premises in 6.1, when a data point in this column is changed, it must be considered that it is the preferred alternative and must remain so.
In the case of states of nature or scenarios, two options arise:
-
1.
The worst scenario.
-
2.
A scenario other than the worst scenario.
Among the rows representing the different scenarios, there is one showing the worst scenario. When the value being modified belongs to this row, it should be considered that the preferred alternative must still obtain its worst result in that scenario.
Another case arises when the modified value is the best in its scenario. In this situation, whether it corresponds to the preferred alternative or not, the alternative in which this best result is obtained must remain the same.
6.3 Sensitivity analysis of EVPI
Recall that EVPI is the difference between “the expected value with perfect information” (EPI) and “the expected value of the preferred alternative” (BEVA)(see Eq. 1). Therefore, note that EVPI does not vary when the modified y value meets the following:
-
1.
It belongs to the preferred alternative and is the best outcome of its scenario. This is because the y value will intervene equally in both EPI and BEVA, and consequently, will not affect the final result.
-
2.
It neither belongs to the preferred alternative nor is the best result of its scenario. This is because y value will not be relevant in the EVPI calculation.
In all other cases, the amended y value is only involved in a single summand of EVPI. So, if it corresponds to an alternative that is not the preferred one but is the best result for its scenario, then
because the variation occurs in EPI.
However, if it corresponds to the preferred alternative but is not the best result for its scenario, then
for the reason that the variation occurs in BEVA, which is subtracted.
Let us also recall that the variation has to respect the established premises in Sect. 6.1.
6.4 Sensitivity analysis of VPIP
Section 6.3 has shown the cases in which EVPI changes. However, it remains to be determined in which situations L and FPW can vary.
In accordance with Eq. 4, the data that might cause a variation in L are
-
The minimum payment associated with the preferred alternative, i. e., the payment associated with the preferred alternative in the worst scenario.
-
The data belonging to alternatives other than the preferred alternative, representing the current payment in the worst scenario (note that this may or may not be the best result for its scenario).
The data that might cause a variation in FPW are
-
The data belonging to alternatives other than the preferred alternative, which are also the best result for the worst scenario.
Note that the data that may cause L and FPW to vary are the worst scenario’s data.
Table 5 summarizes the situation of the data that may lead to a variation in EVPI, L, FPW, and VPIP. The modified data point is labeled as y. Note that this table constitutes the core of this work and contains its main results.
Respecting the established premises, the problem data can swing between the intervals shown in Table 6.
6.5 Examples
Below, by way of illustration, we apply the sensitivity analysis developed in the present article to the oil-drilling problem. Let us recall, according to Sect. 4 and Table 2:
-
Preferred alternative: Drilling.
-
The worst scenario: Dry.
-
\(VPIP= min \{EVPI, L, FPW\} = min \{142,500; 100,000; 90,000\} = 90,000\)
6.5.1 Variation in the value of the preferred alternative belonging to the worst scenario
Let us consider the drilling cost. In what range can this cost vary so that the problem does not change in essence? How would this affect VPIP? In this case, the proposed amendment corresponds to “the preferred alternative" in “the worst scenario." Table 7 shows the location of the y data point that will be modified.
In such circumstances, apart from respecting the premises of Section 6.1, the problem as stated does not allow replacing the \(-\$100,000\), which represents the drilling cost, with a positive amount. Consequently, as indicated there, a new constraint (Neg) must be added to maintain y as a negative value. However, if for some reason y were to take a positive value, consider also that the loss to be avoided would be 0 according to Eq. 4.
Thus, the linear programming problem emerging would be the one presented in Table 8 and represented graphically in Fig. 1.
The shaded area indicates the set of feasible solutions (x, y) formed by all points whose coordinates satisfy all the constraints. Therefore, for each value \(y_{0}\) that satisfies the premises of Section 6.1, the maximum value of x that is less than or equal to EVPI, L, and FPW is the x-coordinate of the point \((x,y_{0})\) that lies on the boundary of the feasible solution set and maximizes the x-coordinate values.
Figure 1 shows that as long as the drilling cost is less than \(\$90,000\) (the land selling price), VPIP will be given by the loss to be avoided, which will match the drilling cost:
Also, when the drilling cost is between \(\$90,000\) and \(\$113,300\), VPIP will indicate that the maximum amount that can be spent on perfect information cannot exceed \(\$90,000\) (FPW), which is the amount that could be obtained from the sale.
A drilling cost higher than \(\$113,300\) would not respect the premises of Sect. 6.1, since drilling would no longer be the preferred alternative. Therefore, considering VPIP as a function of the drilling cost (y), which is the value we modify, we can write
Figure 2 explains that the horizontal ray represents all the points in the feasible solution set where the drilling cost is \(\$100,000\). These are points of the form \((x, -100)\), where the y-coordinate is fixed at the cost of interest for us. The objective of the linear problem is to maximize the x-coordinate within the feasible set. The arrows indicate the direction in which the x-coordinate grows. The point at which it reaches the maximum value is \((90, -100)\). At this point, the feasible set is bounded by the constraint FPW. Hence, the value of the x-coordinate gives us VPIP for the drilling cost of \(\$100,000\) (in the graphical representation, it is denoted by \(VPIP^{*}\)). It also represents how much could the x-coordinate grow if we ignore the FPW limit and it continues moving forward until reaching the EVPI limit at the point (142.5, -100). Again, the x-coordinate gives us the value of EVPI for the drilling cost of \(\$100,000\) (in the graphical representation, it is denoted by \(EVPI^{*}\)).
By varying the drilling costs within the feasible set, all the values of the VPIP bound will be found. The whole VPIP bound is represented by a line of large dots. Observe that the specific values taken by VPIP and EVPI when the cost of drilling is \(\$100,000\) are located on the x-axis.
Also, note that in the graphical representation the VPIP function appears rotated (symmetric with respect to the y-axis) since y is the independent variable.
6.5.2 Variation of the value that gives the best result in the worst scenario (and, therefore, belongs to a non-preferred alternative).
Now, it is proposed to vary the price of the possible sale. In this case, it represents the best outcome of the worst scenario and the change affects both scenarios.
Table 9 shows the location of the y data point that will be modified.
Similar to the previous case and as indicated in Sect. 6.1, a constraint (Pos) must be added to ensure that the selling price is positive. The corresponding linear programming problem is presented in Table 10 and represented graphically in Fig. 3.
It is shown how the selling price could increase up to $100,000, as above this value the preferred option would be to sell. Also, VPIP will be given by FPW, which will grow with the value of the sale:
Analogous to the previous subsection, the horizontal ray represents all the points in the feasible solution set where the selling price is \(\$90,000\). These are points of the form (x, 90) at which the y-coordinate is fixed at the selling price of interest for us. The objective of the linear problem is to maximize the x-coordinate within the feasible set. The arrows indicate the direction in which the x-coordinate grows. The point at which it reaches the maximum value is (90, 90). At that point the feasible set is bounded by the constraint FPW. Therefore, the value of the x-coordinate gives us VPIP for the selling price of \(\$90,000\) (in the graphical representation, it is denoted by \(VPIP^{*}\) ). It also represents how much the x-coordinate could grow if we ignore the FPW limit and it continues moving forward until reaching the EVPI limit at the point (142.5, 90). Again, the x-coordinate gives us the value of EVPI for the selling price of \(\$90,000\) (in the graphical representation, it is denoted by \(EVPI^{*}\)).
6.5.3 Variation in the value of the preferred alternative yielding the scenario’s best result
We only need to consider the interval in which the profit of \(\$700,000\) might oscillate and how this would affect VPIP. This is the case of “the preferred alternative” and “the scenario’s best result.” Table 11 shows the location of the y data point that will be modified.
According to Tables 5 and 6, this profit can rise indefinitely without changing EVPI or VPIP. However, it can only fall to \(\$660,000\) because at this point the expected value of the drilling alternative is equal to the expected value of the selling alternative, and below it, drilling would cease to be the preferred alternative. Additionally, \(\$660,000\) remains the best result if oil is struck (Fig. 4).
The linear programming problem that arises is described in Table 12 and represented graphically in Fig. 5.
In this case, note that for any value of y higher than \(\$660,000\), VPIP is given by the vertical \(FPW =\$90,000\). The profit obtained by striking oil may vary in the interval [660,000; +\(\infty\)]. Then, the premises will be met, and the value of VPIP will be maintained at \(\$90,000\).
So,
6.5.4 Sensitivity analysis in linear programming
Since linear programming is a widespread technique with many applications, there are plenty of refined tools that develop it. One of them is the Solver add-in in Excel, which solves linear programming problems and provides sensitivity analysis tables. Table 13 is obtained by Solver for the linear programming problem in Table 8 with the difference that the drilling cost has been set at \(\$100,000\) and the last three constraints have been eliminated. We use \(\$1,000\) as monetary unit.
In this table, it can be noticed that there is only one saturated constraint (the one corresponding to FPW) and that its shadow price is 1. This means that if the selling price increases by 1 unit, VPIP also increases by 1 unit. These results are in agreement with what we have already seen in Sect. 6.5.1, since we argued that in the interval \([-113,300;-90]\), VPIP meets FPW. In the “allowable increase” column, the table also indicates that the increase margin for the independent term of the third constraint (FPW) is 10 units. Indeed, it is clear from Fig. 2 that keeping the horizontal \(y_{0}=-100\), the distance between FPW and L is 10 units. If the increase was more than 10 units, the constraint that would become saturated would be L.
Therefore, the manager of Goferbroke, taking into account Sect. 6.5.1 and Table 13, will know that as long as the drilling cost exceeds the offered price to purchase the land, the optimal value of the linear programming problem (VPIP) will coincide with the selling price (FPW), which is the only saturated constraint. That is, he will understand that the purchase price of the land indicates the maximum amount he would be willing to pay for perfect information. However, he will note that if the drilling cost is lower than the selling price, VPIP will coincide with the drilling cost, and thus, the manager will never pay an amount higher than the drilling cost for perfect information.
The “allowable increases” indicate to the manager the margin between one situation and another. In this case, since the drilling cost (L) has been set at \(\$100,000\) and the selling price (FPW) at \(\$90,000\), it is only allowed to increase the selling price by the difference (\(\$10,000\)), which is the value indicated in the “allowable increase.” In other words, if the selling price increases by more than \(\$10,000\), the optimal VPIP would no longer be given by the selling price (FPW) but by the drilling cost (L). The shadow price allows us to calculate how much VPIP will vary if the selling price changes within this interval:
\(\Delta VPIP\)= Shadow price * \(\Delta\) Selling price
In this case, the shadow price equal to 1 indicates that if the selling price increases by x units, VPIP will also increase by x units.
The sensitivity analysis we offer applied to the oil-drilling problem could be reproduced with respect to politically challenging environmental problems, such as those related to the so-called “creative destruction” (Kivimaa and Kern 2016) within the scope of the phase-out to achieve decarbonisation (Trencher et al. 2022). If we manage to reduce these problems, which involve decisions that are difficult to repeat, to their basic structure, we facilitate their understanding and decision-making.
6.5.5 Distance between EVPI and VPIP bounds in the oil-drilling problem
Finally, the following table shows the values EPI, BEVA, EVPI, and VPIP for different drilling costs (keeping the original values of profit and selling price fixed). Two columns are added to indicate the difference between EVPI and VPIP, as well as the ratio between EVPI and the drilling cost (Table 14).
It should be noted that from a drilling cost of \(\$90,000\), the lower the cost, the greater the difference between EVPI and VPIP. This is clearly seen in Figs. 1 and 2. If the price of drilling were \(\$10,000\), would the decision-maker be willing to pay for perfect information 7.5 times the drilling cost? And if drilling were free, would the decision-maker be willing to pay just anything for perfect information? Certainly not up to three-quarters of the land’s offer price.
EVPI is only an indicator of the value of information, but cannot be considered the maximum value that a decision-maker would be willing to pay for perfect information. The primary objective of our study was to highlight the importance of absolute values when making difficult to repeat decisions.
7 Conclusions
The concept of VPIP defined in Boncompte (2018) has been expanded with a sensitivity analysis of the EVPI and VPIP bounds in the field of finite decision problems using known a priori probabilities.
This paper has consolidated the terms defined in Boncompte (2018) to identify decision alternatives and scenarios which allow us to classify the data of a finite decision problem according to the roles played in it. At the same time, the sensitivity analysis has been presented as generally as possible through this classification.
First of all, some premises have been established to prevent the problem from losing its essence when proposing modifications that exceed the limits associated with a sensitivity analysis. Within these conditions, we have studied how data variations can influence EVPI. It is also shown that EVPI does not change when a data point that belongs to the preferred alternative and is the best result of its scenario is modified within the allowed range. Nor does EVPI change when the variation affects a data point belonging to a non-preferred alternative that is also not the scenario’s best result. In all other cases, the variation in the absolute value of EVPI is directly proportional to the probability of the scenario to which the modified data point corresponds.
Next, to observe how varying a data point in the problem changes VPIP, we have addressed a linear programming problem with just two variables (x, y). The x variable represents the VPIP value and the y variable is the data point to be modified. Moreover, it has been explained that a proper reading of the graphical resolution of this problem will indicate the behavior of VPIP in each case. It is worth noting the novelty of using linear programming to study the behavior of these bounds.
Furthermore, the presentation of the results has been completed with two tables, whose entries depend on the role played in the problem by the data point to be modified. In the first table, it is displayed how the variation of this data point affects both EVPI and VPIP. In the second one, the boundaries of the interval within which the data point can oscillate are fixed while respecting the established premises.
Finally, all of the foregoing has been illustrated by applying the sensitivity analysis to the oil-drilling problem. The comparison between the values obtained for EVPI and VPIP in this example is particularly interesting. This comparison underscores the need to use a more adjusted value than EVPI when attempting to determine how much the decision-maker would be willing to pay for perfect information. In the specific case of the oil-drilling problem, it is noted that if the cost of drilling were only \(\$10,000\), EVPI would be \(\$75,000\). Therefore, EVPI would give a value 7.5 times higher than the loss that the decision-maker wants to avoid by resorting to decision theory. Thus, the aforementioned reiterates the requirement to consider the absolute values of the problem when decisions are difficult to repeat. This is especially important in the environmental context, where many factors come into play and data are often provided in the form of indices and percentages. We believe that reducing the problem to its basic structure, properly presenting alternatives and scenarios, taking absolute values into account, and considering the reflections on the concept of VPIP as discussed in this article can enhance the acquisition of appropriate information and, ultimately, facilitate decision-making.
References
Bolam F, Grainger M, Mengersen K, Stewart G, Runge M, McGowan P (2019) Using the value of information to improve conservation decision making. Biol Rev 94:629–647
Boncompte M (2018) The expected value of perfect information in unrepeatable decision-making. Decis Support Syst 110:11–19. https://doi.org/10.1016/j.dss.2018.03.003
Canessa S, Gurutzeta Guillera-Arroita JJ, Lahoz-Monfort DM, Southwell DP, Armstrong IC, Robert CL, Sarah J (2015) When do we need more data? A primer on calculating the value of information for applied ecologists. Methods Ecol Evol 6:1219–1228. https://doi.org/10.1111/2041-210X.12423
Chernoff H, Moses L (1959) Elementary decision theory. Wiley, New York
Ekwunife OI, Lhachimi SK (2017) Cost-effectiveness of Human Papilloma Virus (HPV) vaccination in Nigeria: a decision analysis using pragmatic parameter estimates for cost and programme coverage. BMC Health Serv Res 17:815. https://doi.org/10.1186/s12913-017-2758-2
Felli JC, Hazen GB (1998) Sensitivity analysis and the expected value of perfect information. Med Decis Making 18:95–109. https://doi.org/10.1177/0272989X9801800117
Gradowska PL, Cooke RM (2014) Estimating expected value of information using Bayesian belief networks: a case study in fish consumption advisory. Environ Syst Decis 34:88–97. https://doi.org/10.1007/s10669-013-9471-4
Haag F, Miñarro S, Chennu A (2022) Which predictive uncertainty to resolve? Value of information sensitivity analysis for environmental decision models. Environ Model Softw 158:105552. https://doi.org/10.1016/j.envsoft.2022.105552
Hazen G, Borgonovo E, Lu X (2023) Information density in decision analysis. Decis Anal 20:89–108. https://doi.org/10.1287/deca.2022.0465
Hazen G, Sounderpandian J (1999) Lottery acquisition versus information acquisition: prices and preference reversals. J Risk Uncertain 18:125–136. https://doi.org/10.1023/A:1007834413032
Hillier FS, Lieberman GJ (2015) Introduction to operations research, 10th edn. McGraw-Hill, New York
Howard R (1966) Information value theory. IEEE Trans Syst Sci Cybern 2:22–26
Howard R (1971) Proximal decision analysis. Manage Sci 17:507–541
Keisler J (2004) Technical note: omparative static analysis of information value in a canonical decision problem. Eng Econ 49:339–349. https://doi.org/10.1080/00137910490888093
Keisler J (2014) Value of information: facilitating targeted information acquisition in decision processes. Environ Syst Decis 34:1–2. https://doi.org/10.1007/s10669-014-9493-6
Keisler J, Collier Z, Chu E, Sinatra N, Linkov I (2014) Value of information analysis: the state of application. Environ Syst Decis 34:3–23. https://doi.org/10.1007/s10669-013-9439-4
Kivimaa P, Kern F (2016) Creative destruction or mere niche support? Innovation policy mixes for sustainability transitions. Res Policy 45:205–217. https://doi.org/10.1016/j.respol.2015.09.008
Laxminarayan R, Macauley MK (eds) (2012) The Value of Information. Methodological Frontiers and New Applications in Environment and Health. Springer, Dordrecht. https://doi.org/10.1007/978-94-007-4839-2
Le Hoang A, Tokai A, Nakakubo T (2014) Applying value of information methods to prioritize elements for water quality management with an example of linear alkylbenzene sulfonate in the Yodo River, Japan. Environ Syst Decis 34:110–123. https://doi.org/10.1007/s10669-014-9490-9
Raiffa H, Schlaiffer R (1961) Applied statistical decision theory. Harvard University Press, Boston
Ramsey F (1926) Weight or the value of knowledge. Personal Unpublished Note; Reprinted in The Br J Philos Sci (1990) 41:1–4
Savage L (1954) The Foundations of Statistics. Wiley, New York
Szaniawski K (1967) The value of perfect information. Synthese 17:408–424
Trencher G, Rinscheid A, Rosenbloom D, Truong N (2022) The rise of phase-out as a critical decarbonisation approach: a systematic review. Environ Res Lett 17:1–28. https://doi.org/10.1088/1748-9326/ac9fe3
Yokota F, Thompson K (2004) Value of information analysis in environmental health risk management decisions: past, present, and future. Risk Anal 24:635–650. https://doi.org/10.1111/j.0272-4332.2004.00464.x
Zafari Z, Sadatsafavi M, Marra CA, Chen W, FitzGerald JM (2016) Cost-effectiveness of bronchial thermoplasty, omalizumab, and standard therapy for moderate-to-severe allergic asthma. PLOS ONE. https://doi.org/10.1371/journal.pone.0146003
Acknowledgements
We would especially like to thank Prof. Marina Núñez for her thoughtful comments and support, and Ms. Maite López and Mr. Esteban López for their contributions and corrections to the English version
Funding
Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethics approval
Not applicable.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Boncompte Pons, M., Guerrero Manzano, M. The value of perfect information for the problem: a sensitivity analysis. Environ Syst Decis (2024). https://doi.org/10.1007/s10669-024-09986-7
Accepted:
Published:
DOI: https://doi.org/10.1007/s10669-024-09986-7