Abstract
Maxi-min efficiency criteria are a kind of multi-objective criteria, since they enable us to take into consideration several tasks expressed by different component-wise criteria. However, they are difficult to manage because of their lack of differentiability. As a consequence, maxi-min efficiency designs are frequently built through heuristic and ad hoc algorithms, without the possibility of checking for their optimality. The main contribution of this study is to prove that the maxi-min efficiency optimality is equivalent to a Bayesian criterion, which is differentiable. In addition, we provide an analytic method to find the prior probability associated with a maxi-min efficient design, making feasible the application of the equivalence theorem. Two illustrative examples show how the proposed theory works.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
1 Introduction
In this study, we aim at solving a multi-objective optimization problem that consists in the maximization of a minimum design-efficiency. In optimal design literature, different approaches can be classified as maxi-min efficiency criteria. The standardized max-min criterion, introduced to tackle the problem of parameter uncertainty, is the most common. This last issue, however, is not considered in this work because it has been already extensively studied (see for instance, Chen et al. 2015; Dette and Biedermann 2003; Nyquist 2013; Fackle-Fornius et al. 2015; Dette et al. 2007, among others); furthermore, parameter uncertainty is not easily interpretable as a multi-task problem. Differently, examples of maxi-min efficiency criteria that can be interpreted as multi-objective problems are: the SMV-criterion (proposed by Dette (1997)), which aims to obtain an accurate estimation of each one of the model parameters, taking into account their different scale (see also López-Fidalgo and Tommasi 2004 and the references therein) and the extensions of T- and KL-criteria (proposed by Atkinson and Fedorov (1975) and Tommasi et al. (2016), respectively) to handle the problem of model uncertainty. Another interesting application might be the identification of an optimal design for model identification, precise parameter estimation and accurate predictions. This multiple objective could be achieved by maximizing the minimum efficiency of three criteria reflecting these three distinct goals.
The maxi-min approach arises naturally when we wish to protect against the worst case scenario; however, it is difficult to compute the corresponding optimal design (the maxi-min efficiency design) because this criterion is not differentiable. Consequently, a standard directional derivative argument cannot be applied to check whether a given design is optimal because unfortunately, the directional derivative involves an unknown measure; see for instance Wong (1992) and Atkinson and Fedorov (1975).
In addition, the construction of the maxi-min efficiency design is not straightforward at all. Frequently, it is found numerically by the application of some algorithm, but there is no way to prove that it is really the optimum.
The main contribution of this study is to prove the equivalence between the maxi-min efficiency approach and the Bayesian criterion for a specific prior, which is differentiable. Hence, the directional derivative of the Bayesian criterion can be used to check for the minimum efficiency optimality. Let us note that the Bayesian criterion is another kind of multi-objective optimality function, being a convex combination of different quantities. The connection between maxi-min efficiency and Bayesian optimum designs has been already explored by other authors, see for instance Schervish (1995), Müller and Pazman (1998) and Dette et al. (2007); other versions of the equivalence theorem can be found but they are specialized for specific problems; for instance, Dette and Biedermann (2003) or Berger et al. (2000) consider parameter uncertainty in a non-linear model and the D-criterion.
In this study, we prove a more general version of the equivalence theorem, because it covers any multi-objective problem that can be expressed as a minimum design-efficiency (for any component-wise criteria). Furthermore, following similar ideas as in Chen et al. (2017), we provide a method to determine the prior probability that matches the maxi-min efficiency criterion and the Bayesian optimality; this makes possible the application of the equivalence theorem.
The paper is organized as follows. In Sect. 2, we recall some background information and the used notation. In Sect. 3, we state the equivalence theorem and the rule to determine the prior probability that makes the minimum efficiency and the Bayesian criteria equivalent. Section 4 concerns a pair of illustrative examples. Section 5 provides some conclusions, and finally Appendix A includes the proofs of the theoretical results.
2 Background and notation
In this section, we introduce the main ideas of optimal experimental design and the notation used in what follows.
Let us assume that \(f(y,x,\theta )\) is a statistical model that describes the response Y at the experimental condition x, which may be chosen in a compact set \({{\mathcal {X}}}\) and \(\theta \in \Theta \subseteq \mathrm{I\!R}^p\) denotes a \(p\times 1\) parameter vector.
An approximate design is a probability measure on the design space \({\mathcal {X}}\) with a finite support, i.e.
where \(\xi (x_i)\approx n_i/n,\) and \(n_i\) is the number of observations to be taken at the experimental condition \(x_i\), \(i=1, \dots , r\).
The aim is to find a design \(\xi ^*_\theta \) maximizing (minimizing) a concave (convex) optimality criterion function \(\Phi (\xi ;\theta )\) defined on the space of all designs \(\Xi \) to the real line. This means that an optimal design \(\xi ^*_\theta \) may be found according to several criteria reflecting different inferential goals: parameter estimation, prediction or model discrimination. Many optimality criteria for the precise estimation of \(\theta \) are concave (or convex) functions of the information matrix of a design \(\xi \in \Xi \), i.e. \(\Phi (\xi ;\theta )=\Phi [M(\xi ,\theta )]\), where
If \(\Phi (\xi ;\theta )\) is a non-negative concave function, then a measure of the goodness of a design \(\xi \) with respect to the optimal design \(\xi ^*_\theta \), is the following efficiency function:
If \(\Phi (\xi ;\theta )\) is convex, then the ratio on the right-hand side of Eq. (2) should be reversed.
3 Minimum efficiency and pseudo-Bayesian criteria
Let \(\Phi _i(\xi ;\theta _i)\) with \(i=1,\ldots ,k\) be k different concave optimality criteria, that reflect distinct goals and possibly depend on some unknown parameter vector \(\theta _i\). Let \(\theta _{0i}\) be a guessed value for \(\theta _i\); thus, \(\xi _i^*=\xi _{i;\theta _{0i}}^*=\arg \max _{\xi \in \Xi } \Phi _i(\xi ;\theta _{0i})\) are local optimum designs. When we are interested in a compromise design that is ‘good’ for all the different criteria, we need to combine \(\Phi _i(\xi ;\theta _i)\), for \(i=1,\ldots ,k\), in a multi-objective criterion. To this aim, as suggested by Dette (1997), we should first standardize the criteria \(\Phi _i(\xi )=\Phi _i(\xi ;\theta _{0i})\), obtaining their efficiency functions: \(\textrm{Eff}_i(\xi )={\Phi _i(\xi )}/{\Phi _i(\xi _{i}^*)}\), \(i=1,\ldots ,k\).
An easy way of combining the standardized criteria is through a linear combination. If we have same prior knowledge about criteria \(\Phi _i(\xi )\) for \(i=1,\ldots ,k\), we might compute a Bayesian optimum design maximizing the following criterion:
where \(\pi ^T=(\pi _1,\ldots ,\pi _k)\) is a prior probability on the set \(\{1,\ldots ,k\}\). For an application of this criterion, see for instance Tommasi and López-Fidalgo (2010).
A design \(\xi _{\pi }^*\) is Bayesian optimal if and only if \(\partial \Phi _B(\xi _{\pi }^*,{\bar{\xi }};\pi )\le 0\) for any \({\bar{\xi }}\), where
is the directional derivative of criterion (3) at \(\xi _{\pi }^*\) in the direction of \({\bar{\xi }}-\xi _{\pi }^*\), and \(\partial \Phi _{i}(\xi _{\pi }^*,\xi _x) \) denotes the directional derivative of the component-wise criterion \(\Phi _i(\cdot )\) at \(\xi _{\pi }^*\) in the direction of \(\xi _x-\xi _{\pi }^*\). It is easy to prove that \(\xi _{\pi }^*\) is a Bayesian optimal design if and only if it satisfies the following inequality:
and that
When we are unable to provide a prior distribution \(\pi \), another possibility to takes into consideration all the objectives represented by the k different criteria is the following minimum efficiency criterion:
This multi-objective optimality function, differently from the previous one, is not differentiable, and thus the computation of \(\Phi \)-optimal designs is not straightforward at all.
A design \(\xi ^*\) is a maxi-min efficiency design if and only if
From the last equation, \(\xi ^*\) is also the design that minimizes the maximum inefficiency optimality criterion:
We find maxi-min efficiency designs by minimizing \(\Phi ^{-1}(\xi )\), for which we can state the following propositions:
Proposition 1
The maximum inefficiency criterion \(\Phi ^{-1}(\xi )\) is a convex function.
The proof is straightforward.
Proposition 2
The directional derivative of \(\Phi ^{-1}(\xi )\) at \(\xi \) in the direction of \({\bar{\xi }}-\xi \) is
where \(e_i\) denotes the canonical vector of the Euclidean space,
and \(\displaystyle \psi (x,e_i,\xi ) = -\Phi _{i}(\xi _i^*) \,\frac{\partial \Phi _{i}(\xi ,\xi _x)}{\Phi _{i}^2(\xi )}\).
The proof is deferred to Appendix A.
3.1 Equivalence theorem
Bayesian optimum designs are usually found by applying standard algorithms, because the equivalence inequality (4) is completely known. Maxi-min efficiency designs are difficult to determine because they are not differentiable (their equivalence inequality depends on an unknown measure); see for instance, Wong (1992). See also Chen et al. (2017) and Dette and Biedermann (2003) for an equivalence theorem for the standardized max-min D-optimal design criterion. In this section, we provide a new formulation of the equivalence theorem, which establishes a connection between \(\Phi _B(\xi ;\pi )\) and \(\Phi (\xi )\).
Theorem 3
(Equivalence Theorem) A design \(\xi ^*\) is a maxi-min efficiency design if and only if there exists a probability distribution \(\pi ^*\) on the index set
such that \(\xi ^*\) is a Bayesian optimum design for the prior distribution \(\pi ^*\), that is, if and only if \(\xi ^*\) fulfils the following inequality,
The detailed proof of the equivalence theorem is deferred to Appendix A. In addition, from (5), we can state the following corollary:
Corollary 3.1
The quantity \(\sum _{i\in {{\mathcal {I}}}(\xi ^*)} \pi _i^* \,\frac{\partial \Phi _{i}(\xi ^*,\xi _x)}{\Phi _{i}(\xi _i^*)}\) attains its maximum value of zero at every support point of \(\xi ^*\).
The equivalence between the minimum efficiency and the Bayesian optimality criteria can be used to check whether a design is optimal with respect to criterion (6). Recently, several algorithms have been applied to construct optimal designs numerically; see for instance, Dette et al. (2003) who apply the Nedler–Mead algorithm, (Chen et al. 2015, 2020), where the authors use particle swarm optimization, or (Belmiro et al. 2015), where a semi-infinite programming based algorithm is considered. These algorithms provide a solution based on a suitable stopping rule; however, it is necessary to check the equivalence inequality to prove that an ‘optimum’ has been reached. We follow the same idea as in Chen et al. (2017) (page 87). Given a solution of a numerical procedure \(\xi _s^*\), from the equivalence inequality (8) with \(\xi _s^*\) instead of \(\xi ^*\), we can compute the prior distribution \(\pi ^*\) solving the minimization problem
where \({{\mathcal {S}}}_{\xi _s^*}\) denotes the support of \(\xi _s^*\) and \({{\mathcal {I}}}(\xi _s^*)\) is the set defined in (7) with \(\xi ^*\) replaced by \(\xi _s^*\). Equation (9) comes out from the equivalence theorem, for which the weighted sum of the component-wise criteria’s derivatives must be zero at each support point of the optimal design, and thus, the weights can be chosen by minimizing the sum of squares of these expressions for all the support points.
Given a design \(\xi _s^*\), using the solutions of (9) we can check whether \(\xi _s^*\) really is an optimal design by computing the equivalence inequality (8).
Remark 1
At the optimal design, the value of (9) should be zero (except for rounding approximations).
4 Illustrative examples
The first example of this section underlines the difficulty in finding out a maxi-min efficiency design, when the search is done step-by-step by comparing the k efficiencies. This leads to the conclusion that suitable optimization algorithms should be applied, and then their numerical solutions should be checked for their optimality through Equivalence inequality (8). This procedure is followed in Example 4.2.
4.1 SMV-optimum designs in biology immunoassays
In biology, immunoassays are usually performed to quantify the concentration of an analyte. In this example, the SMV-optimality criterion is applied to the four-parameter logistic model, which is the most frequently used model for symmetric immunoassay data,
where y is the response at the concentration x, \(\varepsilon \sim N(0;\sigma ^2)\) is a random error, and \(\theta _1>0\), \(\theta _2>0\), \(\theta _3\in \mathrm{I\!R}\), and \(\theta _4>0\) are unknown parameters.
The SMV-optimality criterion, proposed by Dette (1997),
is an example of maximum inefficiency criterion (6), where \(k=4\) is the dimension of \(\theta =(\theta _1,\theta _2,\theta _3,\theta _4)\); \(\theta _0\) is a guessed value for \(\theta \); \(\Phi _i(\xi )\) is given by
where \({M(\xi ,\theta )}\) is the information matrix (1) for model (10), and \(e_i\), \(i=1,...,4\) are the canonical basis of \(\mathrm{I\!R}^4\).
In this example, \({{\mathcal {X}}} = [0, 5]\), \(\theta _0=(1,2,1,1)\) and the gradient in (1) is
where the third component has been slightly modified for computational reasons.
The procedure followed to find out the optimal design is quite cumbersome, but the prior probabilities which solve (9) enable us to identify the right maxi-min efficiency design. At first we search for designs that have the same efficiencies for any pair of the indices. Let \(I=\{i_1,\ldots ,i_l\}\), with \(l=2,\ldots ,k\), be an index set. For instance, for \(I=\{2,4\}\) we obtain the design
which has the same efficiency, 0.2116, for both 2 and 4 standardized criteria, but the efficiencies of the other criteria are smaller (0.1139 and 0.0525 for standardized criteria 1 and 3, respectively). Thus, \(\xi _1^{(2, 4)}\) is not a minimum efficiency design and is discarded. In particular, one of the other efficiencies is very low, and thus after a new search the design
gets a common efficiency of 0.1386 for indices 2 and 4, and efficiencies for the other criteria which are not so bad as in the previous case (0.1696 and 0.1140 for indices 1 and 3, respectively). However, once again one of the efficiencies is smaller than that for the indices in I, and \(\xi _2^{(2, 4)}\) is discarded as well.
After some attempts, finally we find out the design
giving the same efficiency, 0.4778, for indices 2 and 4, which is smaller than the other efficiencies, 0.5734 and 0.5879 (for indices 1 and 3, respectively); therefore, \(\xi _3^{(2, 4)}\) is a candidate design for the Bayesian optimality. To prove that, it is necessary to identify a prior distribution in I, \(\pi = \{\pi _ 2, \pi _ 4\} \), such that \(\xi _ 3^{(2, 4)} \) is Bayesian optimal for \(\pi \). To find such a distribution, we employ condition (9). The weights minimizing this expression are \(\pi _2=0.608\) and \(\pi _4=1-\pi _2\), but the minimum value obtained from these weights is 3.547, which is far from zero. Thus, this design cannot be Bayesian optimal (and neither maxi-min efficiency optimal).
We obtain similar results with every pair \((i_1, i_2)\) of indices. Thus, the search proceeds among designs producing equal efficiencies for three of the component-wise criteria. At first we look for designs that produce a common efficiency for the indices in \(I = \{1, 2, 4\}\); Table lists some designs verifying this condition, however, none of them has the remaining efficiency larger than this common value.
The same happens with the triplets of indices \(\{1,3,4\}\) and \(\{1,2,3\}\). Differently, for the set \(I=\{2,3,4\}\), we find out some designs with the same common efficiency, which is smaller than that for \(i=1\); see Table .
However, none of them can be Bayesian optimal because no distribution of weights in I gets a minimum value zero in (9). Finally, for the same index set, we obtain the design
with efficiencies \(\{0.5963, 0.4970, 0.4970, 0.4970\}\). Setting \(\xi ^*_s=\xi ^*\) in (9), we get the solution \(\pi ^*=\{0, 0.493, 0.054, 0.453\}\) with a minimum value of 6.644 x \(10^{-4}\) and hence, \(\xi ^*\) turns out to be Bayesian optimal for \(\pi ^*\).
4.2 Maxi-min optimal discriminating designs in toxicology studies
In toxicology studies, we may have a continuous response and several possible models for the true mean response. As in Dette et al. (2010), we assume the following rival models for the mean response of the outcome Y:
and the following criterion for discriminating between pairs of models:
where index i denotes 4 different pairwise comparisons: \(\eta _1\) vs \(\eta _2\), \(\eta _1\) vs \(\eta _3\), \(\eta _2\) vs \(\eta _4\), and \(\eta _3\) vs \(\eta _4\), respectively. In other terms, for a fixed value \(\theta _0\),
with
where \(e_j\), \(j=3,4\) is the j-th canonical basis of the Euclidean space and \(M_{j}(\xi ,\theta _0)\) is the information matrix (1) for the mean response \(\eta _j(x,\theta )\), with \(j=1,2,3,4\). Dette et al. (2003) found the maxi-min efficiency designs using a numerical procedure based on the Nedler–Mead algorithm. Setting \(\theta _0=(1,3,0,1)^T\) (see Table 3 in Dette et al. 2003), the authors found the following numerical solution:
for which \(\textrm{Eff}_{1}(\xi _s^*)=.705\), \(\textrm{Eff}_{2}(\xi _s^*)=\textrm{Eff}_{4}(\xi _s^*)=.682\) and \(\textrm{Eff}_{3}(\xi _s^*)=.871\), and hence \({{\mathcal {I}}}(\xi _s^*)=\{2;4\}\) and \(\pi _1^*=\pi _3^*=0\). From (9), where
and
with \(\nabla \eta (x,\theta )= [\frac{\partial \eta (x,\theta )}{\partial \theta _1},\ldots ,\frac{\partial \eta (x,\theta )}{\partial \theta _4}]^T\), we obtain \(\pi _2^*=.574\) and \(\pi _4^*=1-\pi _2^*\). Figure , which shows the sensitivity function on the left-hand side of (8),
proves that the numerical solution \(\xi _s^*\) actually is a maxi-min efficiency design.
5 Conclusions and discussion
In practice, obtaining an optimal design that accounts for several goals or experimenter’s interests, is a difficult task. There is much literature on different approaches, usually considering specific situations. In this study, we consider a quite general setting; we aims at finding a max-min efficiency design which maximizes the minimum of the efficiencies of several component-wise criteria (reflecting different tasks). This multi-objective criterion depends on some nominal values of the parameters, therefore a sensitivity analysis to assess this dependence is advisable.
We provide theoretical results, including an equivalence theorem which states that the maxi-min efficiency design is Bayesian optimal for a specific prior distribution on the set of the component-wise criteria. Furthermore, a method to identify this prior distribution is given. This is important for two reasons.
-
(i)
It enables the application of the equivalence theorem in such a way the optimality of a particular design, e.g. found by the implementation of an algorithm, can be checked through the equivalence theorem since the prior probability can be determined.
-
(ii)
This prior distribution tells the practitioner the weight the optimal design is assigning to each component-wise criterion. Notice that if a criterion does not receive any weight, this does not mean that the optimal design is going to be bad for that criterion. It is quite the opposite, as the efficiency of the optimal design with respect to that specific component-wise criterion will be higher than those with positive weights.
References
Atkinson A, Fedorov VV (1975) Optimal design: experiments for discriminating between several models. Biometrika 62:289–303
Belmiro PMD, Wong WK, Atkinson AC (2015) A semi-infinite programming based algorithm for determining T-optimum designs for model discrimination. J Multivar Anal 135:11–24
Berger MPF, Joy KCY, Wong WK (2000) Minimax d-optimal designs for item response theory models. Psychometrika 65(3):377–390
Chen R, Chang S, Wang W, Tung H, Wong WK (2015) Minimax optimal designs via particle swarm optimization methods. Stat Comput 25:975–988
Chen P, Chen R, Tung H, Wong WK (2017) Standardized maxmin d-optimal designs for enzyme kinetic inhibition models. Chem Intell Lab Syst 169:79–86
Chen R, Chen P, Chen L, Wong WK (2020) Hybrid algorithms for generating optimal designs for discriminating multiple nonlinear models under various error distributional assumptions. PLoS ONE 15(10):1–30
Dette H (1997) Designing experiments with respect to ‘standardized’ optimality criteria. J R Stat Soc Ser B 59:97–110
Dette H, Biedermann S (2003) Robust and efficient designs for the Michaelis–Menten model. J Am Stat Assoc 98(463):679–686
Dette H, Melas VB, Pepelyshev A, Strigul N (2003) Efficient design of experiments in the Monod model. J R Stat Soc Ser B 65:725–742
Dette H, Haines LM, Imhof LA (2007) Maxmin and Bayesian optimal designs for regression models. Stat Sin 17:463–480
Dette H, Pepelyshev P, Shpilev P, Wong WK (2010) Optimal designs for discriminating between dose-response models in toxicology studies. Bernoulli 16(4):1164–1176
Fackle-Fornius E, Miller F, Nyquist H (2015) Implementation of maximin efficient designs in dose-finding studies. Pharm Stat 14:63–73
Fedorov VV, Hackl P (1997) Model-oriented design of experiments. Lecture notes in statistics. Springer, New York
López-Fidalgo J, Tommasi C (2004) Construction of MV- and SMV-optimum designs for binary response models. Comput Stat Data Anal 44(3):465–475
Müller CH, Pazman A (1998) Applications of necessary and sufficient conditions tor maximin efficient designs. Metrika 48:1–19
Nyquist H (2013) Convergence of an algorithm for constructing minimax designs. In: Ucinski D, Atkinson A, Patan M (eds) mODa 10-advances in model-oriented design and analysis. Springer, Heidelberg, pp 187–194
Schervish MJ (1995) Theory of Statistics. Springer, New York
Tommasi C, López-Fidalgo J (2010) Bayesian optimum designs for discriminating between models with any distribution. Comput Stat Data Anal 54(1):143–150
Tommasi C, Martín-Martín R, López-Fidalgo J (2016) Max-min optimal discriminating designs for several statistical models. Stat Comput 26:1163–1172
Wong WK (1992) A unified approach to the construction of minimax designs. Biometrika 79:611–619
Acknowledgements
The authors are grateful to Professor Martín-Martín for useful discussions and comments. Research was supported by the Spanish Ministry of Science and Innovation (Projects ’PID2020-113443RB-C21’ and ‘PID2021-125211OB-I00’), and Junta de Castilla y León, Spain (Project ‘SA105P20’).
Funding
Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix A
Appendix A
Lemma 4
The maximum inefficiency criterion admits the following expression
where \({{\mathcal {C}}}\) is the convex hull
of the canonical vectors \(\{e_1,\ldots ,e_k,-e_1,\ldots ,-e_k\}\) and
Proof
The function \(\Psi (\xi ;c)\) is convex with respect to c; thus, it reaches its maximum at one (or more) of the vertexes of the set \({{\mathcal {C}}}\), and
which proves the lemma. \(\square \)
Proof of Proposition 2
The set \({{\mathcal {C}}}=\{c:\; c\in \mathrm{I\!R}^k,\; |c|_1\le 1 \}\), where \(|c|_1=\max {\{|c_1|,\dots ,|c_k|\}}\) is compact. Therefore, from Eq. (2.6.15) of Fedorov and Hackl (1997), the directional derivative of \(\Phi ^{-1}(\xi )\) evaluated at \(\xi \) in the direction of \({\bar{\xi }}-\xi \) is
where \(\psi (x,c,\xi )\) is the directional derivative of \(\Psi (\xi ;c)\) in the direction of \(\xi _x-\xi \) and
The last expression for \({{\mathcal {C}}}(\xi )\) is because \(\Psi (\xi ;c)\) always reaches its maximum at one or more points defined by the canonical vectors.
Moreover,
\(\square \)
The following two lemmas are necessary to prove the Equivalence Theorem stated in Sect. 3.
Lemma 5
Let \(\xi \) and \({\bar{\xi }}\) be two designs and let \(\eta \) denote a discrete distribution on \({{\mathcal {C}}}(\xi )\), then
Proof
The following inequality
holds for any \(\eta \); thus, it is valid also for the measure \(\eta _i\) which puts the whole mass at the vector \(e_i\),
The last inequality is satisfied for any \(e_i\in {{\mathcal {C}}}(\xi )\), and this means that
On the other hand,
This inequality is obtained by replacing each term
\(\int _{\mathcal{X}} \psi (x,e_i,\xi ) \,{\bar{\xi }}(dx)\) by \(\max _{e_i\in {{\mathcal {C}}}(\xi )} \int _{{\mathcal {X}}} \psi (x,e_i,\xi ) \,{\bar{\xi }}(dx)\), and it is satisfied for any measure \(\eta \); thus,
The lemma follows from inequalities (14) and (15). \(\square \)
Lemma 6
For any design \(\xi \), the following equality is verified:
Proof
Given \({\bar{\xi }}\), the inequality
holds for any \(\eta \); therefore,
Since inequality (16) holds for any \({\bar{\xi }}\), for the measure \({\bar{\xi }}\) that minimizes the left-hand side of (16),
On the other hand, the inequality
holds for any \({\bar{\xi }}\); thus, it is also valid for any measure \({\bar{\xi }}=\xi _x\), that is,
Since inequality (18) holds for any \(x\in {{\mathcal {X}}}\), it is also valid for the value of x which minimizes the quantity \(\int _{{{\mathcal {C}}}(\xi )} \psi (x,e_i,\xi ) \eta (de_i)\), that is,
The lemma follows from inequalities (17) and (19). \(\square \)
Proof of Theorem 3
Since \(\Phi ^{-1}(\xi )\) is a convex function of \(\xi \), a necessary and sufficient condition for \(\xi ^*\) to be an optimum design is that
that is,
From Lemma 5 the above is equivalent to
On the other hand, from Lemma 6 inequality (20) is equivalent to
Thus, there exists a measure \({\overline{\eta }}\) (the maximum of the previous one) satisfying
that is,
From Equation (13) and setting \({\overline{\eta }}_i={\overline{\eta }}(e_i)\), the previous inequality becomes
Let \({{\mathcal {I}}}(\xi ^*)=\left\{ i: \;i=\arg \min _{j\in \{1,\ldots , k\}} \textrm{Eff}_j(\xi ^*) \right\} \), setting
inequality (21) becomes
The thesis follows from comparing inequality (22) with (4). \(\square \)
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Tommasi, C., Rodríguez-Díaz, J.M. & López-Fidalgo, J.F. An equivalence theorem for design optimality with respect to a multi-objective criterion. Stat Papers 64, 1041–1056 (2023). https://doi.org/10.1007/s00362-023-01431-2
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00362-023-01431-2