## Abstract

In both animal and human behavioral repertoires, classical expected utility theory is considered a fundamental element of decision making under conditions of uncertainty. This theory has been widely applied to problems of animal behavior and evolutionary game theory, as well as to human economic behavior. The Allais paradox hinges on the expression of avoidance of bankruptcy by humans, or death by starvation in animals. This paradox reveals that human behavioral patterns are often inconsistent with predictions under the classical expected utility theory as formulated by von Neumann and Morgenstern. None of the many attempts to reformulate utility theory has been entirely successful in resolving this paradox with rigorous logic. We present a simple, but novel approach to the theory of decision making, in which utility is dependent on current wealth, and in which losses are more heavily weighted than gains. Our approach resolves the Allais paradox in a manner that is consistent with how humans formulate decisions under uncertainty. Our results indicate that animals, including humans, are in principle risk-averse. Our restructuring of dynamic utility theory presents a basic optimization scheme for sequential or dynamic decisions in both animals and humans.

## Introduction

Expected utility theory is central to understanding decisions and games (von Neumann and Morgenstern 1944, Maynard Smith 1982). It is widely used in the analysis of decision-making processes in animals (Real and Caraco 1986; Stephens and Krebs 1986; Stephens et al. 2007) and humans (Raiffa 1968). In game theory, the values in a payoff matrix are equivalent to fitness units in animals (Maynard Smith 1982; Nowak 2006) or utility (economic gain) in humans (von Neumann and Morgenstern 1944). The basic principle of expected utility theory is simply the maximization of expected fitness (utility) of current energy reserves (wealth) for an animal (human) decision maker. This is based on the fact that, in humans, the ‘value’ of a $10 bill when one’s wallet is empty is much greater than when one’s wallet is full of $20 bills. Similarly, in animals, the value of one small piece of food when starved is much greater than that of one large piece when the stomach is full. The ‘value’ is called ‘utility,’ in expected utility theory, but it is equivalent to Darwinian ‘fitness’ in animals. Although expected utility theory is well formulated mathematically (von Neumann and Morgenstern 1944; Maynard Smith 1982), the original version has been criticised because of a few serious inherent flaws and heretofore unresolved paradoxes (Friedman and Savage 1948; Markowitz 1952; Edwards 1961; Raiffa 1968; Allais and Hagen 1979; Machina 1987a). The best known, and perhaps the most important, problem is the Allais paradox (Allais and Hagen 1979). The Allais paradox classically involves inconsistencies inherent in human decisions, as follows: if given a pair of choices (“monetary gambles”), human subjects tend to prefer a sure payoff over a gamble, even if the expected payoff of the gamble is much higher than the sure payoff (the ‘sure thing principle,’ after Savage 1954). However, if two gambles are offered, humans prefer the option with the highest payoff (expected utility), even if its probability is slightly diminished (Edwards 1961). That is, some decisions are more influenced by probability, others more by monetary rewards. No single utility function can describe adequately the switching behavior in preferences observed in the Allais paradox. Even though expected utility theory has greatly advanced our understanding of behavioral decisions and evolutionary game theory, it has been criticized heavily for its persistent difficulties, including the Allais paradox, reconciling the problem of gambling and insurance at multiple wealth levels, and that of simultaneous gambling and insurance (Friedman and Savage 1948; Markowitz 1952; Edwards 1961; Machina 1982, 1987a, b).

For example, the problem of gambling and insurance at multiple wealth levels is explained as follows. Since people at any wealth level play both gambling and insurance, the utility (fitness) function should be concave up and convex down at the current wealth level (Friedman and Savage 1948). However, people at all wealth levels play some gambling while paying some insurance premiums, indicating the utility function should shift around the current wealth level (Markowitz 1952). Thus, we cannot define a single utility function for wealth, as in the standard expected utility theory. The simultaneous gambling and insurance is explained as follows. We cannot explain why people play gambling and insurance simultaneously, since these behaviors are opposite: risk-taking and risk-averse (Machina 1987a, b). Among these persistent difficulties, the Allais paradox is widely considered the most intractable problem in expected utility theory (Allais and Hagen 1979; Kahneman and Tversky 1979; Machina 1987a).

Here, extending the dynamic utility function of Yoshimura et al. (2012), we develop the principle of dynamic utility in terms of the avoidance of bankruptcy in humans (death by starvation animals). The novel components of dynamic utility are that: (1) utility is assumed to be conditional on a current state variable (body size or energy fat reserves in animals; wealth in humans); and (2) losses are weighted on utility more heavily than gains, so that death by starvation (bankruptcy in humans) is avoided. We apply the dynamic utility approach to the Allais paradox in human economic behavior. Our solution indicates that paradoxical switching behavior in preferences is a function of current states. We discuss the significance and implications of our findings to the fields of animal foraging behavior, as well as human economic behavior.

The current paper is aimed in particular at the basic principle of optimality in sequential decision making in animals, including humans. Even though we emphasise solving the Allais paradox in humans, our solution also has important implications for understanding optimization schemata in animal behavior. The principal difference between these phenomena lies in the currency under optimization: in humans, gain accrues in economic terms (wealth); in animals, in body size (energy reserves).

## Example of the Allais paradox

We now present an example of the Allais paradox for our numerical solution following Machina (1987a). Imagine your preferences between choices **a** and **b**, and between **c** and **d**.

Let *U* = *U*(*x*) be the utility of wealth $*x*. Then, the expected utility of each choice is

where *M* denotes millions of dollars. If choice **a** is preferred over choice **b**, then the expected utility theory asserts that \( E(U_{a} ) > E(U_{b} ) \) (Eqs. 1, 2).

Now we apply the independence axiom of expected utility theory (von Neumann and Morgenstern 1944). A straightforward explanation of the independence axiom follows (Machina 1982). Suppose we have risky prospects A, B and C, and their combined choices *X* and Y, where X is the combined reward of A and C, with a *p*:(1 − *p*) chance of A or C, that is,

while *Y* is that of *B* and *C*, with a *p*:(1 − *p*) chance of *B* or *C*, that is,

We have three options for both (A vs. B) and (X vs. Y), e.g., (1) prefer A over B, (2) prefer B over A and (3) indifferent between A and B. The independence axiom states that choice A is preferred (otherwise ignored or avoided) over choice B, if and only if X is preferred over Y, such that \( A \succ B \Leftrightarrow X \succ Y \). Here, we explain only the case (1), but the latter two cases hold in the same manner (i.e., \( A \prec B \Leftrightarrow X \prec Y \) and \( A\sim B \Leftrightarrow X\sim Y \)). This means that we can ignore the same component C in choices X and Y because its probability is the same between the choices X and Y, reducing to choices between A and B. The literal meaning of the independence axiom implies that only differences among choices A, B and C need be compared.

Applying the independence axiom, we can subtract 0.89 *U*(1 M) from both sides of this inequality (Eqs. 1, 2). Then we get:

Similarly, if choice **d** is preferred over choice **c**, then \( E(U_{d} ) > E(U_{c} ) \) (Eqs. 3, 4). We also apply the independence axiom to choices **c** and **d**. We subtract 0.89 *U*(0) from both sides, and this likewise reduces to

The inequality in the second choice (Eq. 6) is exactly opposite of that in the first choice (Eq. 5). The independence axiom of the expected utility theory asserts that preference **a** over **b** is equivalent to preference **c** over **d** and vice versa. However, experimental tests and psychological observations all suggest that humans tend to prefer **a** over **b**, but **d** over **c** (Machina 1987a, b). Thus, human behavior seems inconsistent with expected utility theory (specifically with the independence axiom). This kind of systematic violation of expected utility theory is often referred to as the Allais paradox.

## Dynamic utility with discounting for bankruptcy

Suppose a human maximizes his lifetime wealth through a sequence of economically based decisions. We may replace human wealth by body size (the energy state or fat reserves) in animals. The wealth at time *t*, *w*
_{
t
}, is assumed the non-negative state variable of the decision-maker for *t* = 0,…,*T*, where *T* ≫ 0 is a finite end time. We then assume that final wealth, *w*
_{
T
}, represents the lifetime fitness of an individual. The maximization of lifetime fitness, *w*
_{
T
} (for *t* = 0,…,*T*) is then given by

where *r*
_{
t
} (≥0) denotes the multiplicative growth rate of wealth at time *t*, such that *w*
_{
t+1
} = *r*
_{
t
}
*w*
_{
t
}. We here assume that multiplicative growth rate *r*
_{
t
} (*t* = 0…*T*) follows a stochastic process, such that *r*
_{
t
} are independent non-negative random variables (non-negative *i.r.vs.*), i.e., *r*
_{
t
} = *r* (>0) with probability *p*(*r*) for a probability distribution of {*r*}. We here choose the optimal set from many possible sets of random variables. We search for the rules of choice for the optimal probability distribution that gives the highest final wealth (or body size) *w*
_{
T
}. Then the geometric mean *G*(*r*) in Eq. (1) becomes:

This geometric mean is the temporal average in the growth rates of wealth (body size) of an individual over time. Here, Eq. (8) is the temporal mean of observed growth factors *r*
_{
t
}. In order to analyse the optimality of decision sequences, we replace *r*
_{
t
} with the corresponding probability distribution *p* = *p*(*r*) (*r* > 0, i.e., probability *p*(*r*
_{
j
}) = 1/*t*), such that

We now introduce a criterion for the avoidance of bankruptcy in the maximization function of human wealth. The term “bankruptcy (starvation death)” here means that wealth (or energy reserves) is reduced to zero, i.e., *w*
_{
t
} = 0. In the case of animals, it is the death caused by starvation. The idea of a penalty function is that a decision maker always fears an ultimate irreversible loss of wealth (energy reserves). We wish simultaneously to (1) maximize *w*
_{
t
}, and (2) minimize the possibility of bankruptcy (or irreversible losses).

We combine the above two optimization criteria by the following procedure. Let *f*(*r*) be a penalty function for negative growth rates, such that

We then define dynamic optimization with discounts on negative growth, such that

where *G*
_{Total}(*r*) is the combined optimization criterion for the wealth maximization and the avoidance of negative growths. Equation (11) simply adds an additional weight *f*(*r*) on negative growth in the overall fitness function. The reason we introduce the penalty function (Eq. 10) in the current optimization scheme is that the current geometric mean analyses is not capable of including bankruptcy, since log(*r*) = −∞, if *r* = 0 (not assumed). Therefore, we introduce a given penalty for any negative growth (*r* < 1), with no penalty for positive growth. Because of the inclusion of the penalty on negative growth, *f*(*r*) is discontinuous at *r* = 1. The current inclusion of penalty on negative growth should express the avoidance of bankruptcy to some extent. Taking the logarithm of Eq. (11), we get

where *E* now refers to the commonly used arithmetic mean, in this case of [1 + *f*(*r*)]log *r*. This optimization criterion is simply expressed by utility theory (von Neumann and Morgenstern 1944). Namely, we simply define a utility function *u*(*r*):

and maximize the expected utility, *E*[*u*(*r*)]. We now replace the growth rate *r* by gain *g* and current wealth w, such that *r* = (*g* + *w*)/*w*. Then we define the dynamic utility surface *u*(*g*;*w*) of gain *g* (decision variable) given current body size *w* (state variable), such that (Fig. 1):

where we simply maximize the expected utility of gain, E[*u*(*g*;*w*)] given current wealth *w*. This optimization rule for any one-time decision based on dynamic utility surface includes both the criteria of final wealth maximization and the avoidance of bankruptcy at any single decision during the lifetime of a human or an animal.

## Solution for the Allais paradox

Here, we present a numerical solution for the Allais paradox, applying the dynamic utility function (Eq. 14). We here present only a numerical solution, but the current theory is completely logical (purely analytical), that is, the Allais paradox is the inevitable outcome for some people as long as all the conditions are met.

We set a constant penalty on all negative growth, i.e., *f*(*r*) = *c* (constant) for −*w* < *g* < 0. Practically, the penalty should depend on the value of negative growths. For example, a large negative value incurs a large penalty, and a small negative value, a small penalty. We also analyze the case of proportional penalty (see Supplementary material). With a constant penalty, the dynamic utility of gain (Eq. 14) becomes:

To calculate the Allais paradox numerically, we set the current wealth state *w* = 10,000 and the penalty constant *c* = 3 in Eq. (15). Now we put Eq. (15) into the example of the Allais paradox (Eqs. 1–4). First, imagine the choice between **c** and **d**. Introducing Eq. (15) into Eqs. (3) and (4), the dynamic expected utilities of choices **c** and **d**, E(*u*
_{
c
}) and E(*u*
_{
d
}), are expressed as, respectively:

where *M* stands for a million dollars and *w* = 10,000. Since \( E (u_{d} )> E (u_{c} ) \), the result is a predicted preference for **d** over **c**. Note that the expected utilities of choices **c** and **d** do not depend on the penalty constant *c*.

Now consider the choice between **a** and **b**. Since choice **a** implies *no uncertainty*, a decision maker thinks of it as having been chosen already. This imaginary choice will shift the current wealth state, i.e., *w’* = 1 M + *w*. Then the two choices are rewritten as:

In reality, this involves a single choice of the offer **b′** or otherwise. The expected utilities of choices **a′** and **b′** are similarly calculated from Eq. (15):

Because \( E(u_{a'} ) > E(u_{b'} ) \), the predicted preference is now for **a′** over **b′**. Therefore, the original preference becomes **a** over **b**, and the Allais paradox is resolved.

Our results depend on the current wealth state *w* (Fig. 2). We denote *w* = *x*
_{1} when \( E(u_{d} ) = E(u_{c} ) \) and *w* = *x*
_{2} when \( E(u_{a'} ) = E(u_{b'} ) \). In the current example, the two boundaries are approximately *x*
_{1} = 0.1024 and *x*
_{2} = 18,922.

If 0 < *w* < 0.1024 = *x*
_{1}, then the preferences are **a** over **b** and **c** over **d**. This represents a pure conservative strategy that can only rarely be achieved. If *x*
_{1} = 0.1024 < *w* < 18,922 = *x*
_{2}, the preferences are **a** over **b** and **d** over **c**, exhibiting the Allais paradox. Finally, if *w* > 18,922 = *x*
_{2}, the preferences are **b** over **a** and **d** over **c**, resulting in risk-taking strategies. This suggests that extremely rich people are less likely to show the Allais paradox than poor people. It also agrees with common observations that the preference reversal between choices **a** and **b** is not strict, but that the preference **d** over **c** is almost invariant.

We should also note that the range of the Allais paradox depends on the penalty constant *c* (Fig. 2b). Even though the lower boundary *x*
_{1} is constant and independent of the penalty, the higher boundary *x*
_{2} depends on the penalty cost *c*. When *c* is large, *x*
_{2} becomes large, resulting in the larger middle classes exhibiting the Allais paradox (Fig. 2b).

## Discussion

Our numerical solution to the Allais paradox comprises three critical components: (1) a shift in reference points, (2) a penalty on negative growth, and (3) a wealth-dependent utility function. It is important to note that the Allais paradox requires all three conditions, and that the first two conditions are not unique to our model. We should also note that the penalty is more likely to be proportional to the value of negative growth functions, since it is correlated with the probability of bankruptcy (for the case of proportional penalty, see supplementary information).

The first condition, a shift in reference points, has been suggested (Markowitz 1952) and tested empirically in the context of problems (Hershey and Schoemaker 1980). This means that a utility function is based on a gain (or loss) given the *current* state of wealth, rather than the overall wealth (von Neumann and Morgenstern 1944; Friedman and Savage 1948). In foraging behavior of animals, this means simply a dependence on the current state; this concept is well established in studies of risk-sensitive foraging (Stephens and Krebs 1986). For example, animals tend to remain in a safe nest until hungry (Lima et al. 1985; Ito et al. 2013). Here, the value of food is low when an animal is satiated, but high when the animal is starved. Mathematically, this principle, current-state dependence, agrees with the basic principle of (stochastic) dynamic modeling, e.g., the optimality principle of dynamic programming (Bellman 1957; Mangel and Clark 1988).

The second condition, a penalty on negative growth, is often assumed in expected utility theory (Markowitz 1991) and applied in prospect theory (Kahneman and Tversky 1979). In the absence of a penalty on negative growth [*f*(*r*) = 0], preferences cannot be reversed in our model. This suggests that the Allais paradox is a phenomenon related to the avoidance of bankruptcy in human behavior and the avoidance of starvation in foraging behavior (Lima 1985; Ito et al. 2013).

The unique contribution of our model lies in the third condition: the (current) wealth-dependent utility function. A utility function in expected utility theory has often been characterized as ad hoc, since its shape can only be deduced by logic or estimated from empirical observations (Friedman and Savage 1952; Caraco 1980; Real and Caraco 1986; Yoshimura and Shields 1987; Mangel and Clark 1988). Furthermore, previous solutions for the Allais paradox weighted probability values in a nonlinear fashion (Edwards 1961; Kahneman and Tversky 1979; Machina 1987a, b; Kadane 1992). Such modifications inevitably introduce subjectivity and inconsistency in the systems under analysis (Fishburn 1988). Therefore, the previous solutions have been criticized as *descriptive* models, while the expected utility theory is called a *normative* model (Fishburn 1988).

The proposed wealth-dependent utility function is an *analytical* model, since it is derived analytically from optimization criteria. Under our solution, we adopt a constant penalty on negative growth for the sake of simplicity. For the simplicity of calculations, we assume that penalty is constant irrespective of the amount of losses. However, the larger the loss, the more humans tend to avoid it. Therefore, wealth-dependent utility function is more reasonable if the penalty is proportional to negative growth. However, the result of proportional penalty is qualitatively the same with the constant case (see Supplementary material for detail derivations). We should note that this concept is derived from the maximization of the final states, such as body size. Thus, it is equivalent to the traditional average weight maximization in foraging behavior (Stephens and Krebs 1986) and dynamic modeling in behavioral decisions (Mangel and Clark 1988).

An important aspect of our proposed solution is that expected utility theory is a *static* model (Yoshimura et al. 2012). This implies that game theory and the well-known concept of the evolutionarily stable strategy (ESS) are only valid in the context of decisions arrived at singly. From the very existence of the Allais paradox, many economists and applied mathematicians suggest that standard expected utility theory may be flawed (e.g., Edwards 1961; Allais and Hagen 1979; Kahneman and Tversky 1979; Machina 1982, 1987a, b). However, we should insist that the standard expected utility theory is a valid theory if it is applied as a *static* model dealing with one-time decisions. It is not the theory of optimization, but preference. As a static model, a utility function can be defined as a function of overall wealth only (Friedman and Savage 1948; Markowitz 1952). The only problem is that it is applied to sequential decisions that cause various problems, such as the Allais paradox, and the problem of simultaneous gambling and insurance (see Machina 1982, 1987b). In our model, by taking account of the timing (state) of decisions, we define utility in terms of gain and loss, that is, a dynamic utility surface. With these modifications, the theory can accommodate the Allais paradox and generate testable predictions about the effects of wealth on decision making. Note that dynamic programming is another method that can account for dynamic decision-making or sequential decisions (Mangel and Clark 1988).

Our model deals not only with foraging in animals but also economic behavior of humans; in this regard, we assume no difference between human and animal behavior (Wilson 1975, 1979; Barash 1979). The optimality of human behavior is often regarded as ‘rational’; that is, each person seeks to maximize his gain (Hardin 1968), rendering it equivalent to adaptive behavior in animals (Harsanyi 1977; Hogarth and Reder 1986). Because the traditional expected utility theory is static, its previous applications to animal and human behavior lack the optimality criterion (Friedman and Savage 1952; Caraco 1980; Real and Caraco 1986; Yoshimura and Shields 1987). We here develop the optimality criterion for behavioral decisions in both animals and humans, and derive the utility (fitness) surface, *u*(*g*;*w*) (see also Yoshimura et al. 2012).

Our dynamic utility model is mathematically quite similar to the concept of geometric mean fitness developed in the study of adaptation in stochastic environments (Lewontin and Cohen 1969; Yoshimura and Clark 1991; Yoshimura et al. 2009). However, our model deals only with the sequential decisions of an individual over its lifetime, unlike the population growth rates considered in treatments of geometric mean fitness. In other words, geometric mean fitness applies at the population level over many generations, while dynamic utility applies at the individual level within a single generation. To consider long-time population growth functions incorporating life-time decisions, we could actually combine both models (Yoshimura and Clark 1991).

In summary, current dynamic utility theory encompasses the optimization of energy reserves (body size) in animals or economic wealth in humans during sequential decisions. We therefore expect that foraging (feeding) behavioral patterns of animals should likewise exhibit the Allais paradox against the risk of starvation. Our theoretical results indicate that a starved animal is more willing to take risks than a satiated animal, hence risk aversion is a fundamental feature of animal behavior.

Most important, the fitness function derives both from current energy gain and current body size. Therefore, the fitness function itself changes along with the current body size of an animal (Eq. 14), unlike the standard theory of expected utility theory in which the fitness of an animal is a universal function of body size, irrespective of the current body size (Caraco 1980; Real and Caraco 1986). The Allais paradox is the first demonstration (experiment) showing indeed the fitness function is state (body size)-dependent. Our current theory of dynamic utility can thus be used to evaluate lifetime fitness based on the optimality of an animal’s behavioral decisions.

## References

Allais M, Hagen O (eds) (1979) Expected utility hypotheses and the Allais paradox. Reidel, Dordrecht

Barash DP (1979) The whisperings within: evolution and the origin of human nature. Harper & Row, New York

Bellman RE (1957) Dynamic programming. Princeton University Press, Princeton

Caraco T (1980) On foraging time allocation in a stochastic environment. Ecology 61:119–128

Edwards W (1961) Behavioral decision theory. Annu Rev Psychol 12:473–498

Fishburn P (1988) Nonlinear preference and utility theory. Johns Hopkins University Press, Baltimore

Friedman M, Savage LJ (1948) The utility analysis of choices involving risk. J Polit Econ 56:279–304

Friedman M, Savage LJ (1952) The expected-utility hypothesis and the measurability of utility. J Polit Econ 60:463–474

Hardin G (1968) The tragedy of the commons. Science 162:1243–1248

Harsanyi JC (1977) Rule utilitarianism and decision theory. Erkenntnis 11:25–53

Hershey JC, Schoemaker PJH (1980) Risk taking and problem context in the domain of losses: an expected utility analysis. J Risk Insur 47:111–132

Hogarth RM, Reder MW (1986) Perspectives from economics and psychology. In: Hogarth R, Reder M (eds) Rational choice – the contrast between economics and psychology. University of Chicago Press, Chicago, pp 1–23

Ito H, Uehara T, Morita S, Tainaka K, Yoshimura J (2013) Foraging behavior in stochastic environments. J. Ethol 31:23–28. doi:10.1007/s10164-012-0344-y

Kadane JB (1992) Healthy scepticism as an expected-utility explanation of the phenomena of Allais and Ellsberg. In: Geweke J (ed) Decision making under risk and uncertainty: new models and empirical findings. Kluwer, Boston, pp 11–16

Kahneman D, Tversky A (1979) Prospect theory: an analysis of decision under risk. Econometrica 47:263–291

Lewontin RC, Cohen D (1969) On population growth in a randomly varying environment. Proc Natl Acad Sci USA 62:1056–1060

Lima SL (1985) Maximizing feeding efficiency and minimizing time exposed to predators: a trade-off in the black-capped chickadee. Oecologia 66:60–67

Lima SL, Valone TJ, Caraco T (1985) Foraging efficiency-predation risk trade-off in the grey squirrel. Anim Behav 33:155–165

Machina MJ (1982) “Expected utility” analysis without the independence axiom. Econometrica 50:277–323

Machina MJ (1987a) Decision-making in the presence of risk. Science 236:537–543

Machina MJ (1987b) Choice under uncertainty: problems solved and unsolved. J Econ Perspect 1:121–154

Mangel M, Clark CW (1988) Dynamic modeling in behavioral ecology. Princeton University Press, Princeton

Markowitz HM (1952) The utility of wealth. J Polit Econ 60:151–158

Markowitz HM (1991) Portfolio selection: efficient diversification of investments, 2nd edn. Blackwell, Cambridge

Maynard Smith J (1982) Evolution and the theory of games. Cambridge University Press, Cambridge

Nowak MA (2006) Evolutionary dynamics. Harvard University Press, Cambridge

Raiffa H (1968) Decision analysis: introductory lectures on choices under uncertainty. Addison-Wesley, Reading

Real LA, Caraco T (1986) Risk and foraging in stochastic environments. Ann Rev Ecol Syst 17:371–390

Savage L (1954) The foundations of statistics. John Wiley, New York

Stephens DW, Krebs JR (1986) Foraging theory. Princeton University Press, Princeton

Stephens DW, Brown JS, Ydenberg RC (eds) (2007) Foraging: behavior and ecology. University of Chicago Press, Chicago

von Neumann J, Morgenstern O (1944) The theory of games and economic behavior. Princeton University Press, Princeton

Wilson EO (1975) Sociobiology: the new synthesis. Harvard University Press, Cambridge

Wilson EO (1979) On human nature. Harvard University Press, Cambridge

Yoshimura J, Clark CW (1991) Individual adaptations in stochastic environments. Evol Ecol. 5:173–192, 430 (Corrigenda)

Yoshimura J, Shields WM (1987) Probabilistic optimization of phenotype distributions: a general solution for the effects of uncertainty on natural selection? Evol Ecol 1:125–138

Yoshimura J, Tanaka Y, Togashi T, Iwata S, Tainaka K (2009) Mathematical equivalence of geometric mean fitness with probabilistic optimization under environmental uncertainty. Ecol Model 220:2611–2617

Yoshimura J, Ito H, Miller III, DG, Tainaka K (2012) Dynamic decision-making in uncertain environments I. The principle of dynamic utility. J Ethol (in press)

## Acknowledgments

This work was supported by grants-in-aid from the Ministry of Education, Culture, Sports, Science and Technology of Japan to J.Y. (nos. 22370010 and 22255004) and K.T. (no. 20500204).

### Open Access

This article is distributed under the terms of the Creative Commons Attribution License which permits any use, distribution, and reproduction in any medium, provided the original author(s) and the source are credited.

## Author information

### Affiliations

### Corresponding author

## Electronic supplementary material

Below is the link to the electronic supplementary material.

### 10164_2013_359_MOESM2_ESM.eps

Dynamic utility function, *u*=*u*(*g*;*w*) plotted against *g* with penalty (solid line) and without penalty (dashed line). Body sizes are *w* = 3. Penalty weight constants are *a* = 2, *b* = 2 (EPS 364 kb)

### 10164_2013_359_MOESM3_ESM.eps

The effects of proportional penalty on the wealth range of Allais paradox. (a) The combination of preferences along the current wealth when the penalty weight *a* = 2, *b* = 2, where the penalty \( f\left( r \right) = a\left( \frac{1}{r} \right)^{b} = a\left( {\frac{w}{g + w}} \right)^{b} \). (b) The range of Allais paradox (shaded area) on the current wealth *w*. while *x*
_{1} (= 0.1024; not shown) is constant, *x*
_{2} (solid line: *b*=2, doted line: *b*=1, dot-dashed line: *b*=3) increases with the two penalty weight constants *a* and *b* (EPS 491 kb)

## Rights and permissions

This article is published under an open access license. Please check the 'Copyright Information' section either on this page or in the PDF for details of this license and what re-use is permitted. If your intended use exceeds what is permitted by the license or if you are unable to locate the licence and re-use information, please contact the Rights and Permissions team.

## About this article

### Cite this article

Yoshimura, J., Ito, H., Miller, D.G. *et al.* Dynamic decision-making in uncertain environments II. Allais paradox in human behavior.
*J Ethol* **31, **107–113 (2013). https://doi.org/10.1007/s10164-013-0359-z

Received:

Accepted:

Published:

Issue Date:

DOI: https://doi.org/10.1007/s10164-013-0359-z

### Keywords

- Human decision-making
- Expected utility theory
- The Allais paradox
- Dynamic utility optimization