Analytical Results for Individual and Group Selection of Any Intensity
- 1.1k Downloads
The idea of evolutionary game theory is to relate the payoff of a game to reproductive success (= fitness). An underlying assumption in most models is that fitness is a linear function of the payoff. For stochastic evolutionary dynamics in finite populations, this leads to analytical results in the limit of weak selection, where the game has a small effect on overall fitness. But this linear function makes the analysis of strong selection difficult. Here, we show that analytical results can be obtained for any intensity of selection, if fitness is defined as an exponential function of payoff. This approach also works for group selection (= multi-level selection). We discuss the difference between our approach and that of inclusive fitness theory.
KeywordsEvolutionary game theory Stochastic effects Strong selection Group selection
Certain population structures allow selection to act on multiple levels. If a meta-population is subdivided into groups, there can be selection between individuals in a group and selection between groups. Many theoretical and empirical studies of group selection have been performed. Until the 1960s, it was a routine assumption that selection acts not only on the individual, but also on the group level (Wynne-Edwards, 1962). This idea goes back to Charles Darwin (1871), who wrote “There can be no doubt that a tribe including many members who […] were always ready to give aid to each other and to sacrifice themselves for the common good, would be victorious over other tribes; and this would be natural selection.”
Williams (1966) pointed out some problems in this argumentation and subsequently, many biologists dismissed the possibility of group selection. Mathematical models can show the limits of group selection (Maynard Smith, 1964; Wilson, 1975; Levin and Kilmer, 1974; Matessi and Jayakar, 1976). Wilson (1987) has shown that the failure of group selection in the Haystack model of Maynard Smith (1964) hinges on the assumption that groups stay intact until non-cooperators have taken over all mixed groups. Fletcher and Zwick (2004) have shown that in Hamilton’s group selection model (Hamilton, 1975) cooperation can evolve if groups stay intact for several generations. In many other models of group selection, cooperation can evolve (Eshel, 1972; Uyenoyama, 1979; Slatkin, 1981; Leigh, 1983; Wilson, 1983; Killingback et al., 2006; Traulsen and Nowak, 2006). Experiments have shown that artificial group selection can be effective (Wade, 1976; Craig and Muir, 1996; Swenson et al., 2000).
Kerr and Godfrey-Smith (2002) have argued that a group selection perspective can be helpful under many circumstances. Group selection arguments have been invoked for the evolution of the first cell (Szathmáry and Demeter, 1987; Maynard and Szathmáry, 1995) and for optimizing the number of plasmids in bacterial cells (Paulsson, 2002). Group selection might also have played an important role in human evolution (Wilson and Sober, 1998; Boyd and Richerson, 2002; Bowles, 2004; Bowles and Gintis, 2004; Weibull and Salomonsson, 2006; Traulsen and Nowak, 2006; Bowles, 2006). A recent paper by Wilson and Hölldobler (2005) argues that group selection is more important than kin selection for the evolution of social insects, see also (Reeve and Hölldobler, 2007). Wilson (2007) further questions the importance of kin selection for eusociality.
For some authors, group selection and kin selection are identical concepts (Lehmann et al., 2007). While there could be some overlap between these two mechanisms, we do not consider this to be a useful perspective, in general (Wild and Traulsen, 2007; Taylor and Nowak, 2007). We will return to this topic in the discussion.
Most models of multi-level selection are mathematically very complicated and can only be studied by computer simulation. Here, we consider a simple model that was introduced by Traulsen et al. (2005) and Traulsen and Nowak (2006). We show that this model leads to analytical results for any intensity of selection, if fitness is an exponential function of payoff.
This paper is organized as follows: In Section 2, we recall the frequency dependent Moran process describing a single, well mixed population and discuss the limit of weak selection, where the payoff of the game has only a small effect on fitness. In Section 3, we introduce an exponential mapping of payoffs to fitness and show that this approach leads to exact results for any intensity of selection. In Section 4, we turn to group selection and review the standard results obtained for a linear payoff to fitness mapping. In Section 5, we study group selection using the exponential mapping. In Section 6, we discuss the implications of our results.
2. The Moran process
Here, we restrict the discussion to games where coexistence of two strategies, as in the snowdrift game or hawk-dove game (Hauert and Doebeli, 2004), is not possible. In such cases, the fixation times can become extremely long (Traulsen et al., 2007; Antal and Scheuring, 2006).
3. A new mapping of payoff to fitness
Usually, a linear relation between payoff and fitness is assumed with no further justifi- cation. In most cases, a different payoff to fitness mapping does not change the qualitative outcome, only the speed of the process. An exponential mapping from payoff to fitness has exactly the same properties as a linear mapping in most cases, but it allows greater variation in the intensity of selection and is thus more general. Exponential functions to calculate fitness from model parameters have been used before (Aviles, 1999).
4. Group selection
Imagine a population of individuals that is subdivided into groups. The number of groups is constant and given by m. Each group contains between one and n individuals. The total population size, N, can fluctuate between the bounds m and nm.
In each time step, a random individual from the entire population is chosen for reproduction proportional to fitness. The offspring is added to the same group. If the new group size is less than or equal to n, nothing else happens. If the group size exceeds n, then with probability q, the group splits into two. In this case, a random group is eliminated in order to maintain a constant number of groups. With probability 1 − q, however, the group does not divide, but instead a random individual from that group is eliminated (Traulsen and Nowak, 2006).
This minimalist model of multi-level selection has some interesting features. Note that the evolutionary dynamics are entirely driven by individual properties. Only individuals are assigned payoff values. Only individuals reproduce and group splitting is triggered by individual reproduction. Groups can stay together or split when reaching a certain size. Groups that contain fitter individuals reach the critical size faster and, therefore, split more often. This concept leads to selection among groups, although only individuals reproduce. Higher level selection emerges from lower level reproduction. The two levels of selection can oppose each other (Williams, 1966; Wilson, 1975; Hamilton, 1975; Traulsen et al., 2005).We note in passing that the underlying population structure cannot be described by evolution on a fixed graph (Nowak and May, 1992; Lieberman et al., 2005; Ohtsuki et al., 2006, 2007b; Taylor et al., 2007).
While many group selection models consider group competition in terms of differential productivity of groups, here groups are eliminated and successful groups divide. Similar mechanisms where whole groups are taken over have been described before (Bowles et al., 2003; Chalub et al., 2006; Pacheco et al., 2006; Bowles, 2006).
We can compute the fixation probabilities. An analytic calculation is possible in the limit q ≪ 1 where a separation of time scales emerges, as individuals reproduce much more rapidly than groups divide. In this case, most of the groups are at their maximum size, and hence the total population size is almost constant and given by N = nm. We have a hierarchy of two Moran processes. Fixation of a mutant implies first fixation within the group and then fixation of the group’s strategy in the population. On a fast time scale, we have a frequency dependent Moran process within each of the groups. We have described this process in detail in Section 2. On a slower time scale, we have a frequency independent Moran process among pure groups. Once all groups are homogeneous, they stay homogeneous, as no mixing between groups occurs (for a model with migration, see Traulsen and Nowak, 2006).
If we add a single A individual to a population of B, then the A individual must first take over its group. Subsequently, this group of A must take over the entire population. Thus, the overall fixation probability of this process, ρ A , is the product of the fixation probability of an individual in a group, ϕ A , and the fixation probability of the group in the population, Φ A . We have ρ A = ϕ A · Φ A .
If the number of groups becomes very large compared to the group size, m≫ n, then A individuals have a higher probability of fixation than B individuals if a > d. In this case, mixed groups do not influence the dynamics and the Pareto optimal equilibrium is favored. If the number of groups is much smaller than the group size, m ≪ n, then A individuals have a higher probability of fixation than B individuals if A is risk dominant in a single, well-mixed population a + b > c + d (Nowak et al., 2004; Nowak, 2006a; Fudenberg et al., 2006). In the general case of finite n and finite m, the full condition (33) determines which fixation probability is larger.
5. The new mapping in the case of group selection
For strong selection, the comparison with the fixation probability of a neutral mutant is no longer meaningful. For instance, consider the interactions of cooperators and defectors. On the individual level, defectors perform better than cooperators, but a group of cooperators is better off than a group of defectors. For strong selection, a single cooperator will hardly ever reach fixation within a group, whereas a single defector group will hardly ever reach fixation in a population of cooperator groups. Thus, many attempts are necessary before either a cooperator or a defector can take over the whole population. Consequently, both ρ A and ρ B become very small as β → ∞. However, we can compare the fixation probabilities of the two strategies directly to each other for any intensity of selection. For any finite β, such a comparison is meaningful, but one has to keep in mind that for large β the fixation probabilities are small and many mutations are necessary before one of them reaches fixation.
Our analytical calculation is valid for small group splitting probability, q ≪ 1, only, but simulations show that larger values of q favor cooperators. The reason for this is that for larger q, groups tend to be smaller, as not all groups grow back to their carrying capacity. In addition, in this case often mixed groups split, which allows cooperators to take over groups without reaching fixation.
Our way to address arbitrary intensities of selection is very different from common approaches taking higher order terms in the intensity of selection into account. Higher order terms make the weak selection approximation more accurate, but the reference point remains neutral selection. Because of the limited convergence radius of such expansions, higher-order approximations cannot provide reliable information on general intensities of selection.
We have introduced a Moran process where the fitness is an exponential function of payoff. We have shown that the results of Traulsen and Nowak (2006) can be extended to any intensity of selection if this mapping from payoff to fitness is applied.
It has been argued that the model described in Traulsen and Nowak (2006) describes kin-selection. Wild and Traulsen (2007) and Lehmann et al. (2007) have shown that a special form of Eq. (40) can be derived using an inclusive fitness approach. The inclusive fitness approach uses a within-group and between-group relatedness. Although some of our results can be obtained using the mathematical framework of kin selection, there are several conceptual differences.
Our model considers two distinct pure strategies, A and B. In such a system, any selective scenario is possible on the individual level, see Taylor and Nowak (2007). The two types could engage in a coordination game, leading to a bistable situation. The two types could also form a stable polymorphism, leading to an internal equilibrium. Finally, one type can dominate the other, which is the situation considered in Traulsen and Nowak (2006). Weak selection is implemented in the sense that the two types have similar fitness values despite their distinct phenotypes.
In contrast, kin selection methods determine whether cooperativeness increases in a continuous phenotype space. Weak selection in such a system is usually implemented by considering two types that are close to each other in phenotype space. This concept leads to frequency independent selection if only the linear term in the phenotypic distance is considered (Wild and Traulsen, 2007). When higher order terms are considered, aspects of frequency dependence can be addressed (Ross-Gillespie et al., 2007).
The approach of Rousset and Billiard (2000) for calculating fixation probabilities in a kin selection framework hinges on the assumption of frequency independent selection. Hence, it does not necessarily lead to the same fixation probabilities for weak selection as in Traulsen and Nowak (2006). In fact, the same condition for the ratio of the fixation probabilities is only obtained if the payoff matrix fulfills a+d = b+c (Wild and Traulsen, 2007), which is a special situation that has been termed “equal gains from switching” (Nowak and Sigmund, 1990). Thus, our more general Eq. (40) cannot be obtained by current kin selection approaches, as the different weak selection assumption changes the condition.
Furthermore, inclusive fitness arguments use weak selection to decouple relatedness and fitness effects. Relatedness coefficients are calculated in a system without selection. Thus, for inclusive fitness calculations, weak selection is a necessity to avoid the intricacies of calculating relatedness in a system with strong selection, which is usually an insurmountable task. In contrast, for the approach of Traulsen and Nowak (2006), there is no necessity to consider the weak selection limit. Weak selection only serves to simplify the fixation probabilities and to obtain Eq. (33), which is easier to interpret than Eq. (30). In the present paper, we derive results that hold for any intensity of selection, see Eq. (40).
The mathematical methods of game theory in finite populations and inclusive fitness are very different and lead to the same results only in special cases. Inclusive fitness methods either use direct or indirect fitness evaluation, but this seems to be rather a different way to do the accounting (Fletcher et al., 2006; Fletcher and Zwick, 2006). The standard approach of evolutionary game theory is usually much simpler and more direct than the approach of inclusive fitness theory. Often the inclusive fitness approach leads only to a subset of the results and does not provide additional insights (An important exception, however, is the paper by Taylor et al., 2007, which leads to correction terms for finite population size that could not be reached by Ohtsuki et al., 2006.) Evolutionary game theory analyses the frequency dependent selection between two strategies, A and B. Inclusive fitness theory assumes a continuum of mixed strategies between A and B and then studies the direction of selection in this continuous strategy space. This approach has two problems: (i) for many games, mixed strategies are not meaningful; and (ii) such a local analysis need not have any implication for the original question concerning frequency dependent selection between the strategies A and B.
Finally, the biological concepts of group selection and kin selection should be kept distinct. Group selection arises when there is competition between groups and does not necessarily depend on genetic relatedness or genetic reproduction. The term kin selection was originally defined by Maynard Smith (1964) as referring to situations of genetic reproduction. Conditional strategies, such as different behavior toward siblings and cousins, depend on kin recognition. The idea of kin selection has given rise to a general method of analysis of structured populations (which can be useful, see Taylor et al., 2007), but the mathematical method should not be confused with the biological mechanism (West et al., 2007). Essentially, kin selection analysis captures the effects of assortment, which is a consequence of any mechanism for evolution of cooperation (Taylor and Nowak, 2007). The evolutionary dynamics of group selection and graph selection (Ohtsuki et al., 2006) are very different, although some aspects of both can be captured by inclusive fitness calculations. Kin selection models that are independent of group selection and graph selection should work in well mixed populations based on kin recognition.
The purpose of this paper was to show that an exponential payoff to fitness mapping allows analytical results for any intensity of selection, both in settings of individual and multi-level selection.
This article is distributed under the terms of the Creative Commons Attribution Noncommercial License which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
- Aviles, L., 1999. Cooperation and non-linear dynamics: An ecological perspective on the evolution of sociality. Evol. Ecol. Res. 1, 459–77. Google Scholar
- Bowles, S., 2004. Microeconomics—Behavior, Institutions, and Evolution. Princeton Univ. Press, Princeton. Google Scholar
- Craig, D.M., Muir, W.M., 1996. Group selection for adaptation to multiple-hen cages: beak related mortality, feathering, and body weight responses. Poultry Sci. 75, 294–02. Google Scholar
- Darwin, C., 1871. The Descent of Man. Murray, London. Google Scholar
- Hamilton, W.D., 1975. Innate social aptitudes of man: an approach from evolutionary genetics. In: Fox, R. (Ed.), Biosocial Anthropology, pp. 133–55. Wiley, New York Google Scholar
- Maynard, S., Szathmáry, J., 1995. The Major Transitions in Evolution. Freeman, Oxford. Google Scholar
- Paulsson, J., 2002. Multilevel selection on plasmid replication. Genetics 161, 1373–384. Google Scholar
- Slatkin, M., 1981. Estimating levels of gene flow in natural populations. Genetics 99, 323–35. Google Scholar
- Williams, G.C., 1966. Adaption and natural selection: A critique of some current evolutionary though. Princeton Univ. Press, Princeton. Google Scholar
- Wilson, D.S., Sober, E., 1998. Unto Others: The Evolution and Psychology of Unselfish Behavior. Harvard University Press, Cambridge. Google Scholar
- Wilson, E.O., 2007. What drives eusocial evolution? Preprint. Google Scholar
- Wynne-Edwards, V.C., 1962. Animal Dispersion in Relation to Social Behavior. Oliver and Boyd, Edinburgh. Google Scholar