The Dynamics of Sex Ratio Evolution: The Impact of Males as Passive Gene Carriers on Multilevel Selection

In game theoretic models, it is possible that not all individuals are active players exhibiting strategies; some of them are passive carriers of the strategy genes. A nontrivial illustration of this problem is the sex ratio evolution. The classical sex ratio models can be divided into two classes. The first class contains the static strategic models related to the Dusing–Fisher–Shaw–Mohler fitness measure, based on the reproductive value of the offspring of the focal female. The second class contains the population genetic models focused on the dynamics of allele frequencies. The approaches are not fully compatible because the strategic models disregard the role of the male individuals as the passive carriers of the strategy genes. In the previous two papers in this cycle, a new synthetic model combining the strategic analysis with more rigorous genetics and considering male carriers was presented. The new model shows that sex ratio self-regulation is a complex multistage process that can be regarded as an example of multilevel selection. One of the elements of this process is the dynamic equilibrium between passive male and active female gene carriers associated with convergence of the dynamics to the manifold termed the male subpopulation equilibrium (MSE). This paper attempts to explain this phenomenon and analyse its properties. We show that sex ratio self-regulation is the by-product of the convergence of the stable sex ratios in the monomorphic subpopulations of particular gene carriers to the MSE manifold. We present a method of derivation of static fitness measures from the dynamic model based on the double-level selection process. This will lead to a new fitness measure free from the bias of the classical approach. We also show that the classical Dusing–Fisher–Shaw–Mohler fitness measure is a biased approximation of the new approach and that an alternative simple approximation of the new approach is possible.


Introduction
Basic approaches to evolutionary game theory assume that the individuals are players, strategies are inheritable traits, and fitness constitutes the payoff. However, we can imagine situations where not all individuals that are carriers of the strategy genes are active interacting players. This can occur when sexual reproduction is explicitly considered and only one sex can express the strategies. The classical problem of this type is the evolution of the sex ratio, which was the first problem in evolutionary theory that involved mathematical reasoning. This was done by German biologist Carl Dusing [11]. He argued that the fitness of a female using a given sex ratio strategy could be described by the number of her grandoffspring. In the simplest version derived under assumptions of equal mortality rates and parental expenditures for both sexes, this function can be denoted in the following way: where P i is the individual strategy (offspring's sex ratio), P is the population sex ratio and k is the average brood size of the female. By the individual strategy, we understand that female control over offspring can be realized by selective abortions; this implies that the female individual can be assumed as the strategic agent. Note that (1) considers only the reproductive success of the focal female as the active strategic agent. The impact of males as passive carriers is not explicitly considered. The interpretation of (1) in the light of the new results will be discussed in this paper in Sects. 3.1 and 4. Similar verbal reasoning was proposed by Fisher (1930). By application of this fitness measure, it can be shown that the average female strategy of 0.5 is evolutionarily stable. This approach to strategic analysis has dominated the game theoretic literature [7,19,30,33,34]) and can be found in books on population genetics [10,20]. Sex ratio theory has inspired the development of other theoretic approaches, such as sex allocation theory [8,36] and local mate competition models ( [18]; Schall 2008). However, population genetics provides an alternative way of modelling sex ratio evolution based on the explicit tracing of the gene frequencies, mainly using discrete dynamics ( [12,13,20] and summarized in [20]) or other methods such as calculation of the ancestral paths [16,17]. In the population genetic models, evolution of states of subpopulations for both sexes is explicitly described by respective equations. Thus, the analysis is not limited to females as focal individuals as in Dusing's model (1). The population genetic approach produces different predictions from the basic phenotypic models. It shows that stable population states should be characterized by stable compositions not only of the female but also of the male subpopulation, not simply by the average strategy of females as in basic game theoretic approaches. This leads to the distinction between two classes of modelling approaches, phenotypic and genetic, related to the sex ratio [36]. The genetic models can be analysed and interpreted in the spirit of the ESS approach, i.e., they can be used in the analysis of the fate of the rare mutant in the resident population (see, for example, [9] for the sex ratio case, and in general [14,22,23]). However, these approaches do not use core game theoretic notions, such as explicitly derived strategic payoff functions. We can imagine a complementary approach in which basic game theoretic methods (payoff functions associated with continuous replicator dynamics) are extended by description of the underlying genetic structure. In two previous papers [3,4], an alternative synthetic approach to the modelling of sex ratio evolution was introduced. This was the first application of multipopulation replicator dynamics [2]. The new model focuses on the dynamics of sex ratio evolution and tries to combine the phenotypic strategic approach with an explicit genetic analysis. This new approach also combines game dynamics with sexual reproduction. It explicitly considers parental male individuals as the passive carriers of female sex ratio strategies (similarly to the population genetics models, [20]) that can be expressed by their daughters if they inherit the strategy from the father. This is important, since the rare invading mutants can be not only females but also males.
The first formulation of the model [3] focused on the trajectories of general population parameters ("global" in the sense that they affect the whole population), such as the primary and the secondary sex ratios, and showed that sex ratio evolution dynamics are biphasic. This is caused by the fact that simpler equations describing the male subpopulation and the secondary sex ratio converge to the neighbourhood of their attracting manifolds (nullclines) faster than the nonlinear dynamics of the female subpopulation (however, without separation of timescales). During the second, longer, phase, they follow the changes in their nullclines caused by the ongoing dynamics of the female subpopulation. During the first, shorter, phase, the population converges to equality between the primary and the secondary sex ratios.
In addition, another phenomenon can be observed, which is one of the topics of this paper. During the rapid phase, the male subpopulation is attracted by a unique state, conditional on the current state of the female subpopulation, called the male subpopulation equilibrium (thus the dynamics converge to the neighbourhood of the MSE manifold). This phenomenon is caused by the contribution of an individual to the fitness of individuals of other types (such as different sexes) by producing newborns of their type [3]. This result shows that the role of passive male carriers as fathers, not only as sons, is also very important. This means that the sex ratio of 0.5 cannot be regarded as just an example of the basic, single population evolutionarily stable strategy or state (ESS). However, this interpretation can be found in the basic textbooks [19,33,34]. In the sex ratio case, we need notions describing both sexes' subpopulations and the proportion between them (similarly to the population genetic models).
This riddle was partially solved in the second paper [4], which focused on the selection of genes encoding individual strategies ("local" scope focused on the dynamics of the subpopulations of carriers of the particular strategy genes). Selection of these genes depends only on sex ratios in carrier subpopulations rather than directly on trait values encoded by such genes (this self-regulation process can be called the Fisherian mechanism; see Sections 2 and 3.1 in [4] for details). However, sex ratios in carriers' subpopulations are determined by the action of female carriers of these genes and female partners of male carriers randomly drawn from the population in a process called the tug of war. This means that the activity of female carriers attracts the sex ratio among carriers of the particular gene to the value encoded by that gene, and the activity of random female partners attracts it to the actual value of the primary sex ratio. Then, the encoded traits are "local variables" affecting only the compositions of carrier subpopulations and are not explicitly visible in the "global" selection dynamics. The Fisherian mechanism and tug of war together constitute a process that can be regarded as double-level selection. Thus, the classical problem of sex ratio evolution is an important example in the current debate on the mechanisms of multilevel selection [25,26,32].
A question that arises concerns the role of the MSE phenomenon revealed by the first formulation [3] in the double-level selection process shown by the second formulation [4]. When the MSE state is reached, selection of strategies appears to work according to the values encoded by the genes. (This was shown by Lemma 1 in [3].) The new theory produces predictions similar to the classical theory; however, the mechanistic interpretation of the MSE phenomenon remained a mystery and will be analysed in the present paper. It should be emphasized that the MSE is a specific example of a more general problem. The impact of the passive carriers of unexpressed genes (strategies) on the proliferation of those genes (strategies) may appear in many applications of population genetics and evolutionary game theory. Similar dynamic population equilibria can emerge in problems other than sex ratio evolution, where some fraction of individuals does not exhibit inherited traits but transfer them to their offspring. However, sex ratio evolution is one of the many possible examples of complex self-regulation, where the passive gene carriers play an important role in the underlying mechanisms operating on many levels.
Therefore, the main goal of this paper is to show the importance of the passive carriers in the population processes. We will investigate the relationships between the MSE mechanism from [3] and the dynamic self-regulation mechanisms from [4] (i.e., the Fisherian mechanism and the tug of war) and their relationships in the process of double-level selection. Those results will allow for a comparison of the classical Dusing-Fisher-Shaw-Mohler fitness measure with an analogous static fitness function prepared according to the new approach. The next step is an investigation of the role of the MSE in the adjustment of the sex ratios in carriers' subpopulations, which will reveal intriguing properties of the MSE manifold.
The following subsections will recall the formal details of the models presented in [3,4] and briefly summarize the results obtained there. Starting in Sect. 2, new results will be presented.

Details of the Model
Assume that strategies are expressed by female carriers as in basic game theoretic approaches and in Dusing's model [11]. There are u arbitrarily chosen individual strategies encoding the sex ratio among newborns of the female, described by P i ∈ [0, 1]. There are x i female and y i male carriers of the strategy P i in the population. Therefore, the population consists of x = i x i females and y = i y i males. Thus, f = [ f 1 , . . . , f u ] is the vector of frequencies of strategies of the female subpopulation, and m = [m 1 , . . . , m u ] is an analogous vector for the male subpopulation (where f i = x i /x and m i = y i /y). P = y/(y + x) is the fraction of males in the population (a secondary sex ratio), and j f j P j is the mean female subpopulation strategy (the primary sex ratio). Assume that each female produces k offspring according to haploid inheritance (with probability 0.5 for gene transfer from the focal parent). However, males are also gene carriers and transfer those genes to their offspring of both sexes. The influence of males can be described by the fitness exchange effect (i.e., daughters of male carriers affect the payoff of female carriers and sons of females affect the payoff of males). This allows for derivation (which is outlined in "Appendix 1") of the following sex-specific payoff functions, describing explicitly the effects of sexual reproduction: Note that the structure of the above functions, describing growth rates proportional to the average per capita number of produced newborns of the same sex and strategy, explicitly describes the impact of sexual reproduction. Therefore, the obtained replicator dynamics (asexual in general) will also describe sexual reproduction. Now we have all elements needed to formulate the multipopulation replicator dynamics [2]. In the first paper [3], this took the following form: are the respective average payoff functions of the male, the female and the whole populations (see [3] Appendix D for derivation). This leads to the following system of equations (see [3] Appendix E for the derivation): It was shown that, for biological reasons, we can limit the analysis of the model to values of the primary and the secondary sex ratios over the interval (0, 1). The above formulation is similar to population genetic models and is focused on the composition of the whole population. Subsystems (5) and (6) have a simple linear form and are rapidly attracted to close neighbourhood of their nullclines, which are male subpopulation equilibrium (discussed in the next section) and the equality of the primary and the secondary sex ratios. After that, during the second phase, the subsystem (4) slowly converges to its equilibrium. The state of the male subpopulation and the secondary sex ratio trace their nullclines, remaining in their close neighbourhood. During the transition between the fast and slow phase, quantitative changes in behaviour of the dynamics of (4) can occur [3]. The system converges to the state with an average female strategy (primary sex ratio) of 0.5 when it is possible (when 0.5 can be a linear combination of the strategy values) or to the monomorphic population of individuals carrying the strategy closest to 0.5. In [4], the model was modified by a change in coordinates where G = G 1 , . . . , G u−1 is the vector of gene frequencies in the whole population (where is the vector of the sex ratios in the subpopulations of carriers of the same strategy genes. This allows taking the perspective of a gene as a strategic agent. The fitness function of a gene encoding strategy P i (interpreted as the average payoff of the adult carrier of the ith gene) described in the above coordinates and discussed in detail in Section 2 of [4] and Appendix B in [4] is therefore: Note that the fitness function W g is independent of the value encoded by the individual strategy P i . The fitness of a gene is determined by the sex ratio in a subpopulation of its carriers, M i . This leads to an alternative form of replicator equations [4]: which take the forṁ whereP pr = j f j P j . An analysis of the replicator equations based on the fitness function W g (see [4] sections 3.1 and 4.2) shows that changes in a gene pool can be described by the following inequalities.
G i increases when P < 1 2 and P < M i or P > 1 2 and P > M i , This process can be described as the Fisherian mechanism (see sections 3.1 and 4.2 in [4] for details). Thus, gene pool dynamics (8) depends on the current value of the secondary sex ratio P and the sex ratio in the subpopulation of carriers of a gene M i . The signs of the right-hand sides of Eq. (9) are determined by two bracketed terms. The first term P pr − M i is weighted by the fraction of male carriers M i multiplied by average per capita number of their partners (1 − P) /P. The second term (P i − M i ) is weighted by the fraction of female carriers (1 − M i ). Thus, the dynamics of parameter M i (9) is determined by the action of female carriers of strategy P i as well as partners of male carriers of this strategy in a tug of war mechanism, which means that the activity of female carriers (the second term) attracts M i to the value encoded by the gene P i and the action of partners of male carriers (the first term) attracts M i to the value of the females' average strategyP pr . In [4], it was shown that for P i ∈ (0, 1] a unique attracting nullcline exists within the interval P pr , P i . For P i = 0, the state M i = 0 can be stable in some specific cases (not important for this study).

The Male Subpopulation Equilibrium Phenomenon
The role of the male subpopulation composition was shown by population genetic models of sex ratio evolution [12,13,20,29]. In the MSE state (see sections 2.2 and 5.2 in [3] for details), lying on the nullclines of Eq. (5), the condition is satisfied for all strategies, and the subpopulation of males is in the state m MSE = f 1 P 1 /P pr , . . . , f u P u /P pr . The dynamics of the female subpopulation are then described by the rules (according to Lemma 1 in [3]): Note that this mechanism is similar to the Fisherian mechanism of evolution of gene frequencies (10). This suggests that the role of the MSE is important in the process of sex ratio self-regulation. The influence of male carriers is more important for the behaviour of the system than the value of the secondary sex ratio P. The MSE is described by the nonintuitive condition f i P i = m iPpr . This paper will attempt to elucidate the nature of the MSE and specify how it affects the Fisherian and tug of war mechanisms.

The Goals of the Paper
In this paper, we will analyse three problems related to the framework presented above: (a) We will calculate the equilibria of the tug of war dynamics (9) and analyse its relationships with the MSE equilibrium (11). (b) Using the results from point a) and the gene fitness function (7), we will construct the unbiased static fitness measure and compare it with the simplified approximation based on the assumption of the MSE equilibrium and the classical fitness measure (1). (c) We will analyse the quantitative properties of the MSE phenomenon and explain the underlying feedback mechanism.
Thus, the next section starts the presentation of the new results.

MSE as a Dynamic Equilibrium of the Demographic Process
Let us focus on the interpretation of the MSE phenomenon. Some insight into its nature will be revealed below. At the equilibrium of the selection process, the composition of the population (fractions of different strategies and sexes) will reflect the fractions of different types of individuals among newborns being introduced into the population. Thus, for example, the fraction of the male carriers of gene P i (which is y i /N ) should be equal to the respective proportion of P i male newborns produced (equal to f i P i ). Note that the summation of the above relationships over all strategies y i /N = f i P i leads to the condition P =P pr . Due to this condition, for each strategy, we can rescale the relationship y i /N = f i P i to the fractions among male newborns and adults by y i / y j = f i P i / f j P j . In effect, we obtain the MSE condition (11) denoted in the form m i = f i P i / f j P j . This means that in the MSE state, the fraction of adult P i males among all males is equal to the fraction of P i male newborns among all male juveniles produced by female carriers of the genes. Thus, equality of the primary and secondary sex ratios is closely related to the MSE phenomenon. In the next sections, we will use those conditions together many times to prove interesting relationships.

The Relationship Between the MSE and the Tug of War Mechanism
As shown in the previous article [4], the sex ratio of the subpopulation of carriers of a given gene is self-regulated by the so-called tug of war mechanism mentioned here at the end of Sect. 1.1; this mechanism is described for each strategy by Eq. (9). Lemma 1 in [4] states that the above dynamics have a single stable restpoint. We can calculate this restpoint, define the symbol = (1 − P)/P as in [4]. Restpoints of (9) will satisfy the equation: which can be presented in the form which collapses to a linear equation with solutionM i = P i / 1 + P i −P pr for = 1. Thus, the unique equilibrium from the interior of the interval (P i ,P pr ) ( [4], Lemma 1a) should be one of the roots of the above quadratic equation. Numerical solutions show that this will bẽ Note that (13) is a monotonically increasing function of P i for < 1 and > 1, which is determined by the factor 4P i (1 − ) in the numerator and factor (1 − ) in the denominator. A question arises concerning the relationships between the MSE phenomenon and equilibria and the dynamics of the tug of war process. The answer to this problem is described below by the following lemmas. Consider first the form of the MSE from the point of view of the sex ratio in the carrier subpopulation M i .

Lemma 1
The MSE condition (11) for strategy P i , according to the current value ofP pr , is equivalent to the following sex ratio among P i gene carriers: For proof, see "Appendix 2". Therefore, the MSE state is equivalent to the unique sex ratio in the carrier subpopulation M i . Let us focus on the role of M i in the tug of war process, which is revealed below. (9) is attracted by the point

Lemma 2 (a) For M i and the current value ofP pr , the dynamics
For a proof, see "Appendix 3". Point a) shows that in general M i is not an equilibrium of the tug of war mechanism (which isM i when carriers' sex ratio equals M i ). Point b) shows the properties of a steady state when the equilibria of the tug of war mechanism are on the MSE manifold. The value of M i determined by the MSE of the individual strategy P i (14) is very important. This parameter is an argument of the fitness function of a gene W g (7). Let us focus on the relationships Let us illustrate this problem by numerical examples. Figure 1 shows the trajectories of the gene frequency dynamics (8) and the respective trajectories of the carrier sex ratio dynamics (9). The dynamics of gene frequencies is determined by the underlying dynamics of the carriers' sex ratios and the secondary sex ratio, according to the rules (10). The growth or decrease in a particular gene frequency is determined by the excess of its carriers' sex ratio M i from the secondary sex ratio P and the deviation of P from 0.5. The trajectories of the dynamics of the carriers' sex ratios mainly show the following pattern, depicted in Fig. 2. The trajectory is attracted by the equilibrium of the tug of war mechanismM i and follows its changes. The equilibriumM i converges toM i , which is attracted by the MSE manifold represented by M i . Thus,M i can be regarded as the approximation ofM i in the neighbourhood of the MSE manifold. Therefore, different strategies are attracted by different values ofM i (which converge to the respectiveM i ), and through these values they can be distinguished by natural selection operating on a second, higher level. We can use this prediction for the construction of the unbiased static fitness measures, free from disadvantages of the classical DFSM fitness measure. This will be the subject of the next section.

Construction of the Static Fitness Measures
This section examines the results of the classical theory according to the new approach. We can construct static fitness measures using the attractors of the carriers' sex ratio obtained in the previous section. These fitness measures will assign fitness to the individual strategy under the assumption of equilibrium of the tug of war process. When we substituteM i from (13) into the gene fitness function (7), we obtain the following static fitness function based on the assumption that the tug of war process has reached its equilibrium: This function is quite complicated. However, in a sufficiently close neighbourhood of the MSE manifold,M i (13) can be approximated byM i (15), which can be substituted into (7). This leads to the approximation of (16) by the much simpler function The classical static fitness measure (1) (described as the DFSM function in [3]) relies on the number of grand offspring of a female that express her individual strategy. It can be presented as Note that the secondary sex ratio P in the above function describes the state of the population when the offspring of the focal female become mature. An additional assumption of nonoverlapping generations implying P =P pr allows for the description of (1) as a function of the strategic composition of the population. However, we have shown that the condition P =P pr in continuous models can be satisfied at an equilibrium of (6) only. This suggests that the condition P =P pr assumes that offspring will interact only with their peers, and individuals of other generations are disregarded. Thus, in the general case, we can only assume P ≈P pr as a simplified approximation. However, numerical simulations show that it can be quite good, and the bias is not serious in many cases.
We can now compare fitness function (16) with its approximations (17) and (1) to estimate the bias. Let us assume for simplicity that the mean brood size of a female is k = 2, which will remove this parameter from both formulae. In addition, assume for simplicity that P ≈P pr (then = (1 −P pr )/P pr ) to reduce the dimensionality of the system. Then, the fitness functions (16), (17) and (1) expressed in parameters P i andP pr will have form  (14). With convergence to the MSE, the valuesM i approach the neighbourhoods of their approximationsM i (15) W (P i ,P pr ) = 1 − 2P pr P pr P i + 1.
All three functions are constant and equal to 1 forP pr = 0.5; in addition, functionsW and W are equal to 1 − P i forP pr = 1, while functionŴ is equal to 1 − 2P i P i +1 . The classical fitness measure W is a linear function of the parameter P i , whereas the new fitness measureW and its approximationŴ are nonlinear. Figure 3 shows the plots of all three functions. The classical fitness function mainly overestimates the new fitness functionW , while the approximationŴ always underestimates it. Figure 4 illustrates this bias by plots of overestimation in the case of the classical fitness function W (in cases when W underestimatesW , the plot shows negative values) and underestimation in the case of the approximationŴ to show the excess of both functions fromW . It shows thatŴ is a good approximation in the neighbourhood ofP pr = 0.5. The classical DFSM function W is always significantly biased, except for the casesP pr = 0.5 andP pr = 1 when it is equal toW . Thus, the classical fitness function W is a biased approximation, which may have serious implications when modelling detailed population dynamics. The interpretation of Fig. 3 Plots of the static fitness functionW (P i ,P pr ), its approximationŴ (P i ,P pr ) and the classical DFSM fitness function W (P i ,P pr ). The functionŴ (P i ,P pr ) is bounded, while the function W (P i ,P pr ) increases significantly faster thanW (P i ,P pr ) the classical DFSM fitness measure as a Malthusian growth rate is problematic from the perspective of the new model. In the relatively wide neighbourhood of the equilibrium valuē P pr = 0.5, the functionŴ (P i ,P pr ) is a much better approximation.

Relationships Between Fitness Functions
The DFSM function (1) has an interesting relationship with the gene payoff function (7) and the female payoff function (3).
In the neighbourhood of the MSE manifold (which can be presented in the form m i / f i ≈ P i /P pr ), after substitution of the MSE condition and P ≈P pr into the sex-specific female payoff function (3), we obtain W (P i , P) ≈ W f k/2 (where k/2 is the reproductive value of a female). Note that both fitness functions describe the payoff of the focal female. The DFSM function counts offspring of both sexes but disregards the contribution of males from the parental generation. On the other hand, the female payoff function (3) considers the contribution of males from the focal female's generation, but counts only female offspring. Thus, when multiplied by k/2 to count grand offspring, this function disregards the contribution of males from the offspring generation. FunctionsŴ (P i ,P pr ) and W (P i ,P pr ) are approximations ofW (P i ,P pr ).Ŵ (P i ,P pr ) always underes-timatesW (P i ,P pr ), while W (P i ,P pr ) mainly overestimates it. The figure shows the plots of underestimation by the functionW (P i ,P pr ) and overestimation by the function W (P i ,P pr ) from two different points of view. In the relatively wide neighbourhood of the equilibrium valueP pr = 0.5, the functionŴ (P i ,P pr ) is a better approximation than W (P i ,P pr ) The relationship with the gene payoff (7) is the following: when we assume M i = P i , then we obtain W (P i , P) = W g (P, P i )k/2. This leads to an interesting interpretation. Suppose that a single mutant female produces all carriers of a mutant gene P mut in the next generation according to the expression of her individual strategy. Thus, in the generation of her descendants, there is equality M mut = P mut , and the reproductive success of a mutant gene in the first generation of descendants is proportional to ( P mut + (1 − P mut )). It is clear that the predictions of this function are exactly the same as in the DFSM model. This also supports the compatibility of linearization of a limit case of the population genetic model [29] with the DFSM approach. A problem arises in further generations. For each female carrying mutant gene P mut , there is some number of male carriers of the unexpressed gene P mut acting as fathers. The DFSM fitness measure, which is related to the number of a female's grand offspring, disregards the role of male parents on gene proliferation. Thus, the classical fitness measure can be seriously biased in cases where an entire subpopulation carries a mutant gene, not just a single female. This bias may be strong for strategies close to 1 that produce mostly males.

Impact on the Fisherian Selection Mechanism
The gene payoff function (7) leads to the dynamics (8), which leads to the selection rules (10). Now let us look at the simplified models of selection mechanisms, based on the rules (10), implied by the fitness functions (18), (19) and (20). According to (10), the threshold between increase and decrease in a gene frequency G i is the equality of the actual carriers' sex ratio M i and the secondary sex ratio P = G i M i . Straightforward substitution of (13) or (15) or the MSE condition (14) to the condition M i = P, followed by substitution of P ≈P pr in each case, leads to the same threshold P i =P pr , which is the solution of the obtained equations. (For (13) and (14), there is a second solutionP pr = 1 that is biologically meaningless.) Thus, in the rules (10), P i will replace M i andP pr will replace P leading to G i increases whenP pr < 1 2 andP pr < P i orP pr > 1 2 andP pr > P i , Thus, in the above cases, selection of the genes acts according to the values of individual strategies. However, the selection process at the gene level should be synchronized with the adjustment of the primary sex ratioP pr determined by the state of the female subpopulation. The relationship between the gene pool and the female subpopulation is , which combined with expressions (13) or (15) will be highly complicated. In the case of the MSE state, this relationship is very simple.

Lemma 3 If the MSE condition (11) is satisfied, P ≈P pr and the population is in a polymorphic state, then
For a proof, see "Appendix 4". This result shows that on the MSE manifold, changes in gene frequencies are synchronized with changes in the mean female subpopulation strategy (the primary sex ratioP pr ). This explains the similarity between rules (21) and rules (12). Substitution of the MSE condition into (4) leads to the simplified approximation of the dynamics of the female population [3] which resembles the gene pool dynamics (8), where f i , P i andP pr replace G i , M i and P. Note that according to the similarity of the DFSM fitness function W (P i ,P pr ) and the female payoff function (3) under the MSE condition (as shown in Sect. 3.1), system (23) can be regarded as the replicator dynamics of the DFSM fitness function. Thus, the selection mechanisms induced by functionsW (P i ,P pr ) andŴ (P i ,P pr ) are similar to the mechanism induced by the classical DFSM fitness measure but are not necessarily well synchronized with the adjustment of the primary sex ratio. This synchronization will increase with the convergence to the MSE manifold. Thus, it is time to look more closely at the properties of the MSE manifold, the attractor of those emerging mechanisms.

The Effect of the MSE on the Sex-Specific Payoff Functions (2) and (3) and the "Fitness Exchange" Effect
Now let us examine the population structure on the MSE manifold. Since f i = x i /x and m i = y i /y, the MSE condition (11) is equivalent to This means that the product of the number of females per single male x/y and the primary sex ratio in the entire population j f j P j is equal to the analogous coefficients for monomorphic subpopulations of carriers of any gene P i . This property can be generalized.
Consider the subpopulation (described by index ) consisting of all carriers of arbitrarily chosen strategies. The strategic composition of subpopulation can be described by the vector of strategy indices d = [d 1 , . . . , d u ] (for example, d = [1,3,4] means that all carriers of strategies P 1 , P 3 , P 4 are included in the subpopulation ). Assume that is the number of females per single male individual in the subpopulation . Analogously, assume thatP pr is the mean strategy of females from subpopulation (i.e., the subpopulation primary sex ratio). This leads to the interesting property described by the following lemma.

Lemma 4 When the MSE condition is satisfied, then for every arbitrarily chosen subpopulation , the following condition is satisfied:
In particular, P pr = i P i for a monomorphic subpopulation of carriers of strategy P i for which i = x i /y i . For a proof, see "Appendix 5". Note that the transformed MSE condition (24), which is a cornerstone of the above result, contains the term x i /y i which describes the number of female carriers per single male carrier.
Recall that male and female payoff functions (2) and (3) describe numbers of newborns of the same sex and carrying the same strategy as the focal individual. This term is present in the male sex-specific payoff function (2) and describes the contribution of female carriers to the payoff of a focal male individual. This phenomenon was termed the "fitness exchange" in [3].
Let us examine the form of the payoff functions when a population is in the MSE state. Lemma 5 describes the quantitative properties of the "fitness exchange" mechanism in the MSE state and its impact on sex-specific payoffs.

Lemma 5 When the MSE condition is satisfied and P ≈P pr , then (i) The female contribution is x i
y i W f m = k 2 P pr and a male's payoff (2) has the form W m = k P pr .
(ii) The male contribution is y i x i W m f = k 2 P i , and a female's payoff (3) has the form (iii) The MSE condition (11) is equivalent to which means that all female carriers of gene P i produce the same number of sons as the partners of all male carriers of that gene.
For a proof, see "Appendix 6". In addition, we can generalize point (iii) from Lemma 5 to the following property:

Lemma 6
In the MSE state, the reproductive value of the contribution of the opposite sex gene carriers to the payoff of the focal individual equals the reproductive value of the newborn male carriers produced by that individual.
For a proof, see "Appendix 7". It was mentioned in Sect. 3.1 that on the MSE manifold, the female payoff (3) resembles the DFSM payoff function. Here, this is completed by the respective form of the male payoff (2), showing that on the MSE manifold, all males have the same payoff equal to the number of sons of their partners despite the carried gene k P pr . Thus, the male payoff is the same for all strategies, while the female payoff depends only on the focal female's individual strategy. This suggests the existence of a feedback mechanism allowing females to control their payoff by affecting the male subpopulation. The differences in the payoffs between males carrying different genes correspond to the effects of differences in their "sisters"' activities (female carriers of the same gene), which is determined by the factor x i /y i (the number of female carriers per single male carrier). If this factor has a high value, then male carriers of this gene will experience a greater growth rate. However, when the number of male carriers y i increases, then the factor x i /y i will decrease (see Fig. 5).
This will cause a decrease in the influence of female carriers on the payoff of the average male carrier. This process will lead to an equilibrium state in which the influence of female carriers for all male carriers is the same.
How does this mechanism affect the female subpopulation? For different strategies, we will have different values of the factor x i /y i . The contribution of male carriers to female fitness is determined by the coefficient y i /x i for every strategy (a ratio-dependent mechanism, [1]). Female carriers of different strategies exert continual pressure on the equilibrium state of a male subpopulation by introducing different numbers of new male carriers. In effect, female individuals indirectly control the feedback impact of male carriers on their own fitness.

Discussion
Summarizing, in this paper we have shown that the causal chain underlying sex ratio selfregulation towards the value of 0.5 is more complex than was previously thought. The males as the passive carriers play an important role in this process; thus, the analysis cannot be reduced to the females. This phenomenon is the by-product of the convergence of the stable sex ratios in the monomorphic subpopulations of the carriers of the genes encoding the same strategies to the MSE manifold. This means that the trajectories are attracted by the equilibria of the tug of war process (the adjustment of the carriers' sex ratios by the activity of female strategy carriers and random female partners of male strategy carriers), and those attracting manifolds converge to the MSE manifold. Thus, the results obtained correct the intuitions from [3]. The rapid phase of the dynamics is responsible for the convergence to the equilibria of the tug of war mechanism. Indeed, the dynamics converge to the neighbourhood of the MSE manifold and the equality of the primary and secondary sex ratios, but it will reach them at the global equilibrium of the system. In addition, we have shown that in the neighbourhood (a) (b) Fig. 5 Mechanistic explanation of the male subpopulation equilibrium. Partners of every male produce the same number of offspring carrying his gene ( k 2 P pr ), so the differences in payoff are the effects of differences in the activity of female carriers of the same gene. The influence of female carriers is determined by the factor x i /y i (the number of female carriers per single male carrier). If this factor has a high value (more females per single male), then male carriers of this gene will have a larger growth rate (this situation is presented in panel a). However, when the number of male carriers y i increases, then factor x i /y i will decrease, which will cause a decrease in the influence of female carriers of the gene on the payoff of the average male carrier of the same gene (panel b). This process will lead to an equilibrium state in which the influence of female carriers on all male carriers is the same of the MSE manifold, the tug of war equilibrium can be approximated by a much simpler formula. Numerical simulations confirm that this approximation can be acceptable. The above result can be used for the derivation of the unbiased static fitness function and its simplified approximation. When the deviation of the sex ratio is not far from the equilibrium value, then the new approximation is better that the classical Dusing-Fisher-Shaw-Mohler fitness function, which is more seriously biased.
On the MSE manifold, selection of the genes is driven by the excess of the encoded individual strategy (phenotypic trait) from the primary sex ratio, and the two variables are equal. The first is the reproductive value of the contribution of the opposite sex gene carriers to the payoff of the focal individual, and the second is the reproductive value of the newborn male carriers produced by that individual. In addition, for all subpopulations containing all carriers of some subset of strategies, there is equality of the products of the number of females per single male and the average strategies of those females. All of those phenomena are revealed by the focus on the passive gene carriers. In problems other than sex ratio evolution, explicit analysis of the impact of the passive carriers can reveal interesting mechanisms.

The Dusing-Fisher-Shaw-Mohler Model from the Perspective of the New Approach
The classical DFSM fitness measure is based on the reproductive value of the offspring of the focal female, which will be determined by the secondary sex ratio when they become mature. We can describe this fitness measure as a proper frequency-dependent game theoretic payoff (not as in the "playing the field" approach where the environment is not explicitly determined by the population state) by incorporation of the strategic composition. This can be obtained by the simplifying assumption of the equality of the primary and secondary sex ratios. However, numerical simulations show that in continuous models, this assumption holds only at equilibrium. Thus, this approach will be unbiased only in the case of nonoverlapping generations. In other cases, it will disregard the individuals that are not peers of the offspring of the focal female. Thus, the DFSM fitness measure is equivalent to the reproductive value of the sex-specific female payoff on the MSE manifold. Both of these approaches are biased, simplified approximations of the new approach related to the gene perspective. However, they are compatible with the new approach at the level of the strategic analyses and produce the same game theoretic predictions regarding the female subpopulation. A disadvantage of the classical sex ratio game is the fact that it disregards passive male gene carriers as fathers mating with other females. They are considered only as the sons of "mom's" [8]. The strategic agent is the female individual. However, invasions of males or mutations in male individuals are possible. This study shows that the DFSM model can be considered as an approximation under the assumption that the male subpopulation is very close to equilibrium and cannot be perturbed. This produces several problems. The first is that the evolutionarily stable equilibrium (the sex ratio of 0.5) is described as a state of the female subpopulation. The male subpopulation is not explicitly considered. However, the new model also shows that the state of the male subpopulation is important, and the sex ratio of 0.5 can be unstable for perturbations of that state [3]. This is an important problem, because the sex ratio game is a basic example of a nonlinear payoff function in every textbook on evolutionary game theory. Thus, the composition of the subpopulation of passive gene carriers should also be considered in the concepts of evolutionary stability. Classical population genetics results support these predictions [12,13,20,29]. In the new approach, the strategic agent is the gene encoding the sex ratio strategy. This perspective is free of the above disadvantages and leads to new interesting predictions, such as the tug of war mechanism and double-level selection. It is also consistent with classical population genetics results. A second problem is a bias in the estimation of reproductive success, which is problematic on the grounds of population dynamics. This is an example of the disadvantage of purely strategic models mentioned by Oster and Rocklin [27]; more on this topic can be found in [6,35]. In effect, the basic interpretation of the payoff as the Malthusian growth rate is problematic in the case of the classical sex ratio game. (A dynamic model based on Dusing's approach was discussed in Sect. 4 and can also be found in [24].) This paper establishes an alternative methodology for derivation of the static fitness functions. It is based on the substitution of the equilibrium of the carriers sex ratio, determined by the encoded strategies and modelled inheritance system, in the gene payoff function describing the Fisherian mechanism. It was shown in this paper that we can derive an unbiased fitness function in this way. It was also shown that it can be approximated by a simpler function that produces a better approximation for relatively small perturbations than the classical DFSM fitness function.

The Mechanistic Nature of the Convergence to the MSE Manifold
The results presented above attempt to interpret the MSE phenomenon. They suggest that the MSE constitutes a compensatory equilibrium between the production of female carriers of a gene by passive male carriers and the production of male carriers by female individuals. As was mentioned in the introduction, the MSE is an example of a more general class of problems. The MSE is related to population phenomena, such as stable demographic structure or Hardy-Weinberg equilibrium. In the new model, there is no demographic structure. However, existing models that include demographic structure [31] report different behaviours before and after demographic equilibrium is reached. The MSE properties presented in this paper represent effects of haploid inheritance and the assumption that an individual strategy is encoded by a single gene. However, other forms of self-regulation structures are possible for different inheritance systems (diploid or haplodiploid) and different genetic structures (multilocus or polygenic). We can imagine a version of the model where the offspring sex ratio is controlled by males and the females are passive carriers since they cannot apply selective abortions. Here, strategic analysis of phenotypic adaptation meets population genetics. Strictly genetic mechanisms may play important roles in the process of phenotypic selection by determining the values of crucial parameters (e.g., the sex ratio in a carrier subpopulation) that are responsible for the selection of individual strategies. Future extensions of the present model containing more realistic genetics (for example, polygenic and haplodiploid) describing the system observed in some living organism can be tested experimentally, similar to the classical experiments [5,21]. This situation can also be tested by individual-based models. Similar dynamic equilibria should be observed in every model where there are passive carriers of unexpressed strategy genes. We can imagine many problems, such as the Hawk-Dove game, related to mating conflicts where only the males are active competitors. This problem is not just related to biological models. In economics and social sciences, there are also possible situations where only a part of the population is engaged in the game interaction, and the strategies can be transferred verbally among the passive members of the population. Game theory is focused on individuals who play the games; however, those who do not play the games can also be important. probability j f j P j for a male and j f j 1 − P j for a female newborn) carrying the strategy gene from the focal parent (with probability 0.5). Single female will have k trials and the sex for every newborn will be determined by her strategy. Then, W f m = 0.5(1− P i )k is the number of female offspring, and W f f = 0.5P i k is the number of male offspring, of the female individual (k trials for a single female). Analogously, W mm = 0.5 j f j P j xk y is the number of male offspring, and W m f = 0.5 j f j 1 − P j xk y is the number of female offspring of the male individual carrying the same gene. Due to sexual reproduction, we should take into account newborns produced by carriers of the opposite sex than the focal individuals. They should be equally distributed among focal individuals to add the contribution of the opposite sex carriers to their growth rates. Therefore, we have the payoff functions describing average growth rates for males and females, respectively, as describing per capita number of newborns of the same sex and carried strategy as the focal individual.

Appendix 2
Proof of Lemma 1 Assume that the male subpopulation equilibrium condition m iPpr = f i P i is satisfied. Recall from [4] that Then, the MSE condition can be written in the form and thus M i 1 + P i P pr = P i P pr , which gives M i P pr + P i P pr = P i P pr .
The male subpopulation equilibrium condition is therefore equivalent to the following sex ratio value in the carrier subpopulation: M i = P i P pr + P i M i = P i 1 −P pr + P i whenP pr = P .
which ends the proof.

Appendix 3
Proof of Lemma 2 Because f i = x i /x and m i = y i /y, according to the MSE condition (11), we have where i = 1−M i M i = x i y i and = 1−P P = x y . The equation for the sex ratio in the carrier subpopulation (9) has the forṁ For every value of M i from the interior of the unit interval, the right-hand side of this equation can be presented in the form Thus, by substitution of (27), we can transform (28) to Let us find the zero point from the interior of the unit interval of the right side of the equation transformed to the above formula: Substitution of P =P pr implies P i +P pr 2 = (1 −P pr )P pr +P pr P i ⇒ (0.5 −P pr )P pr − (0.5 −P pr )P i = 0 ⇒ (0.5 −P pr )(P pr − P i ) = 0.
Thus, equality M i =M i can be satisfied for all i only when P =P pr = 0.5. This constitutes the end of the proof.

Appendix 4
Proof of Lemma 3 G i can be presented in the form (see [4] section 2) By substituting m i ≈ f i P ī P pr (according to MSE condition (11)) and P ≈P pr , we obtain G i ≈ P f i P ī P pr + (1 − P) f i = f i P P pr P i + (1 − P) = f i P i + 1 −P pr , which completes the proof.

Appendix 5
Proof of Lemma  When we multiply this condition by x y , we obtain x yP pr = x y P pr , that is P pr = P pr , completing the proof.

Appendix 6
Proof of Lemma 5 Because f i = x i /x and m i = y i /y, from the MSE condition (1), we have y i y j f j P j = x i x P i .
Thus, x i y i = P pr P i (then y i x i = P i P pr ). When we substitute this coefficient into the payoff functions of males, which takes the form (in terms of auxiliary symbols andP pr ) W m = W mm + x i y i W f m = 0.5 P pr k + x i y i 0.5P i k, then coefficient x i y i 0.5P i k, which describes the per capita normalized number of new male individuals produced by female carriers of strategy P i , will be equal to 0.5 P pr k. In effect, W m = P pr k, which is the proof of point (i).
The analogous operation for the female payoff function takes the form By substituting the transformed MSE condition y i x i = P i P pr in this function, we obtain y i x i W m f = 0.5P i 1−P pr P pr k. After the substitution of the conditionP pr = P, we obtain y i x i W m f = 0.5P i 1−P P k = 0.5 P i k. In effect, the female payoff function will have the form which is the proof of point (ii).
Since f i = x i /x, m i = y i /y and = x/y, the MSE condition f i P i = m i j P j can be described as x i P i k = y i P pr k. The left side of this formula describes the number of male individuals produced by all female carriers of gene P i , and the right side describes the number of male individuals produced by female partners of male carriers of the gene, which is the proof of point (iii).
This completes the proof.