Introduction

An understanding of how biological diversity is created and maintained is one of the major challenges facing humanity in its bid to preserve functioning ecosystems on Earth. The accelerating impact of human activities on ecosystems at all scales, from how bacteria evolve in response to antibiotics to the local impacts of habitat loss and the global impacts of climate change, presents a pressing need for the development of parsimonious models, composed of a few differential equations, that can simulate the dynamics of eco-evolutionary systems and predict the implications of human activities (Irwin et al. 2015; Padfield et al. 2017; Beaufort et al. 2022). The ability of models of evolution to simulate evolutionary branching is a litmus test for realistic eco-evolutionary models.

Evolutionary branching (Metz et al. 1996) is a major contribution of Adaptive Dynamics (AD) (Geritz et al. 1998) to understanding the processes of evolution (Della Rossa et al. 2015; Dercole et al. 2016), and may elucidate a fundamental process in sympatric speciation (Waxman and Gavrilets 2005; Senthilnathan and Gavrilets 2021). Evolutionary branching is the splitting of a unimodal phenotype distribution of a population into a bimodal, or even multi-modal phenotype distribution, and is considered to generally occur at an eco-evolutionary equilibrium point that is ecologically stable but evolutionarily unstable (Wakano and Iwasa 2013). Quantitative genetics models consider that evolutionary branching occurs when the trait mean is constant, but the trait variance increases without bound (Mullon and Lehmann 2019), although trait variances may not necessarily be unbounded (Debarre and Otto 2016). The transition at such eco-evolutionary saddle points is sometimes described as “catastrophic” (Dercole et al. 2016), but may not necessarily be so (Wakano and Iwasa 2013).

The dynamics of evolutionary branching may be investigated by simulating large numbers of interacting phenotypes of a population, for example, Geritz et al. (1997, 1998), Law et al. (1997). The AD approach models a single resident phenotype and tests whether a mutant phenotype can invade a convergent stable equilibrium occupied by the resident phenotype - if it cannot be invaded the equilibrium is an evolutionary stable strategy (Dercole et al. 2016).

An alternative to modelling individual phenotypes is to model the population, its average trait value, and a measure of trait variance within the population (Klauschies et al. 2018; Patel and Burger 2019; Lion et al. 2023). Eco-evolutionary models seek to simulate the complex interplay of ecological interactions between populations and the evolutionary processes that shape their characteristics (Abrams et al. 1993; Dieckmann and Law 1996; Dieckmann and Doebeli 1999; Fussman et al. 2007; Pelletier et al. 2009; Schoener 2011; Cortez 2018; Klauschies et al. 2018; Lion et al. 2023). Our framework allows dynamic feedback to occur between the ecology and evolution and vice versa. Pelletier et al. (2009) raise the joint feedback issue as a key attribute of eco-evolutionary dynamics.

Eco-evolutionary modelling assumes that ecological and evolutionary processes can occur on similar time scales, and evolutionary dynamics can affect ecology (Schoener 2011; Villa Martin et al. 2016). In 2009 the Philosophical Transactions of the Royal Society B devoted a theme issue to this topic (see the introductory paper of Pelletier et al. (2009)). Eco-evolutionary population models typically involve orders of magnitude fewer equations than their phenotype model equivalents, and examine the dynamics of a system rather than just its steady states or their long-term stable attractors.

A key difference between eco-evolutionary modelling and the AD approach is that all possible mutants are included in the model’s initial conditions, so the AD criterion of explicitly testing each stable equilibrium point for invasibility by a mutant is redundant, as this has already been done in arriving at the equilibrium. As a result, the criteria for evolutionary branching developed by AD (Waxman and Gavrilets 2005) are generally not directly applicable to eco-evolutionary models.

Branching points in eco-evolutionary models may be characterised as equilibrium points on the fitness landscape where the population fitness is zero, the fitness gradient in the evolutionary dimension is zero, and the curvature of the fitness surface in the evolutionary dimension is positive. Such equilibrium points have attracting eigenvectors in the ecological direction and repelling eigenvectors in the evolutionary direction (Rubin et al. 2021).

Eco-evolutionary models typically have frequency-dependent measures of fitness, considered to be essential to modelling evolutionary dynamics (Metz et al. 1992), that are derived directly from the ecological dynamics. Early eco-evolutionary models often assumed that traits were normally distributed with constant variance (Lande 1976), but phenotype models typically simulate the change in both the mean and variance of traits (Meszena et al. 2005; Senthilnathan and Gavrilets 2021). Many modelling approaches, such as quantitative genetics (Abrams 2001) and oligomorphic dynamics (Sasaki and Dieckmann 2011; Lion et al. 2023), assume sub-populations with unimodal distributions with small variances. Often, phenotypes are assumed to be normally distributed; normal distributions have zero skewness and are often assumed to have constant variance.

Recent eco-evolutionary modelling approaches have explored the possibility that traits may be described by beta distributions, that have dynamic variance and may be skewed or even bimodal (Klauschies et al. 2018). The eco-evolutionary framework used in this paper (Cropp and Norbury 2021, 2022), that follows how the beta distribution changes its shape properties, allows for increases in variance (in the absence of mutation), skewness, and bimodal phenotype distributions, suggesting the potential to simulate evolutionary branching in an eco-evolutionary model.

Here, we examine the dynamical evolutionary branching behaviour of an eco-evolutionary system described by six coupled ordinary differential equations based on an eco-evolutionary framework that assumes phenotypes have beta distributions (see equations (6)-(8) for the specific model and equations (34) in Appendix “Extended eco-evolutionary population modelling framework” section for the general framework). The model simulates the evolution of an autotroph population that trades-off maximising its growth rate against intra-population competition, where the competition between similar phenotypes is greater than that between dissimilar phenotypes. The population trade-off is analogous to that used in some phenotype models (for example, Meszena et al. (2005); Kisdi (1999)), and oligomorphic population models (Lion et al. 2023), so the approach has a similar fitness landscape and related dynamical behaviour.

We develop a two-sub-population ordinary differential equation model, described by six equations, that reproduces the results of an equivalent 100-equation phenotype model with a high level of agreement. A simplified, single population, (three equation) version of the population model has an explicitly three-dimensional fitness landscape. This reveals that weak evolutionary branching is initiated by crossing a zero curvature isocline, prior to strong branching, which is controlled by the unstable manifold of a saddle equilibrium point in the eco-evolutionary state space.

We show that two-dimensional sections through the ecological and evolutionary phase spaces of the two-sub-population model, that change as the system evolves, are useful indicators of the dynamics of the system. Standard dynamical systems analysis tools then provide useful insights into the dynamics of this eco-evolutionary model. For example, they reveal the existence of what may be a lengthy zone where the ecological state is not near equilibrium and/or evolutionary properties of the system may change substantially, confirming the importance of dynamical feedback between ecology and evolution. The phenotype model does not readily provide such insights because of its high dimensionality (typically hundreds of phenotypes).

Pelletier et al. (2009), in their introductory paper to the theme issue “Eco-evolutionary Dynamics” discuss the aims and importance of looking at feedback between the ecological, evolutionary, and environmental systems. Although we do not explicitly model the interaction of environmental forcings in our example, we demonstrate the potential for environmental changes to fundamentally affect the properties of eco-evolutionary systems. This could have profound implications for how major ecosystems, such as coral reefs, adapt to climate change.

The manuscript is organised as follows. We first present a phenotype model that explicitly simulates the dynamics of every phenotype in a population (“A phenotype model with evolutionary branching” section). This model makes no assumptions of fitness functions or trait distributions and serves as a benchmark to compare our model results against. Our eco-evolutionary modelling framework is introduced in the “Modelling framework and a heuristic model” section along with its simplest implementation — a single population model with one evolving trait. This serves as a heuristic model to assist in understanding the properties of the phenotype model and the more complex simulation model. The eco-evolutionary simulation model is introduced in the “A two-sub-population simulation model” section, and the results of simulations in the “Results and discussion” section. This section presents and discusses details of the model’s equilibria, its bifurcation behaviours, the role of trait differentiation Q, and analysis of the phase space. A summary of our results is presented in the “Conclusions” section and a comprehensive Appendix provides supporting details of our approach and results.

A phenotype model with evolutionary branching

A common feature of models that exhibit evolutionary branching is that individuals with similar phenotypes compete more strongly with each other than individuals with widely dissimilar phenotypes. An example is beak morphology in birds that determines the size and/or shape of seeds eaten (Grant and Grant 2006). We consider a similar competition model here.

Resource-based ecosystem models of single populations typically contain three ecological processes: growth based on the uptake of a resource; competition between various members of the population; and mortality. Each of these processes may be density-dependent or density-independent, depending upon the specific formulation. A single population model in this framework is typically that of a plant, that technically has density-dependent growth due to resource recycling. Here, we consider a population composed of a number of phenotypes that are differentiated by their value of a trait. This trait determines their relative efficiency at taking up and growing on a resource and how effectively they compete with other phenotypes in the population. The population reproduces continuously and clonally, similarly to phytoplankton.

We define a fitness function, that includes growth, competition, and mortality, for each population P of the form f where the abundance of each phenotype, \(P_i\), changes according to \(f(\gamma _i;\;P_j, \text { for } 1 \le j \le n)\). Each phenotype i is associated with a scaled trait value \(0<\gamma _i<1\) that determines its maximum growth rate and how it competes with other phenotypes j with scaled trait values \(\gamma _j\).

We model the competition between phenotypes i in a population whose total size is given by \(P=\sum _i{P_i}\). The phenotype model is given by the equation:

$$\begin{aligned} \frac{dP_i}{dt} = P_i \left( \frac{\mu \gamma _i (1-\gamma _i) N}{(N + \kappa )} - \sum _j{\frac{P_j}{\eta + \omega (\gamma _i-\gamma _j)^2+ \rho (\gamma _i -\gamma _C)^2 } } - \sigma \right) , \end{aligned}$$
(1)

where the resource N is given by \(N=1-\sum _i{P_i}\) and \(i,j = 1,2, \dots ,n\), for n the number of phenotypes simulated. Here the \(P_i\) are abundances, measured as the amount of biomass (in terms of scaled limiting resource) in each phenotype, and N is the amount of resource in the abiotic pool. When P is a plant, the resource is a limiting inorganic nutrient.

Each phenotype is subject to the same population-wide density-independent mortality rate \(\sigma\), as well as the other population parameter values \(\mu\), \(\kappa\), \(\eta\), \(\rho\), \(\omega\), and \(\gamma _C\). The maximum growth rates of the phenotypes are described by a population growth rate \(\mu\), and a concave function of the trait \(\gamma\) such that, for the same availability of resource N, phenotypes with trait values near the middle of the range (i.e. \(\gamma _i \approx 0.5\)) have greater maximum growth rates than phenotypes with trait values near the bounds (\(\gamma _i \approx 0\) or \(\gamma _i \approx 1\)). The realised growth rate of each phenotype (the first term in (1)) is described by a Michaelis-Menten (Holling Type II) term that modulates (saturates) the maximum possible growth rate of the phenotype \(\mu \gamma _i(1-\gamma _i)\) according to the availability of resource. Here, \(\kappa\) represents the half-saturation constant of nutrient uptake, that is, the nutrient concentration at which the organism attains half its maximum growth rate.

Competition between phenotypes is modelled by the second term in equation (1). The first term in the denominator of the competition term \(\eta\) controls the constant, population-wide competition between phenotypes. The second term in the denominator of the competition term, \(\omega (\gamma _i-\gamma _j)^2\), reflects that competition between phenotypes with similar trait values is greater than competition between dis-similar phenotypes. The third term in the denominator of the competition term, \(\rho (\gamma _i -\gamma _C)^2\), allows differential competition between phenotypes. The parameter \(0<\gamma _C<1\) identifies a trait value that is detrimental to phenotypes that have it, and to phenotypes with similar trait values. The effect of this trait value on phenotypes’ growth decreases for phenotypes with more dissimilar trait values. When the population is small, the effect of this term is minimal, but its effect increases as the population increases. The fitness landscape of (1) is symmetric about \(\gamma = 0.5\) when \(\gamma _C = 0.5\), but is asymmetric for other values of \(0< \gamma _C < 1\).

Fig. 1
figure 1

Distributions of phenotype abundances produced by the phenotype model (1) for varying values of density-independent mortality (\(\sigma\)) and fitness landscape asymmetry (\(\gamma _C\)): a \(\sigma = 2.00\), \(\gamma _C = 0.500\); b \(\sigma = 0.50\), \(\gamma _C = 0.500\); c \(\sigma = 2.00\), \(\gamma _C = 0.40\); d \(\sigma = 0.50\), \(\gamma _C = 0.40\). Other parameter values used were \(\mu = 10\); \(\kappa = 0.10\); \(\rho = 4.00\); \(\eta = 0.50\); and \(\omega = 6\). Initial conditions were \(\sum {P_i} = 0.050\) with phenotype abundances distributed according to a beta distribution with shape parameters \(\alpha = 100 = \beta\). A population of 100 phenotypes was used for these simulations

Numerical simulations using the phenotype model (1), for given initial conditions and parameter values, with symmetric (\(\gamma _C=0.50\)) and asymmetric (\(\gamma _C=0.40\)) fitness landscapes with large (\(\sigma =2.00\)) and small (\(\sigma =0.50\)) density-independent mortality produce the phenotype distributions in Fig. 1. These simulations were initiated with beta-distributed phenotype abundances among the traits, but the results do not depend on this assumption. See Appendix “Phenotype distributions" section for evidence that the model generates beta distributions, even if it does not start with a beta distribution.

Figure 1 shows that for small values of \(\sigma\) ((b) and (d)) the single initial population splits into two sub-populations with different trait means, of equal biomass sizes in the symmetric case and unequal sizes in the asymmetric case. For large values of \(\sigma\) ((a) and (c)) the population remains a single population with a trait mean of 0.50 in the symmetric case, and a trait mean of 0.53 in the asymmetric case. In all cases the variance is small. Note \(P_i(t) / \sum _j{P_j(t)}\) is used as the probability density function to calculate the phenotype statistics.

The asymmetry of the fitness landscape does not noticeably affect the simulation results for large \(\sigma\) ((a) and (c)) but causes the system to produce a larger and a smaller sub-population in the asymmetric branching case (d). The stability and co-existence of the large and small sub-populations in the asymmetric case is due to the competition term \(\omega (\gamma _i-\gamma _j)^2\) which reduces the level of competition between phenotypes as the phenotypes become more dissimilar. When \(\omega\) is sufficiently small in the asymmetric case, one of the sub-populations eventually goes extinct.

A well-known example of this is finches, where birds with different beak sizes feed on different size seeds. Finches with similar beak sizes experience a higher level of competition with similar phenotypes than with finches that have dissimilar beak sizes (Grant and Grant 2006). See Pelletier et al. (2009), Schoener (2011) for more examples where eco-evolutionary modelling has been studied.

Our aim is to create a much simpler population model that reproduces the phenotype equations (1) behaviour and is amenable to analysis that can provide insights into the reasons for the behaviours. We first consider a single population model in the “Modelling framework and a heuristic model” section, and then introduce a two sub-population model in the “A two sub-population simulation model” section. The distributions produced by the phenotype model, which solved 100 coupled ordinary differential equations, will be used to validate the results of an equivalent six-equation two sub-population model.

Modelling framework and a heuristic model

The six-equation model presented in the “A two sub-population simulation model” section is the appropriate simulation model to compare evolutionary branching behaviour with the phenotype model (1), but this model is sufficiently high dimensional that analysis of its basic properties is not straightforward. Hence, we first present a simple model, approximately equivalent to (1), that may be analysed more readily in order to understand the sorts of behaviours that we might expect from the more complex model.

In the cases where the phenotype model does not show evolutionary branching (Fig. 1a, c) the simple model is able to reproduce the single population predictions of the phenotype model very accurately. However, in cases where branching does occur (Fig. 1b, d) the simple model can be used to predict the potential for such branching, but is unable to simulate such branching.

The simple three-equation single population eco-evolutionary model provides a fitness landscape that can be viewed explicitly in three dimensions. We apply a single delta function phenotype to the phenotype model (1) to define a corresponding fitness function for a single population model with analogous properties to the phenotype model (1). The delta function considers the average trait value of the population, \(\hat{\gamma }\), and has values \(P_i=P\) at \(\gamma _i = \hat{\gamma }\) and \(P_i=0\) for all \(\gamma _i \ne \hat{\gamma }\). This identifies a population P with the phenotype mean trait value \(\hat{\gamma }\) and a fitness function \(\hat{f}(\hat{\gamma }; P)\). This model is developed in order to gain insight into the dynamical properties that underlie the branching behaviours observed in Fig. 1.

Eco-evolutionary population modelling framework

The canonical equations of the eco-evolutionary framework used here, for a population P that grows or reduces in accordance with how it interacts with its environment and other populations, described by the population fitness function \(\hat{f}\), with an evolving mean trait value \(\hat{\gamma }\), and a trait differentiation Q (Cropp and Norbury 2022), are:

$$\begin{aligned} \begin{aligned}\frac{dP}{dt}&=P \left( \hat{f} + \frac{1}{2} \hat{\gamma }(1-\hat{\gamma }) Q \frac{\partial ^2 \hat{f}}{\partial \hat{\gamma }^2} \right) ,\\ \frac{d \hat{\gamma }}{dt}&=\hat{\gamma }(1-\hat{\gamma }) Q \frac{\partial \hat{f}}{\partial \hat{\gamma }}, \\ \frac{dQ}{dt}&=Q^2 \left( (1-2\hat{\gamma }) \frac{\partial \hat{f}}{\partial \hat{\gamma }} + \hat{\gamma }(1-\hat{\gamma }) \frac{\partial ^2 \hat{f}}{\partial \hat{\gamma }^2} \right) , \end{aligned} \end{aligned}$$
(2)

where subscripts denoting multiple populations with many, one or no evolving traits, have been omitted for clarity (see Appendix “Extended eco-evolutionary population modelling framework” section for a fully annotated two-population modelling framework). The net per capita phenotype growth function averaged (in the small variance limit) over the phenotype distribution, \(\hat{f}\), may be considered a measure of population fitness. The first derivative \(\partial \hat{f} / \partial \hat{\gamma }\) in equation (2) is often referred to as a fitness or selection gradient, that determines the direction of adaptation. The second derivative \(\partial ^2 \hat{f} / \partial \hat{\gamma }^2\) is the curvature of the fitness landscape which narrows or widens the distribution of phenotype abundances, and when negative is associated with evolutionary stability.

This framework assumes that the distribution of the population phenotype abundances over the trait \(\gamma\), on the scaled trait interval \(0<\gamma <1\), may be described by a beta distribution with a mean value \(\hat{\gamma }\) and variance v. The state variable Q describes the trait differentiation of the population. The variance of the distribution is calculated using \(v=\hat{\gamma }(1-\hat{\gamma })Q\). The derivation of these equations is provided in Cropp and Norbury (2022) using a moment-based method; an alternative derivation based on an asymptotic boundary layer analysis is provided in Appendix “Asymptotic derivation” section. Note that in the phenotype model of the “A phenotype model with evolutionary branching” section, v is directly calculated from the phenotype distribution.

Equations (2) form a single eco-evolutionary population modelling framework that is the basis for modelling many evolutionary scenarios. This modelling framework assumes no sources of additional phenotypic diversity such as the immigration of mutants from outside the evolutionary space. Phenotype diversity is incorporated through the initial conditions, and is modified by the population dynamics and selection pressures. The framework can accommodate ecosystems with many populations, each of which may have no, one, or many traits that evolve, and can represent stabilising, directional, and disruptive selection.

A particular eco-evolutionary system is defined by specifying an \(\hat{f}\) for each population, which provides a \(\frac{dP}{dt}\) equation. The \(\hat{f}\) may include none, one, or several evolving traits, where each evolving trait mean has corresponding equations for \(\hat{\gamma }\) and Q. That is, a \(\frac{d \hat{\gamma }}{dt}\) and a \(\frac{dQ}{dt}\) equation are obtained for each evolving trait using the \(\hat{f}\). One or more populations may be considered sub-populations, or phenotype groups, of a population if their \(\hat{f}\) have the same form and differ only in the names of the evolving parameters.

A simple analogy of the phenotype model

The population fitness function corresponding to that of the phenotype model (1), for a single population P feeding on a limiting recycling resource N with a mean trait value of \(\hat{\gamma }\) is:

$$\begin{aligned} \hat{f} = \frac{\mu {\hat{\gamma }}(1-{\hat{\gamma }}) N}{(N + \kappa )} - \frac{P}{\eta + \rho ({\hat{\gamma }}-{\hat{\gamma }}_C)^2} - \sigma . \end{aligned}$$
(3)

Resource recycling is imposed by a conservation condition \(N=1-P\). Differentiating this condition produces an equation for dN/dt that describes the recycling process. When the limiting resource is a nutrient, recycling implies remineralisation of organic material into inorganic nutrient N.

The terms in (3) are explained in (1). Note that the \(\omega (\gamma _i-\gamma _j)^2\) term of the phenotype model (1), which captures competition between phenotypes, cannot be represented in this simple population model (3). This model is presented to help understand the properties of the two-sub-population model. The two-sub-population model presented in the “A two-sub-population simulation model” section is the appropriate model to compare simulation results with the phenotype model.

The fitness function (3) is inserted into the single population, single evolving trait eco-evolutionary modelling framework (2) (Appendix “Extended eco-evolutionary population modelling framework” section, Cropp and Norbury (2022)), to give the eco-evolutionary model:

$$\begin{aligned} \begin{aligned}\frac{dP}{dt}&=P \left( \begin{array}{c}\frac{\mu \hat{\gamma } (1-\hat{\gamma }) N}{(N + \kappa )} - \frac{P}{\eta + \rho (\hat{\gamma } -\hat{\gamma }_C)^2} - \sigma + \\ \frac{1}{2} \hat{\gamma }(1-\hat{\gamma }) Q \left[ - \frac{2 \mu N}{N+\kappa } + \frac{2 \rho (\eta - 3 \rho (\hat{\gamma } - \hat{\gamma }_C)^2) P}{(\eta + \rho (\hat{\gamma } - \hat{\gamma }_C)^2)^3} \right] \end{array} \right) , \\ \frac{d \hat{\gamma }}{dt}&= \hat{\gamma }(1-\hat{\gamma }) Q \left( \frac{\mu (1-2 \hat{\gamma }) N}{(N + \kappa )} + \frac{2 \rho (\hat{\gamma }-\hat{\gamma }_C)P}{(\eta + \rho (\hat{\gamma }-\hat{\gamma }_C)^2)^2} \right) , \\ \frac{dQ}{dt}&=Q^2 \left( \begin{array}{c}(1-2\hat{\gamma }) \left[ \frac{\mu (1-2 \hat{\gamma }) N}{(N + \kappa )} + \frac{2 \rho (\hat{\gamma }-\hat{\gamma }_C)P}{(\eta + \rho (\hat{\gamma }-\hat{\gamma }_C)^2)^2} \right] + \\ \hat{\gamma }(1-\hat{\gamma }) \left[ - \frac{2 \mu N}{N+\kappa } + \frac{2 \rho (\eta - 3 \rho (\hat{\gamma } - \hat{\gamma }_C)^2) P}{(\eta + \rho (\hat{\gamma } - \hat{\gamma }_C)^2)^3} \right] \end{array}\right) .\end{aligned} \end{aligned}$$
(4)

The resource is recycled and its mass (of limiting nutrient) is conserved in this simple scaled system, so that \(N=1-P\), and a differential equation to describe changes in N is not necessary.

We evolve the trait mean \(\hat{\gamma }\) and the trait differentiation Q so that the trait variance is given by \(v(t)=\hat{\gamma }(t)(1-\hat{\gamma }(t))Q(t)\). Note that this model simulates the process in the phenotype model (1) where phenotypes with trait values near \(\gamma _C\), equivalent to \(\hat{\gamma }_C\) in (4), endure greater negative effects of competition than phenotypes with trait values further from \(\gamma _C\).

The fitness landscape

The fitness landscape for this model is a surface in three-dimensional \((P,\hat{\gamma },\hat{f})\) space, similar to those of Hui et al. (2021), that does not depend on Q. The \((P,\hat{\gamma },Q)\) solution space for (4) is a three-dimensional phase space that includes Q, but as Q is generally small and always positive, the phase space may be examined in a representative two-dimensional section for a specific value of Q. The details of the \((P,\hat{\gamma })\) phase plane (Fig. 3) change a little with different values of Q but not sufficiently to warrant drawing separate phase planes.

The internal eco-evolutionary equilibrium points of the framework equations (2), where \(P \ne 0\) and \(\hat{\gamma } \ne 0,1\), ignoring the Q, including the three internal eco-evolutionary equilibrium points of the simple model (4) (Fig. 2), have the properties, if we take Q small and positive, that:

$$\begin{aligned} \begin{array}{cc} \hat{f}_P \approx 0, &{} \frac{\partial \hat{f}_P}{\partial \hat{\gamma }}=0, \\ \lambda _1 \approx \frac{\partial \hat{f}_P}{\partial P} P, &{} \lambda _2 = \hat{\gamma } (1-\hat{\gamma }) Q \frac{\partial ^2 \hat{f}_P}{\partial \hat{\gamma }^2}.\end{array} \end{aligned}$$
(5)

The first pair of properties (the intersections of the zero isoclines) determines the location of each point, and the signs of the second pair (the eigenvalues of each internal equilibrium point) determine their stability. The approximations are the result of ignoring small variance terms.

Figure 2 illustrates how the changing density-independent mortality \(\sigma\) affects the solutions. The fitness landscape of the system simply translates with the change in \(\sigma\); the key change that affects the outcome of the model is that the system is restricted to low values of P when \(\sigma\) is large. This restricts the system to the region of the fitness landscape where the curvature in the \(\hat{\gamma }\) dimension is negative (i.e. concave), stabilising the equilibrium point as the gradient in the P direction is always negative. Reducing \(\sigma\) allows the system to occupy the valley region of the fitness landscape where the \(\hat{\gamma }\) curvature is positive (i.e. convex), which directs the system to one of the stable equilibrium points that appear on the ridges.

Fig. 2
figure 2

Fitness landscapes for the simple model (3) for a the symmetric case (\(\hat{\gamma }_C = 0.50\)) with high mortality (\(\sigma = 1.75\)); b the symmetric case with low mortality (\(\sigma = 0.50\)); c an asymmetric case (\(\hat{\gamma }_C = 0.40\)) with high mortality (\(\sigma = 1.75\)); and d an asymmetric case (\(\hat{\gamma }_C = 0.40\)) with low mortality (\(\sigma = 0.50\)). Other parameter values as for the phenotype model simulations shown in Fig. 1. Stable eco-evolutionary equilibrium points are shown by black dots and unstable points by white dots. The black dots in (a) and (c) are obscured by the red dots showing the final state of the system, but are evident in panels (b) and (d). Two separate integration trajectories are shown by the dashed red lines. The symmetric cases (a and b) have one trajectory starting from \(\{P=0.05,\hat{\gamma }=0.475,Q=0.005\}\) and one from \(\{P=0.05,\hat{\gamma }=0.525,Q=0.005\}\). The asymmetric cases (c and d) have one starting from \(\{P=0.05,\hat{\gamma }=0.360,Q=0.005\}\) and one from \(\{P=0.05,\hat{\gamma }=0.410,Q=0.005\}\). Note the centre of the valley between the two ridges is located at \(\hat{\gamma }=0.50\) in the symmetric case (a), and at \(\hat{\gamma } \approx 0.40\) in the asymmetric case (b)

Figure 2 reveals that the fitness landscape of this single population system changes significantly as the population increases. Intra-population competition is low when the population is small, and the system has a fitness landscape with negative curvature in the \(\hat{\gamma }\) dimension that indicates stabilising selection and no potential for evolutionary branching. As the population increases the intra-population competition also increases and causes the fitness landscape to buckle, with a valley and two ridges becoming obvious from around \(P \approx 0.5\). A stable eco-evolutionary equilibrium point is located on each of these ridges, revealing that the single population system has two distinct stable equilibrium points, with the outcome of any integration determined by the initial conditions.

Located within the valley lies an unstable eco-evolutionary equilibrium point, with attributes \(\frac{\partial \hat{f}}{\partial P}<0\) and \(\frac{\partial ^2 \hat{f}}{\partial \hat{\gamma }^2}>0\), similar to some requisites for evolutionary branching (Geritz et al. 1997, 1998). The quantities that determine the stability of the point are the eigenvalues of the Jacobian matrix of the system evaluated at the point (5). These are related to the gradient and curvature of the fitness surface, and ensure that the point has an attracting eigenvector in the P direction and a repelling eigenvector in the \(\hat{\gamma }\) direction, that is, this point is an unstable saddle point. This positive second trait derivative causes this point to be unstable in the \(\hat{\gamma }\) direction. The attracting eigenvector lies along the \(\hat{\gamma } = 0.50\) line in the symmetric case, and nearby in the asymmetric case (i.e. between the two red dashed lines in panels (a and c) and (b and d) of Fig. 2 respectively). In each case, the attracting eigenvector forms a separatrix that divides the system into two parts, and determines which of the two stable equilibrium points the system will be attracted to.

Dynamical properties

The properties of the internal eco-evolutionary equilibrium points are confirmed by the trajectories of two integrations of the system shown in Figs. 2 and 3. The integrations start from initial conditions on either side of the separatrix, are initially attracted to the (unstable) saddle equilibrium point, but are then repelled from this point to end at the stable equilibrium point on the appropriate ridge shown in Fig. 2b, d and the zero isocline intersection in Fig. 3b, d.

It is interesting to note that although changing the value of the population mortality \(\sigma\) only subtly alters the shape of the fitness landscape, it can significantly alter the region of the fitness landscape that the system explores. When the population has low mortality rates (Fig. 2b, d), the system explores a region of the fitness landscape where it has the potential for evolutionary branching. As the mortality rate increases, the population eventually loses this potential (Fig. 2a, c), providing theoretical evidence of the potential for environmental change to affect the fundamental properties of ecosystems.

Fig. 3
figure 3

Phase planes and vector fields for the single population model (4). Mortality (\(\sigma\)) values are a 1.75; b 0.50; c 1.75; and d 0.50. Cases and parameter values as for Fig. 2 except that \(\hat{\gamma }_C\) is increased from 0.40 to 0.499 for the two asymmetric cases to show the symmetry breaking. The solid black lines in the phase plane are the \(P=0\) and \(\hat{f}=0\) isoclines. The dotted lines are the \(\hat{\gamma }=0\), \(\hat{\gamma }=1\), and \(\partial \hat{f} / \partial \hat{\gamma }=0\) isoclines. Panels (a) and (b) also have \(\hat{\gamma }=0.5\) isoclines. Unstable equilibrium points are shown by white dots, and stable ones by black dots; the latter are overlaid in the diagrams by the large red dots showing the final states of the integrations. The saddle point appears as a half-white, half-black dot in the phase plane. The dashed line shows the zero curvature isocline where \(\partial ^2 \hat{f} / \partial \hat{\gamma }^2 =0\). Two integration trajectories are shown by the dashed red lines. Trajectories as for Fig. 2

Figure 3 shows that a bifurcation occurs in the system’s eco-evolutionary solution space as \(\sigma\) is reduced. When \(\sigma ^* \approx 1.490\) the symmetric case undergoes a pitchfork bifurcation, when the previously stable equilibrium point becomes unstable, and two stable branches are created, one either side of the original point (Fig. 3b). This process creates an unstable saddle point that is key to evolutionary branching. The effect of this saddle point on trajectories starting on either side of the separatrix is evident in Fig. 3. Rather than the trajectories converging as they did for large \(\sigma\) (panel a), the saddle point now causes them to ultimately diverge and be attracted to different stable equilibrium points.

The zero curvature (\(\partial ^2 \hat{f} / \partial \hat{\gamma }^2=0\)) isocline shown as the dashed black line in Fig. 3 provides information on the dynamics of the evolutionary branching. The sign of the curvature determines the sign of the key eigenvalue that controls the stability of the internal equilibrium points (5). The trajectories in Fig. 3b to the left of the zero curvature isocline are slowly converging, as the curvature is small and negative. When the trajectories cross the dashed black line the curvature becomes small and positive, and the trajectories begin to move apart. We call this behaviour, which occurs in the region of the fitness landscape between the dashed line and the branching point in Fig. 3b and d, “weakly branching” as \(\hat{\gamma }\) changes very slowly in this region. When the trajectories arrive at the branching point, they are in a region where the fitness landscape is more strongly positively curved, and the trajectories diverge more rapidly. However, each trajectory soon moves into a region where the curvature is strongly negatively curved, and they are attracted to their respective stable equilibria.

The branching dynamics predicted by the properties of the fitness landscape and the solution space of the symmetric case of the simple model (Figs. 2b and 3b) agree with those observed for the symmetric case of the phenotype model in Fig. 1b. In both instances, the population splits smoothly and symmetrically into two equivalent-sized sub-populations that have mean trait values equally distant from \(\hat{\gamma }_C\).

The bifurcation in the asymmetric case occurs slightly differently. The bifurcation still occurs at approximately the same value of \(\sigma ^*\) but now the stable equilibrium point moves upward in the \(\hat{\gamma }\) dimension and an unstable and stable pair of points appear below it in an imperfect pitchfork (or apparently blue-sky) bifurcation, ultimately producing an outcome and eco-evolutionary branching properties similar to the symmetric case. The different forms of bifurcation indicated by the simple model are evident in the distributions produced by the phenotype model, as differences in the branching process.

However, multiple numerical simulations of the phenotype model (1) reveal that the bifurcation value of \(\sigma\) of the phenotype model is different from that of the single population model. This is likely due to the absence of any representation of the \(\omega (\gamma _i-\gamma _j)^2\) term in the simple model. Nonetheless, the correspondence between the behaviour of the phenotype model (Fig. 1) and the properties of the single population model predicated by its fitness landscapes and vector fields (Figs. 2 and 3) suggest that the single model provides useful insights into certain behaviours of the phenotype model. For example, it may predict the existence and types of bifurcations but not their specific locations.

Figure 3b and d suggests the existence of two distinct zones of eco-evolutionary behaviour that underpin the AD approach (Dieckmann and Law 1996): an “ecological” zone that extends from the initial condition to the trajectory approaching the saddle point; and an AD zone between the saddle point and the stable equilibrium points.

The system transitions from its initial ecological behaviour (between the initial condition and the dashed line where \(\partial ^2 \hat{f} / \partial \hat{\gamma }^2=0\)) to weakly branching in the zone between the dashed line and the saddle point, where \(\partial ^2 \hat{f} / \partial \hat{\gamma }^2>0\) (recall (5)) — we refer to this as the non-equilibrium dynamics (NED) zone. The system then transitions to strongly branching behaviour in the AD zone, which occurs after the trajectories leave the immediate neighbourhood of the saddle point. The NED zone will be discussed further in the “The non-equilibrium dynamics zone” section in the Appendix.

The single population model predicts and reproduces the results of the phenotype model well for \(\sigma =2\) when no evolutionary branching occurs (Fig. 1a and c), but cannot reproduce the evolutionary branching evident in Fig. 1b and d. We next produce an extended model with two sub-populations to do this.

A two-sub-population simulation model

To reproduce the evolutionary branching evident in our phenotype model we consider an equivalent eco-evolutionary population model with two sub-populations of sizes \(P_1\) and \(P_2\). Hence, we apply two delta functions simultaneously, at trait values \(\gamma = \hat{\gamma }_1,\hat{\gamma }_2\) respectively, to the phenotype model (1) to produce fitness functions \(\hat{f}_1\) and \(\hat{f}_2\) for two sub-populations that represent two groups of phenotypes. We obtain the fitness functions, \(\hat{f}_1\) and \(\hat{f}_2\), that each has the same form and parameter values as they are drawn from the same initial population, but each has its own trait mean, \(\hat{\gamma }_1\) and \(\hat{\gamma }_2\).

The fitness functions:

$$\begin{aligned} \hat{f}_i = \frac{\mu \hat{\gamma }_i (1-\hat{\gamma }_i) N}{(N + \kappa )} - \frac{P_i}{\eta + \rho (\hat{\gamma }_i-\hat{\gamma }_C)^2} - \frac{P_j}{\eta + \rho (\hat{\gamma }_i -\hat{\gamma }_C)^2 + \omega (\hat{\gamma }_i-\hat{\gamma }_j)^2} - \sigma , \end{aligned}$$
(6)

here for \(i, j = 1,2\), (\(i \ne j)\), are included in the population framework (34), for two populations where each independently evolves its own trait mean and differentiation. See (1) for ecological definitions of the terms and parameters in equation (6). We now create our eco-evolutionary two-sub-population model that will be compared to the phenotype model (1):

$$\begin{aligned} \begin{aligned} \frac{dP_i}{dt}&= P_i \left( \hat{f}_i + \frac{1}{2} \hat{\gamma }_i(1-\hat{\gamma }_i) Q_i \frac{\partial ^2 \hat{f}_i}{\partial \hat{\gamma }_i^2} + \frac{1}{2} \hat{\gamma }_j(1-\hat{\gamma }_j) Q_j \frac{\partial ^2 \hat{f}_i}{\partial \hat{\gamma }_j^2} \right) , \\ \frac{d \hat{\gamma }_i}{dt}&= \hat{\gamma }_i(1-\hat{\gamma }_i) Q_i \frac{\partial \hat{f}_i}{\partial \hat{\gamma }_i}, \\ \frac{dQ_i}{dt}&= Q_i^2 \left( (1-2\hat{\gamma }_i) \frac{\partial \hat{f}_i}{\partial \hat{\gamma }_i} + \hat{\gamma }_i(1-\hat{\gamma }_i) \frac{\partial ^2 \hat{f}_i}{\partial \hat{\gamma }_i^2} \right) , \end{aligned} \end{aligned}$$
(7)

where:

$$\begin{aligned} \begin{aligned} \frac{\partial \hat{f}_i}{\partial \hat{\gamma }_i}&= \frac{\mu (1 - 2\hat{\gamma }_i) N}{N+\kappa } + \frac{2 \rho (\hat{\gamma }_i-\hat{\gamma }_C) P_i}{(\eta + \rho (\hat{\gamma }_i - \hat{\gamma }_C)^2)^2} + \frac{2 [ \rho (\hat{\gamma }_i - \hat{\gamma }_C) + \omega (\hat{\gamma }_i - \hat{\gamma }_j) ] P_j}{(\eta + \rho (\hat{\gamma }_i - \hat{\gamma }_C )^2 + \omega (\hat{\gamma }_i - \hat{\gamma }_j)^2 )^2}, \\ \frac{\partial ^2 \hat{f}_i}{\partial \hat{\gamma }_i^2}&=- \frac{2 \mu N}{N + \kappa } - \frac{8 \rho ^2 (\hat{\gamma }_i - \hat{\gamma }_C)^2 P_i}{(\eta + \rho (\hat{\gamma }_i - \hat{\gamma }_C)^2)^3} + \frac{2 \rho P_i}{(\eta + \rho ( \hat{\gamma }_i - \hat{\gamma }_C )^2 )^2} \\ {}&\quad + \frac{2 (\rho + \omega ) P_j}{(\eta + \rho (\hat{\gamma }_i - \hat{\gamma }_C )^2 + \omega (\hat{\gamma }_i - \hat{\gamma }_j)^2 )^2} - \frac{8[ \rho (\hat{\gamma }_i - \hat{\gamma }_C) + \omega (\hat{\gamma }_i - \hat{\gamma }_j)]^2 P_j}{(\eta + \rho (\hat{\gamma }_i - \hat{\gamma }_C )^2 + \omega (\hat{\gamma }_i - \hat{\gamma }_j)^2 )^3}, \\ \frac{\partial ^2 \hat{f}_i}{\partial \hat{\gamma }_j^2}&=\frac{8 \omega [\rho (\hat{\gamma }_i - \hat{\gamma }_C) + \omega (\hat{\gamma }_i-\hat{\gamma }_j)] (\hat{\gamma }_i-\hat{\gamma }_j) P_j}{(\eta + \rho (\hat{\gamma }_i - \hat{\gamma }_C)^2 + \omega (\hat{\gamma }_i - \hat{\gamma }_j)^2)^3} \\ {}&\quad - \frac{2 \omega P_j}{(\eta + \rho (\hat{\gamma }_i - \hat{\gamma }_C)^2 + \omega (\hat{\gamma }_i - \hat{\gamma }_j)^2)^2}. \end{aligned} \end{aligned}$$
(8)

Now \(N=1-\sum _i{P_i}\). We evolve the sub-population measures \(P_1\) and \(P_2\), with their trait means \(\hat{\gamma }_1\) and \(\hat{\gamma }_2\), and their trait differentiations \(Q_1\) and \(Q_2\), after stating suitable parameters and initial conditions.

This eco-evolutionary population model simulates two sub-populations \(P_1\) and \(P_2\), that together form a population P that consumes a resource N in order to grow. The net growth rate of each sub-population \(P_1\) or \(P_2\) represents competition for the resource N, and a trade-off of its growth against the cost of evolving defences against intra-specific competition. This trade-off is captured by the trait means \(0<\hat{\gamma }_1,\hat{\gamma }_2<1\). The population maximises its growth rate when \(\hat{\gamma }_1\) or \(\hat{\gamma }_2\) equals \(\frac{1}{2}\), but suffers its maximum density dependent mortality, from intra-specific competition, when \(\hat{\gamma }_1\) or \(\hat{\gamma }_2\) equals \(\hat{\gamma }_C\).

The model has a six-dimensional phase space \(\{P_1,P_2,\) \(\hat{\gamma }_1,\hat{\gamma }_2,\) \(Q_1,Q_2\}\), and a hypersurface for each fitness landscape in five-dimensional space \(\{P_1,P_2,\) \(\hat{\gamma }_1,\hat{\gamma }_2,\) \(\hat{f}_1\) or \(\hat{f}_2\}\), as \(Q_1\) and \(Q_2\) are not involved in the population fitness terms. The properties of the system are complicated to analyse and difficult to visualise even in three dimensions. However, when \(\hat{\gamma }_1 \approx \hat{\gamma }_2\), which is the situation which usually precedes evolutionary branching, we can reduce the dimension of the model if we take \(P_1 \approx P_2\) and \(Q_1 \approx Q_2\), so that \(\hat{f}_1 \approx \hat{f}_2\). Then Figs. 2 and 3 provide a starting point to understanding the more complicated model.

The details of the numerical simulations of this model are provided in Appendix “Numerical simulations” section. We use these numerical simulations to construct Figs. 4 to 8 in the manuscript and Figs. 9 to 15 in the Appendix. The phenotype distributions in Fig. 4 were created by estimating the beta distribution shape parameters at each generation from the trait means and variances (from \(v_i = \hat{\gamma }_i(1-\hat{\gamma }_i)Q_i\)) and using these to construct beta distributions for each population of each generation as described in Appendix “Numerical simulations” section.

Results and discussion

Phenotype distributions produced by the two sub-population model (6)–(8) (Fig. 4) are very similar to those produced by the phenotype model (1) (Fig. 1). These simulations used the same parameter values and similar initial conditions, and provided an initial validation of the two-sub-population model.

Fig. 4
figure 4

Distributions of phenotypes (assuming beta distributions) produced by the two-sub-population model (6)–(8) for simulations using the same parameter values and initial conditions as those shown in Fig. 1 for the phenotype model (1). Note these results reproduce the essence of the results of the phenotype model (1) shown in Fig. 1, including the different forms of evolutionary branching in the symmetric and asymmetric cases

The distributions produced by the two-sub-population model agrees qualitatively with those of the phenotype model in that larger values of density-independent mortality \(\sigma\) suppress evolutionary branching, and that symmetric and asymmetric fitness landscapes produce different forms of evolutionary branching. Further, the model results for the sub-population biomasses, the trait means, and the trait variances at the end of the integration agree quantitatively. A detailed examination of the correspondence between the end states of the solutions of the phenotype and population models shown in Figs. 1 and 4 is provided in Appendix “Final distributions” section.

The agreement between the preliminary results of these models suggests that a detailed examination of the dynamical properties of the population model (7), (8) may provide useful insights into the dynamics of the equivalent phenotype model. Further, both model results agree broadly with the bifurcation properties of the single population model (Fig. 3) with the exception of the critical value of \(\sigma\) that defines the bifurcation point. This will be considered further in the “Bifurcation behaviours” section, where it is shown that the two-sub-population model successfully predicts the bifurcation value.

Equilibrium states

The evolutionary branching behaviours of the two-sub-population model evident in Fig. 4b and d are further examined by considering two-dimensional ecological and trait sections of the six-dimensional phase space (Fig. 5). The four solution trajectories shown in these figures each start from different initial values of the trait means. These initial conditions were chosen to demonstrate that all stable equilibria in the state spaces may be accessed.

Fig. 5
figure 5

Vector fields produced by the two-sub-population model based on (6)-(8) for a symmetric fitness landscape (\(\hat{\gamma }_C=0.50\), a and b), and an asymmetric fitness landscape (\(\hat{\gamma }_C=0.40\), c and d). Other parameter values used as for Fig. 4. Four trajectories from four different \(\hat{\gamma }_1\) and \(\hat{\gamma }_2\) initial conditions are plotted in each vector field: 1) \(\hat{\gamma }_1 = 0.0950\), \(\hat{\gamma }_2 = 0.1050\),; 2) \(\hat{\gamma }_1 = 0.0110\), \(\hat{\gamma }_2 = 0.1000\); 3) \(\hat{\gamma }_1 = 0.9000\), \(\hat{\gamma }_2 = 0.9100\); and 4) \(\hat{\gamma }_1 = 0.9000\), \(\hat{\gamma }_2 = 0.8400\). Other initial values are \(P_1=0.0250 = P_2\), \(Q_1 = 0.0050 = Q_2\). The zero isoclines, equilibrium points, and vector fields are drawn at the final state of the first set of initial conditions, so do not necessarily agree with the other trajectories. Note the evolutionary rescue in (a) and (c) where one trajectory in each diagram almost intercepts the \(P_2\) axis

When this system has a symmetric fitness landscape (\(\hat{\gamma }_C=0.50\), a and b) the ecology has a single stable equilibrium point and the traits have two stable equilibrium points separated by a separatrix that links five unstable equilibria. All trajectories finish at the same ecological equilibrium but may finish at different trait equilibriums. The symmetric fitness case with \(\sigma <\sigma _*\) appears to have only eco-evolutionary branching solutions, as there are no other stable equilibrium points in the interior or on the boundaries of the evolutionary (trait) space.

The introduction of asymmetry into the fitness landscape (\(\hat{\gamma }_C=0.40\), Fig. 5c and d) introduces a third stable equilibrium point into the evolutionary space, and allows for solutions that do not involve evolutionary branching. For the chosen parameter values, this solution is only available to trajectories that commence with large trait means, and then only to a small cohort of initial conditions that are attracted to the stable equilibrium point and not the nearby unstable saddle that initiates branching for large trait means.

The asymmetric case also has slightly different equilibrium states in the ecological space. Each stable equilibrium in the evolutionary space is associated with a slightly different stable equilibrium location in the ecological space. The stable ecological equilibrium for the \(\hat{\gamma }_1 \approx 0.7, \hat{\gamma }_2 \approx 0.3\) evolutionary equilibrium point is shown as the black dot in Fig. 5c; the equilibrium points for the other trajectories lie at the large red dot at their termination. Nearby equilibria in the ecological space can have very different evolutionary outcomes associated with them.

An interesting attribute of many of the ecological trajectories shown in Fig. 5a and c is that many initial conditions lead to “evolutionary rescue” (Bell 2017). Systems that start with sub-populations that have similar mean trait values (as all evolutionary branching scenarios do) have \(\hat{f}_i=0\) isoclines in the ecological space that are nearly parallel. In these cases, small changes in mean trait values can move the stable ecological equilibrium point where both sub-populations coexist dramatically, pushing this point through the boundary creating a stable single sub-population equilibrium on the boundary through a trans-critical bifurcation. Eventually, the coexistence point can go to infinity and back, creating a stable equilibrium point on the opposite boundary where the other sub-population dominates. Further changes can then cause the unstable coexistence equilibrium point to re-enter the state space through the opposite boundary and create a new stable coexistence point within the state space through a second trans-critical bifurcation. These behaviours suggest evolutionary rescue may be a common feature of such systems, as is evidenced by the trajectories in Fig. 5a and c that almost intersect the \(P_2\) axis, suggesting that at one time in the integration the \(P_1=0\) equilibrium points were stable.

Note that the details of the diagrams in Fig. 5 are slightly different for the other initial conditions as the trajectories finish in different regions of the six-dimensional space. Hence equilibrium points may appear to lie in different locations. As the vector fields are drawn for the final state of the simulation, but the trajectories are for the whole integration, separatrices may appear to be crossed in these figures.

The simple model (4) showed that breaking the fitness landscape symmetry (i.e. \(\hat{\gamma }_C \ne 0.5\)) leads to different forms of bifurcation behaviour when \(\sigma\) is varied. We now explore the behaviour of the two sub-population model for symmetric and asymmetric cases.

Bifurcation behaviours

The bifurcation behaviour of a dynamical system is a fundamental property of the system and may be used to compare the attributes of different models or different modelling approaches. The vector fields of the simple system (4) in Fig. 3 reveal that the model with a symmetric fitness landscape (a and b) bifurcates slightly differently from the same model with an asymmetric fitness landscape (c and d). Although bifurcations also occur in the ecological space (see Figs. 1012 in Appendix “Bifurcation dynamics” section), here we focus on bifurcations in the evolutionary space.

The simple model predicts that the symmetric case will undergo a pitchfork bifurcation to create the evolutionary branching point and that the asymmetric case will undergo an imperfect pitchfork, or blue sky, bifurcation. The difference in the way the branching points are created produces a detectable difference in the way branching occurs in the model simulations. A smooth, symmetric branching of the initial population into two equal sub-populations is predicted by the simple model for the symmetric case (Fig. 3b). This dynamic is evident in the plots of the phenotype distributions of both the phenotype and two sub-population models (Figs. 1b and 4b).

The asymmetric case of the simple model predicts that evolutionary branching in this case will occur differently from the symmetric case. Instead of a smooth splitting into two sub-populations, it predicts that the initial population will change its mean trait value and grow before a second sub-population appears with a different mean trait value and commences to grow (Fig. 3d). This branching dynamic is again evident in the plots of the phenotype distributions of both the phenotype and two sub-population models (Figs. 1d and 4d).

The qualitative differences in how evolutionary branching occurs in the symmetric and asymmetric cases of the phenotype and two-sub-population model evident in Figs. 1 and 4 are predicted by the simple model. The properties of the saddle points that form the evolutionary branching points are the same in the symmetric and asymmetric cases, but the bifurcations by which the points are created differ. These differences lead to differences in the dynamics of how the populations branch. That the simple model (4) is able to predict what is observed in the phenotype model, and that the two-sub-population model (6)-(8) is able to reproduce the dynamics, are compelling evidence that the eco-evolutionary modelling framework (2) is able to capture key properties of these systems.

Fig. 6
figure 6

The evolutionary space (\(\hat{\gamma }_1\) - \(\hat{\gamma }_2\)) vector fields produced by the two-sub-population model based on (6) for a symmetric fitness landscape (\(\hat{\gamma }_C=0.50\)) with: a \(\sigma = 1.75\) (the bifurcation value); b \(\sigma = 1.50\); c \(\sigma = 1.20\); and d \(\sigma = 1.00\). Other parameter values used as for Fig. 4

While the single population model is useful in understanding how and why the evolutionary branching behaviours in the phenotype model are different as a result of introducing asymmetry into the fitness landscape, its simplicity prevents it from identifying specifics such as the critical value of the bifurcation parameter \(\sigma\). The single population model predicts that the bifurcations occur at significantly different \(\sigma ^*\) values to those predicted by numerical experiments for the phenotype model and the two-sub-population model. However, the latter values are very similar, with both the phenotype model and the two-sub-population model bifurcating at \(\sigma ^*=1.75\).

The transition from a single-population solution to a two-population solution occurs when the \(\hat{f}=0\) isocline, shown in Fig. 3 as a solid line, passes through the \(\partial \hat{f} / \partial \hat{\gamma }=0\) isocline, shown in Fig. 3 as a dotted line, from left to right. This coincides with a change in sign of the curvature (approximately in the asymmetric case) as the \(\partial ^2 \hat{f} / \partial \hat{\gamma }^2=0\) isocline, shown in Fig. 3 as a dashed line, is tangential with the \(\partial \hat{f} / \partial \hat{\gamma }=0\) isocline in the centre of the eco-evolutionary space in the symmetric case, and nearly tangential in the asymmetric case. This bifurcation point, where \(\partial \hat{f} / \partial \hat{\gamma }=0\) and \(\partial ^2 \hat{f} / \partial \hat{\gamma }^2=0\), is most simply explored by taking the density-independent mortality \(\sigma\) as the bifurcation parameter (see Fig. 3).

For the case \(\hat{\gamma }_C=0.5\) (\(\hat{f}_i\) symmetry in evolutionary space) when \(\hat{\gamma }^* = \hat{\gamma }_1^* = \hat{\gamma }_2^* = \hat{\gamma }_C\), we use \(\left. \hat{f}_i \right| _{\hat{\gamma }_i^*=0.5} = 0\) to calculate the bifurcation point:

$$\begin{aligned} \sigma ^* = \frac{\mu }{4} \frac{N^*}{N^*+\kappa } - \frac{1-N^*}{\eta }. \end{aligned}$$
(9)

We find \(N^* = 1-P_1^*-P_2^* = 1-2P_1^*=1-P^*\) as the symmetric case has \(P_1^*=P_2^*\), using the zero curvature condition:

$$\begin{aligned} \frac{N^*}{N^*+\kappa } = \left( \frac{\rho }{\eta ^2} + \frac{\omega }{2\eta ^2} \right) (1-N^*). \end{aligned}$$
(10)

Using this \(N^*\) in (9) gives \(\sigma ^* = 1.75\) in the symmetric case, which agrees with the phenotype model calculation to two decimal places. When \(\hat{\gamma }_C \ne 0.5\) (asymmetric \(\hat{f}_i\) in evolutionary space) the bifurcation is imperfect, and the isocline equation \(\left\{ \partial \hat{f}_i / \partial \hat{\gamma }_i =0 \right\}\) is now used to find \(\hat{\gamma }_i^*\).

Some key stages in the bifurcation behaviour of the two-sub-population model with a symmetric fitness landscape are shown in Fig. 6. For all \(\sigma > \sigma ^* = 1.75\) the evolutionary section of the vector field looks like panel (a), with a single stable equilibrium point in the phase space and no possibility of evolutionary branching. Reducing \(\sigma\) to 1.50 (panel b) introduces a supercritical pitchfork bifurcation into the previously stable equilibrium producing two stable equilibrium points separated by a saddle point. This initiates evolutionary branching in the model. As \(\sigma\) further reduces (panel c) the stable equilibria move apart and the zero isoclines through the saddle extend until the saddle splits into an unstable node with two saddle points (panel d). This arrangement (as shown in Fig. 5b) remains relatively unchanged in the symmetric fitness case as \(\sigma\) reduces further.

A similar presentation of the bifurcation properties of the asymmetric case of the eco-evolutionary model (6)-(8) is provided in Appendix “Bifurcation dynamics” section. Further, a comparison of Fig. 6c, d hints that further bifurcations may be possible, but would require a model with more sub-populations to explore.

Eco-evolutionary dynamics and Q

Time series of the first 100 generations of the simulations of the evolutionary branching solutions of the eco-evolutionary population model shown in Fig. 4b and d are provided in Fig. 7. In both the symmetric (Fig. 7a) and asymmetric (Fig. 7b) cases the evolutionary branching processes are accompanied by significant increases in Q, and hence the variance, of the sub-populations. In the symmetric case, both sub-populations simultaneously increase Q by about 50% as their distributions spread symmetrically as phenotypes with better trade-offs between growth and competition out-grow the initially most abundant phenotypes. The Q values then reduce as the two sub-populations establish coexistence at stable equilibriums with different mean trait values. Note that the peaks in Q coincide with rapid changes in the trait means.

The branching process occurs differently in the asymmetric case. Here, the \(Q_1\) value for the \(P_1\) population (panel (b), red line) increases by about an order of magnitude during the evolutionary branching process while the \(Q_2\) value of the \(P_2\) sub-population (panel (b), blue line) does not change. This is consistent with \(P_2\) following the stable branch in the vector field (Fig. 3d) while the \(P_1\) sub-population “jumps” to the stable equilibrium point created by the imperfect, or blue sky, bifurcation.

Fig. 7
figure 7

The time series of state variables for the first 100 generations of the integrations of the eco-evolutionary population model (6)-(8) shown in: a Fig. 4b; and b Fig. 4d. The time series shown are the population size in each of the sub-populations (P, top), the average phenotype value for each sub-population (\(\hat{\gamma }\), second panel), the trait differentiation (Q, third panel), and the trait variance of each sub-population (v, bottom). Time series data for \(P_1\) is shown by the red line and \(P_2\) by the blue line in each case. These are overlaid for P, Q, and v in (a). Note the correspondence of the peaks in Q and v with changes in the average phenotype value

The increase in \(Q_1\) facilitates an increase in the variance of the \(P_1\) phenotype distribution as phenotypes in the vicinity of the second mean trait equilibrium, that started with small initial abundances, increase in abundance, and result in \(P_2\)’s mean trait value \(\hat{\gamma }_2\) increasing. This soon establishes a second sub-population mode, with intermediate phenotype abundances reducing to near zero to create sub-populations with different trait modes.

These time series reveal the importance of Q in evolutionary branching, as increases in the Qs allow the variances of the sub-populations to increase as the sub-populations sample the evolutionary space for better options. This is consistent with an increase in variance that is considered a condition for evolutionary branching (Wakano and Iwasa 2013).

Note that although Fig. 7 shows the sub-population sizes and trait means have stabilised by about 100, and the Qs and variances are near zero, Fig. 4 shows that the dynamics of the system are not completely over. This is a further advantage of simulating Q in these systems, as although the cross-sectional areas and the locations of the distributions of the sub-populations in evolutionary space in the population model have stabilised by about time step 100, the shapes of the distributions have not. Even though the Qs and vs are very small, the variances of the distributions in Fig. 4 continue to decrease. This agrees with the results of the phenotype model shown in Fig. 1.

Sectioning the phase space

The six-dimensional solution space of the two-sub-population model presents difficulties in visualising the properties of the system, and in Figs. 5 and 6, we examined sections through the space. This presents a problem analogous to Plato’s Allegory of the Cave: how do we understand the true properties of the system from the snippets that we can visualise?

We now consider in some detail the eco-evolutionary dynamics of the two-sub-population model (6), (34) with an asymmetric fitness landscape to assess the usefulness of various sections through the solution spaces of these models. Two-dimensional ecological, evolutionary, and eco-evolutionary sections through the six-dimensional phase space of this model are shown as vector fields in Fig. 8.

Fig. 8
figure 8

End-of-integration phase plane sections from the eco-evolutionary population model (6)-(8). Phase plane details as for Fig. 7 except that trait mean initial conditions were changed to \(\hat{\gamma }_1 = 0.1000, \hat{\gamma }_2 = 0.1100\). The integration was extended to time 1,000 for the phase plane diagrams to ensure the system reached eco-evolutionary equilibrium. Separatrices are shown as dashed black lines but are not apparent where coincident with zero isoclines. The trajectories may cross separatrices in these diagrams as the trajectories are for the whole integration and the location of the separatrices is shown only for the end of the integration

In contrast to the eco-evolutionary space of the single population model (Fig. 3) which showed the entire solution space (apart from small changes associated with changes in Q), the eco-evolutionary sections through the six-dimensional solution space of the two sub-population model (Fig. 8a and b) are harder to interpret for the mechanics of evolutionary branching. The eco-evolutionary sections \((P_i, \hat{\gamma }_i)\) have only one stable equilibrium point each, although they suggest that other instantiations of the model may have more than one. The arrangements of the zero isoclines also suggest that the only bifurcations that will occur in the vicinity of the solutions shown are transcritical bifurcations that occur when either of the sub-populations goes extinct. The important bifurcations that facilitate evolutionary branching in this model are captured solely in the evolutionary section.

The ecological (c) and evolutionary (d) sections through the solution space, however, provide very useful descriptions of the system, and clearly show a stable ecological equilibrium state accompanied by a stable evolutionary equilibrium state that is one of three stable evolutionary equilibria available to the system. The trajectory through the ecological space suggests that more complex dynamics than are implied by the final zero isoclines and vector field have occurred during the simulation. The two reversals of the direction of the trajectory demonstrate the potential for evolutionary rescues to occur as stable equilibria leave and enter the ecological state space through transcritical bifurcations on the boundary (see Figs. 10 to 12 in Appendix “Bifurcation dynamics” section).

Whether evolutionary rescue occurs in a particular simulation depends upon the choice of parameters and initial conditions. For some choices, one population can become extinct. Generally, simulations that seek to reproduce evolutionary branching are initiated with two very similar sub-populations. This similarity means that their ecological zero isoclines are nearly coincident so that subtle changes in mean trait values can lead to dramatic changes in the location and stability of ecological equilibrium points. This can result in the ecology being attracted to one boundary equilibrium point, then an opposite one, before being attracted to a stable interior equilibrium, as shown in Fig. 8c. This suggests that the potential for evolutionary rescue is a common attribute of these systems.

Further, the ecological isoclines in Fig. 8c show that the system has evolved to a state that reduces the effect of evolutionary changes on the ecological state. This is evidenced by the zero isoclines becoming less parallel, indicating that the system has formed two relatively robust sub-populations with different trait means. Note that the property of nearly coincident zero isoclines does not apply to the evolutionary space so trajectories through the evolutionary space are generally simple, with the system initially being attracted to a saddle point which then directs the system to an evolutionary branching solution with \(\hat{\gamma }_1 \ne \hat{\gamma }_2\).

We have considered here only a simple model of a population that undergoes evolutionary branching. More complex scenarios with more populations and more evolving traits increase the dimensionality of the solution spaces we seek to understand, but we remain restricted to visualising two-dimensional sections. Visualising a sequence of such sections at multiple points of a solution, as is presented in Appendix “Bifurcation dynamics” section, is arduous but provides further insights into the properties of the solution space. Developing a solid understanding of simple systems such as (4), whose fitness landscapes and solution spaces can be visualised (almost) in their entirety, may be the best aid to inform interpretations of the properties of more complex systems.

Conclusions

This work has demonstrated the validity of the eco-evolutionary modelling framework (2), and its extension to multiple populations (34). The framework assumes that population fitness functions mirror individual growth functions, that phenotype abundances have beta distributions across traits, and that the trait differentiation Q is fundamental to simulating key evolutionary processes such as branching. This confirms previous testing of this framework in other evolutionary scenarios (Cropp and Norbury 2021, 2022).

The correspondence between the predictions of a model of trait evolution that simulates the dynamics of each phenotype, without assuming a particular distribution of traits or a fitness function, and those of our eco-evolutionary population model suggests the modelling framework captures the essence of evolutionary change. This correspondence is evident both in simple comparisons of the changes over time of the phenotype abundances and in comparisons of fundamental properties of the systems such as bifurcation behaviours. The simulations confirm the efficacy of small variance approaches to the modelling of evolution in populations. While this work assumed beta-distributed traits, closely related results have been obtained by oligomorphic approaches that assumed normal distributions (Lion et al. 2023).

The differences in bifurcation behaviour inferred from the simple population model (4) in this work, that indicated the bifurcation from a non-branching solution to a branching solution would occur as a symmetric pitchfork bifurcation in a symmetric fitness landscape but as an imperfect pitchfork (or blue-sky) bifurcation in an asymmetric fitness landscape appear to be borne out by the dynamics of the phenotype model (1). Despite the simple model being only an approximation to the full model (6)-(8), the correspondence between the dynamics of the branching of the phenotype model (Fig. 1) and the full model (Fig. 4) suggest that the three models exhibit the same fundamental properties. In particular, the differences in the branching dynamics between the symmetric and asymmetric cases in the models demonstrate that all three models have pitchfork bifurcations in the symmetric fitness landscape and imperfect pitchfork/blue sky bifurcations in the asymmetric fitness landscape.

In the context that the results presented in this work support the equivalence of the phenotype and population modelling approaches, and the utility of the simple population model in understanding the properties of both the more complicated models, we make the following observations:

  • the eco-evolutionary modelling framework (2), within which specific models are obtained by defining an \(\hat{f}_i\) and \(\hat{\gamma }_i\)(s) for each population \(P_i\), can provide plausible simulations of evolutionary processes;

  • generic properties of the modelling framework and simple versions of complex models can provide insights into the dynamical properties induced by coupled eco-evolutionary feedbacks in more complex eco-evolutionary systems;

  • the heuristic model provides a theoretical basis for an argument that environmental change could affect the manner in which an ecosystem adapts, in particular, whether it is capable of evolutionary branching or not;

  • changes in the variance of the phenotype distribution predicted by Q appear to be important in evolutionary branching, as it allows the variance in the system to spike, but remain bounded (Figs. 7b and 15);

  • evolutionary branching produces a two sub-population system with an equilibrium state that becomes less sensitive to evolutionary feedback as it evolves;

  • systems may have multiple eco-evolutionary stable states, that may simultaneously represent single or branched populations, with which equilibrium is found in a simulation depending on the initial conditions;

  • using asymmetric initial conditions on symmetric phase planes may break the symmetry of solutions over early evolutionary time scales. Ultimately, symmetry such that \(\hat{\gamma }_2^* = 1-\hat{\gamma }_1^*\) (Fig. 14c) is restored as the system approaches eco-evolutionary equilibrium.

We note that in simulations of evolutionary branching, because the two sub-populations are drawn from the same population, the sub-population initial conditions are nearly identical, and their zero isoclines are nearly coincident in the ecological space until evolution creates two distinct sub-populations. This creates a sensitive system, in which small changes (evolutionary or environmental) can dramatically change the location of stable equilibrium points. As the sub-populations evolve their zero isoclines rotate and intersect in a more robust and stable ecological equilibrium point. These properties may facilitate sequential “evolutionary rescues” of the sub-populations while their trait means slowly change, but leave feasible that sub-populations that may coexist in a stable environment do not co-exist in a variable environment.

Further, when simulating real systems such as those influenced by climate change, that perforce include environmental forcings, eco-evolutionary stable equilibria in simulations move in response to external forcings, and evolutionary outcomes may become contingent upon the environment (Wong 2019). Although not examined in this work, the potential for equilibrium points to be moved through bifurcations that create or destroy evolutionary branching points is particularly interesting. The adaptation of marine phytoplankton, with their rapid reproduction rates and strong seasonal dynamics, to warming oceans may be an interesting example of this problem. This may be especially pressing given the role of marine phytoplankton in maintaining the level of carbon dioxide and oxygen in the atmosphere (Irwin et al. 2015; Padfield et al. 2017; Hinners et al. 2017; Ward et al. 2019; Le Gland et al. 2021; Beaufort et al. 2022; Behrenfeld et al. 2022) and mediating the transfer of climatically important gases between the ocean and atmosphere (Charlson et al. 1987; Lancelot et al. 2010; Bullock et al. 2017).

Eco-evolutionary modelling and the commonly used AD method, applied to the same dP/dt and \(d\hat{\gamma }/dt\) equations, produce the same equilibrium solutions for an arbitrary small positive value of Q. Dynamically simulating Q is the major difference between our eco-evolutionary modelling framework and AD, and this is important in being able to simulate the dynamics of evolving ecosystems. In particular, Fig. 7 demonstrates that increasing variance is a key aspect of evolutionary branching. Further, AD is predicated on the ecological system having a stable equilibrium state located within the feasible region of the ecological state space. Eco-evolutionary dynamics have no such constraint, and our simulations show that significant evolutionary change can occur in systems when the ecological equilibrium state lies outside the feasible region of the ecological state space. Our eco-evolutionary modelling framework extends AD from long-term equilibrium solutions to much more of the dynamical system solution space.

The development of population-level eco-evolutionary models such as those presented here greatly reduces the number of equations involved compared to phenotype models and facilitates the inclusion of eco-evolutionary processes in plankton ecosystems into global climate models. This work provides a specific example of where joint feedback between ecological and evolutionary dynamical processes have significant outcomes; here, evolutionary branching can depend on the dynamical path taken. Perhaps, the most significant outcome of this work is the general framework for modelling eco-evolutionary systems and the understanding it can facilitate into the mechanisms underlying the dynamics of eco-evolutionary systems in general, and evolutionary branching in particular.