Abstract
Various vaccines have been approved for use to combat COVID19 that offer imperfect immunity and could furthermore wane over time. We analyze the effect of vaccination in an SLIARS model with demography by adding a compartment for vaccinated individuals and considering diseaseinduced death, imperfect and waning vaccination protection as well as waning infectionsacquired immunity. When analyzed as systems of ordinary differential equations, the model is proven to admit a backward bifurcation. A continuous time Markov chain (CTMC) version of the model is simulated numerically and compared to the results of branching process approximations. While the CTMC model detects the presence of the backward bifurcation, the branching process approximation does not. The special case of an SVIRS model is shown to have the same properties.
Introduction
According to the World Health Organization World Health Organization (2021b), at the time of writing, the total number of confirmed cases of Coronavirus Disease (COVID19) has exceeded 170 million, about a year and a half after the disease and the virus that causes it (SARSCoV2) were officially named. Among the confirmed cases are more than 3.7 million deaths World Health Organization (2021b).
Of particular importance in the fight against COVID19 was the development of vaccines. It is a testament to the amount of effort that went into this endeavour that, barely one year after the start of the crisis, at least 7 different vaccines have been administered World Health Organization (2021a). Three vaccines, mRNAbased vaccines from PfizerBiontech and Moderna along with a viral vector vaccine from Janssen, have been granted emergency use status in the United States United States Centers for Disease Control and Prevention (2021). Worldwide, several other vaccines are available at the time of writing: AstraZeneca, Sputnik, Sinovacc, Covishield, according to World Health Organization (2021a). All these vaccines have different characteristics, which are best summarized using three features: the number of doses required to generate immunity, the level and type of immunity provided and the duration of the protection.
While the number of doses is an important feature, for COVID19, it has this far generated specific issues mostly at the time of vaccine rollout. The second characteristic of a vaccine is its efficacy: a vaccine does not always confer full immunity to the disease, in which case is is called imperfect. Such vaccine imperfections have different sources, but in with COVID19, one of the main reason is the emergence of SARSCoV2 variants less sensitive to some of the vaccines. Finally, it is possible that the immunity provided by the vaccine does not last: the vaccine is said to wane. Clearly, the three characteristics are intimately linked: vaccines against some diseases require booster shots because the protection they afford is known to wane; efficacy may diminish because a full dose regimen is not followed, etc.
Vaccination for COVID19 is presenting heretofore unseen challenges. It is the first time in the history of vaccination that the cycle from development to global worldwide rollout occurs over such a short time period. Vaccination against poliomyelitis and smallpox were on the same scale, but much evidence had been collected about efficacy and waning over the years. Vaccination against the 2009 pandemic H1N1 influenza strain became possible very soon but a lot was already known about influenza vaccines because of annual vaccination campaigns.
Another facet of the fight against COVID19 has been the unprecedented reliance on mathematical models to study critical scientific questions about the dynamics of spread of the disease and thereby help guide public policy. Even in 2020, there were quite a lot of mathematical models published to study COVID19. See, e.g., Mohamadou et al. (2020), Ogden et al. (2020) and the references therein. This has only increased since; see, e.g., the extensive review in Cao and Liu (2021), Xiang et al. (2021) for models regarding public health interventions or Arino (2022) for models related to the spatial spread of the disease. It is interesting to note that many of the mathematical models used to study SARSCoV2 and COVID19 have their roots in the classical SusceptibleInfectedRemoved (SIR) model of Kermack and McKendrick (1927). Some authors have adapted the classical SIR structure; see, e.g., Cooper et al. (2020), Nguemdjo et al. (2020). Others have extended the model to include a latent or exposed compartment, such as Chen et al. (2020), Yang and Wang (2020), while others have gone further to include both latent/exposed and asymptomatic compartments, as in Arino et al. (2020), Arino and Portet (2020), Basnarkov (2021), Li et al. (May 2020), Rădulescu et al. (2020), Tsay et al. (2020). We refer to the general class of models that extend the classical SIR model structure to include latent/exposed (L) and asymptomatic (A) compartments as SLIARtype models. SLIARtype models were first developed to study H5N1 influenza by Arino et al. (2006), Longini et al. (2005) combining characteristics of models for SARSCoV suggested by Brauer (2006). Of importance to justify our work here is that most models have made the (completely justified) assumption that considering the vital dynamics (demography) of the population was not required. However, as the crisis drags on and there is more and more talk about vaccination becoming recurrent, the validity of this hypothesis is coming under question.
This is all the more important that, because of uncertainties about COVID19 vaccine characteristics, the use of mathematical modeling to investigate the potential effects of vaccines is a necessity. However, it has been known for some time that in models with demography, the compounding of imperfection and waning of the protection impacts the dynamics of the spread of the disease, sometimes leading to socalled backward bifurcation situations as in Hadeler and van den Driessche (1997), which were first exhibited as a result of vaccination in an SIS model in KribsZaleta and VelascoHernández (2000) and in an SIRS model in Arino et al. (2003). In a backward bifurcation scenario, there can be multiple endemic equilibria, often occurring in subcritical situations, i.e., when the reproduction number is less than unity. This greatly complicates the mathematical analysis; Arino et al. (2003) is the only work to our knowledge where global conclusions are drawn in a backward bifurcation region. The phenomenon of backward bifurcations has been shown for a variety of epidemic models, see VillavicencioPulido et al. (2015). The existence of a backward bifurcation also has important implications more generally for the dynamics of disease spread and, ultimately, control, since in a backward bifurcation region, solutions are initialcondition dependent. Therefore, the first question we investigate is the existence of a backward bifurcation in a deterministic SLIARS model with demography and vaccination, i.e., a deterministic SVLIARS model.
Our second question concerns the link between the bistable behavior of a deterministic SVLIARS and its related continuous time Markov chain analogue. Indeed, another important teaching of the COVID19 crisis is the importance of case importations (or introductions in the ecological lingo) in the global spread of infectious diseases. Highlighted in Arino et al. (2020), Arino et al. (2021), this phenomenon is best described using a stochastic model. While the effect of importations was of course known before, the amount of scrutiny and the wide availability of data had made studying this aspect possible. In the context of COVID19 and more generally, the emergence or reemergence of a disease, case importations and the initial spread in communities involve a relatively small number of infectious individuals, leading to disease dynamics driven by randomness. Randomness is also present when there is a degree of variability associated with the mechanisms driving the disease dynamics such as transmission or recovery or if environmental randomness affects disease outcomes. Stochastic epidemic models date back to Bernoulli (1760) and have been studied in earnest at least since Kermack and McKendrick (1927). An important feature of these models is that they allow to compute the probability of a minor epidemic and its complement, the probability of a major epidemic. These probabilities were calculated for continuous time Markov chain (CTMC) SI, SIR models by Whittle (1955). CTMC and stochastic differential equation (SDE) models related to deterministic models exhibiting backward bifurcation have been shown to detect bistability Allen and van den Driessche (2006). Relying on knowledge of the bifurcation structure of the corresponding ODE model, we will investigate the capacity to detect bistability in the SVLIARS CTMC.
When direct analysis of CTMC models is intractable, it is necessary to approximate the probabilities of minor and major epidemics. One common approximation technique is to construct and analyze a branching process model. Branching process approximation of the probability of a minor epidemic has been used to great effect Allen and Bokil (2012), Allen and van den Driessche (2013), Edholm et al. (2018) and has been related to the basic reproduction number of a corresponding deterministic model Allen and van den Driessche (2013). However, this technique is a linearization and has been shown to be less successful for highly nonlinear models and away from the diseasefree equilibrium in Milliken (2017). Another way to approximate the probability of a minor epidemic in a CTMC model is to make calculations from an ensemble of sample paths simulated via Gillespie algorithm. This brings us to the third question considered in this work, namely the consideration of whether the CTMC and the BP approximation are equally able to detect a backward bifurcation.
To summarize, in this work we investigate the dynamical behavior of CTMC models in the presence of a backward bifurcation and whether this behavior can be detected using branching process approximation techniques. To this end, we formulate an ODE SLIARtype model with vital dynamics that includes imperfect vaccination and waning immunity and establish conditions for the existence of a backward bifurcation in a biologically relevant parameter regime. A related continuous time Markov chain (CTMC) model is then presented, and branching process approximation and simulation via the Gillespie algorithm are used to approximate the probability of a minor epidemic. By way of example, we show that branching process approximation does not detect the change in dynamics in the CTMC model associated to the backward bifurcation. In an appendix, we consider the same properties in the special case of an SVIRS model.
The deterministic SVLIARS model
Model formulation
The model is an SLIARtype model to which both demography and vaccination are added, i.e., essentially a cross between the SVIRS model of Arino et al. (2003) and the SLIARS model of Arino et al. (2006). We interpret the R compartment here as containing individuals who are immune (potentially for a limited time) to the disease because of diseaseacquired immunity, rather than as removed individuals as is often done in SLIARtype models. See Table 1 for a list of state variables used in the model and Table 2 for a list of parameters. The flow diagram of the system takes the form shown Fig. 1.
The model has flow diagram shown in Fig. 1 and incorporates imperfect and waning vaccine immunity as well as waning diseaseinduced immunity. While it lasts, diseaseinduced immunity is perfect, contrary to the vaccineinduced one. Disease induced mortality is assumed to only occur for symptomatic infected individuals.
System (1) is considered with nonnegative initial conditions. To avoid trivial solutions, it is generally assumed that \(L(0)+I(0)+A(0)>0\).
Preliminary analysis of the SVLIARS model
Before proceeding further, let us briefly consider properties of model (1) without vaccination, i.e., (1) without equation (1b) and with \(p=e=\omega _v=0\). This system has diseasefree equilibrium (\(E_0\)) \(\bar{S}_0=B/d\) and using the same method as used later, one finds the basic reproduction number
This quantity is useful to understand the effect of vaccination. We now turn to the system with vaccination (1).
Proposition 1
The diseasefree equilibrium of system (1) is
where \(S_0\) and \(V_0\) are given by
Proof
Suppose there is no disease, i.e., \(L=I=A=0\). Then from (1f), \(R=0\). So at a disease free equilibrium, \(L=I=A=R=0\). Now consider the positively invariant subsystem of (1) without disease given by
It follows that the \(E_0\) is given by
i.e., the expression (3). \(\square \)
The diseasefree equilibrium allows us to define a quantity useful in practical applications, vaccine coverage. The situation of COVID19 is of course different, since there was no preexisting vaccination coverage, but having access to this quantity is nonetheless helpful for simulations as it can be used to set parameters. Vaccine coverage is the fraction (typically expressed as a percentage) of the population vaccinated, i.e., \(v_c=V(t)/N\). Vaccine coverage can be evaluated at any point in state space, for instance at endemic equilibria, although a closedform solution is rarely obtained. When the system is at the diseasefree equilibrium, though, the following expression holds, in which the dependence on \(E_0\) is indicated:
This expression also provides a useful form of the nonzero components of the DFE as
To continue the analysis, it is useful to define the combination parameter
Using \(\lambda \), (2) takes the form
Theorem 1
The basic vaccination reproduction number for system (1) is given by
where \(S_0\) and \(V_0\) are given by (3). If \(\mathscr {R}_v<1\), then \(E_0\) (3) of (1) is locally asymptotically stable, while it is unstable if \(\mathscr {R}_v>1\).
Proof
Let us use the method of van den Driessche and Watmough (2002). Infected compartments are L, I and A (presented in that order) and the matrices F and V obtained by taking the Fréchet derivatives of the subsystem in the infected variables x written as \(x'=\mathcal {F}\mathcal {V}\) and evaluating at \(E_0\) take the form
and
Computing the dominant eigenvalue of \(FV^{1}\) gives (8). It is straightforward to show that conditions for applying van den Driessche and Watmough (2002, Theorem 2) are satisfied, giving local asymptotic stability of \(E_0\) when \(\mathscr {R}_v<1\) and instability when \(\mathscr {R}_v>1\). \(\square \)
Remark that \(S_0+(1\sigma )V_0\le S_0+V_0=\bar{S}_0\), with equality when \(\sigma =0\), i.e., when vaccine efficacy is zero. This implies that \(\mathscr {R}_v\le \mathscr {R}_0\), the inequality being strict unless \(\sigma =0\). Thus, vaccination always lowers the reproduction number. Actually, the following relationship links \(\mathscr {R}_0\) as given by (2) and \(\mathscr {R}_v\) for the full model (1):
Proposition 2
System (1) admits endemic equilibria according to the following cases:

(i)
A unique positive endemic equilibrium if \(\mathcal {R}_v>1\) or \(\mathcal {R}_v<1\), \(a_1>0\) and \(a_1^24a_0a_2=0\);

(ii)
Two positive endemic equilibria if \(\mathcal {R}_v<1\), \(a_1>0\) and \(a_1^24a_0a_2>0\);

(iii)
Zero positive equilibria otherwise, and in particular when \(\mathscr {R}_0<1\).
Proof
Write (1) as \(\overset{.}{\mathbf {x}}=\mathbf {f}(\mathbf {x})\), where \(\mathbf {x} = (S,V,L,I,A,R)^T\). Solving the nonlinear system of equations \(\mathbf {f}(\mathbf {x})=\mathbf {0}\), we find that, at a positive equilibrium, each of the components of \(\mathbf {x}\) can be written as functions of the equilibrium value of L, itself the root of the quadratic polynomial
where
Before considering endemic equilibria of the full system, let us focus on roots of (9). Since \(\sigma <1\),
Since \(\pi \le 1\), it follows that
Therefore, \(a_2<0\) (unless when \(\sigma =1\), in which case \(a_2=0\)). Clearly,
Note that \(a_1>0\) is equivalent to
where \(\mathcal {R}_0\) is given in (2) and the right equality only holds when \(\sigma <1\); recall that \(a_2=0\) when \(\sigma =1\). Thus, when \(\sigma <1\), \(\mathscr {R}_0<1\implies a_1<0\), since \(a_2/(\lambda ^2(1\sigma ))>0\). Since \(\mathscr {R}_v\le \mathscr {R}_0\), this implies in turn that \(a_0<1\) when \(\mathscr {R}_0<1\), so by Descartes’ Rule of Signs, there are no positive equilibria when \(\mathscr {R}_0<1\) and \(\sigma <1\). The case \(\sigma =1\) is discussed at the end of Section 2.2 and shown to preclude existence of positive equilibria; thus, there are no positive equilibria whenever \(\mathscr {R}_0<1\).
Our next conclusion follows readily from the Rule of Signs of Descartes: regardless of the sign of \(a_1\), if \(a_0>0\), i.e., if \(\mathscr {R}_v>1\), then there is a single positive root of (9). So now assume \(\mathscr {R}_v<1\), i.e., \(a_0<0\). Using the Rule of Signs of Descartes again, if \(a_1<0\) then (9) has no positive root.
So there remains the case where \(\mathscr {R}_v<1\) and \(a_1>0\) to consider, where the Rule of Signs provides the unsatisfactory answer that there are either two (potentially with multiplicity 2) or zero positive roots to (9). Using the Rule of Signs on \(P(L)\) indicates that there are no negative roots of (9) when \(\mathscr {R}_v<1\) and \(a_1>0\). As a consequence, the situation is fully determined by the discriminant \(a_1^24a_0a_2\): if it is positive, there are two distinct positive roots of (9); if it is zero, there is a single (double) root; and if it is negative, there are no real roots.
Putting all this together gives the conditions in the result. Now return to the equilibrium for the whole system (1), expressed as a function of L as
The components I(L), A(L) and R(L) are positive scalar multiples of L. Furthermore, \(V(L)>0\) for all \(L\ge 0\) and when the equilibrium value of L is positive, \(\dot{L} = 0\) implies that \((S(L) + (1\sigma )V(L))>0\) for all \(\sigma \in [0,1]\), implying in turn that \(S(L)>0\) for all \(L\ge 0\). V(L) is a monotone decreasing function of L, so given a value of L, V(L) and S(L) take on unique positive values. Thus, if L is a positive root of (9), then it is the L component of a positive endemic equilibrium with other components given by (14).\(\square \)
When the root of (9) is unique, we denote it \(L^*\), whereas when there are two distinct positive roots, we denote \(L^*\) and \(L_*\) these values, with the convention that \(L_*<L^*\). The resulting endemic equilibria obtained by using (14) are denoted \(E_*\) and \(E^*\). From the properties of (14), all components of \(E^*\) are larger than those of \(E_*\), except \(V_*>V^*\).
Remark that the second condition in Proposition 2(i) defines the value \(\mathscr {R}_{\text {crit}}\) of \(\mathscr {R}_v\) at which the saddle node bifurcation seen in the left part of Fig. 2 takes place; see the discussion in Section 2.3.
As a function of the transmission rate parameter \(\beta \), the basic vaccine reproduction number \(\mathcal {R}_v(\beta )\) is monotone and there exists unique \(\beta ^*\) such that \(\mathcal {R}_v(\beta ^*)=1\). Solving \(\mathcal {R}_v=1\) for \(\beta \) yields
This is useful in simulations, as values of \(\mathscr {R}_v\) are easier to grasp than those of \(\beta \).
At this point, Proposition 2 tells us of situations where multiple endemic equilibria exist, socalled backward bifurcation situations, but says nothing of the stability properties of these equilibria. This is investigated (close to \(\mathscr {R}_v=1\)) in Section 2.3.
Before doing so, though, it is worth briefly investigating particular cases, to check that the model behaves in a way that is similar to existing models exhibiting backward bifurcations. Of particular interest is the situation that prevails when the vaccine is fully efficacious (\(\sigma =1\)), or not efficacious at all (\(\sigma =0\)). These situations should preclude the existence of multiple endemic equilibria. Suppose \(\sigma =1\). Then in (9), \(a_2=0\) so P(L) has at most one positive root and there cannot exist multiple endemic equilibria. Suppose now that \(\sigma =0\). Then \(\mathscr {R}_v=\mathscr {R}_0\), so that \(\mathscr {R}_v<1\iff \mathscr {R}_0<1\), implying there can be no endemic equilibria when \(\mathscr {R}_v<1\).
Existence of a backward bifurcation
The existence of multiple nontrivial equilibria when \(\mathcal {R}_v<1\) given in Proposition 2 suggests that the transcritical bifurcation at the diseasefree equilibrium can be subcritical. This phenomenon is more commonly referred to as a backward bifurcation Hadeler and van den Driessche (1997) and has important implications for control and ultimate eradication of the disease.
Recovered individuals develop a degree of protection from reinfection in the form of (possibly temporary) natural immunity as a result of their bodies’ own immune response Lumley et al. (2021). One goal of vaccination campaigns is to further increase the proportion of protected individuals in the population by generating a vaccineinduced immune response in individuals with no immunity or weak immunity. This provides vaccinated individuals with protection against infection but also can have a populationlevel effect, the socalled herd immunity. The latter occurs when a sufficient proportion of the population becomes immune, implying that infected individuals make most of their contacts with immune individuals, thereby reducing the risk of disease spread to the point that the remaining susceptible individuals are indirectly protected Desai and Majumder (2020). In an ideal setting, once herd immunity is achieved, the number of cases declines to extinction or near extinction. In reality, the possibility of reemergence of the disease remains an everpresent threat.
In mathematical models, it is often the case that the transcritical bifurcation at \(\mathcal {R}_0=1\) (or, in the case of models with vaccination, at \(\mathcal {R}_v=1)\) is supercritical. In these models, the diseasefree equilibrium can typically be shown to be globally asymptotically stable when the basic (vaccine) reproduction number is less than one. Therefore, vaccination campaigns are often designed with the reproduction number in mind, with the herd immunity threshold given by Aschwanden (2020)
The effective reproduction number is the average number of new cases generated by a single infectious case in a population consisting of a combination of susceptible and nonsusceptible individuals. The effective reproduction number is related to the basic reproduction number, but evaluated away from the diseasefree equilibrium. The presence of a backward bifurcation implies that the effective reproduction number has to be reduced further, below a constant \(\mathcal {R}_{\text {crit}}<1\). In this section, we give an analytical proof of the existence of a backward bifurcation and illustrate it numerically for biologically reasonable parameters.
For convenience, write the state variable vector \((S,V,L,I,A,R)^T\) as \(\mathbf {x}^T=(x_1,x_2,x_3,x_4,x_5,x_6)\). Then system (1) can be written \(\overset{.}{\mathbf {x}}=\mathbf {f}(\mathbf {x})\). At each pair \((\mathbf {x},\beta )\), we can calculate the Jacobian matrix \(D\mathbf {f}(\mathbf {x},\beta )\). Writing \(x_1^*=S_0\) and \(x_2^*=V_0\), we have \(E_0^T={\mathbf {x}^*}^T=(x_1^*,x_2^*,0,0,0,0,0)\) and the Jacobian matrix evaluated at the diseasefree equilibrium can be written \(D\mathbf {f}(\mathbf {x}^*,\beta )\). The following Lemma is the result of direct calculation.
Lemma 1
At \(\beta =\beta ^*\), the Jacobian matrix \(D\mathbf {f}(\mathbf {x}^*, \beta ^*)\) admits a simple zero eigenvalue with left eigenvector \(\mathbf {v}=(v_1,v_2,v_3,v_4,v_5,v_6)\) and right eigenvector \(\mathbf {w}^T=(w_1,w_2,w_3,w_4,w_5,w_6)\) given by
where \(w_3\) is free.
Remark 1
Note that \(w_2<0\) for \(w_3>0\). This follows from the fact that
For the purpose of the proof of the backward bifurcation, define the following hypothesis associated to the existence of two positive equilibria:
where \(\mathcal {R}_0\) is given by (36), \(E_0\) is the diseasefree equilibrium and \(v_c(E_0)\) is given by (5).
We can now proceed with establishing the existence of the backward bifurcation analytically.
Theorem 2
System (1) undergoes a backward bifurcation at \(E_0\) and \(\mathcal {R}_v=1\) whenever condition () holds.
Proof
Choose the bifurcation parameter \(\beta \). Then \(\mathcal {R}_v=\mathcal {R}_v(\beta )\) can be viewed as a function of \(\beta \) with \(\mathcal {R}_v(\beta ^*)_=1\). By Lemma 1, at \(\beta =\beta ^*\), \(J{E_0}=D\mathbf {x}(E_0,\beta ^*)\) admits a simple zero eigenvalue with associated eigenvectors \(\mathbf {v}\) and \(\mathbf {w}\) given in equations (17) and (18), respectively. Following CastilloChavez and Song (2004, Theorem 4.1), we calculate the bifurcation parameters
Let the free component of \(\mathbf {w}\), \(w_3=1\). From the Lemma, we have \(v_k=0\) for \(k=1,\,2,\,6\). Thus, we can restrict ourselves to the mixed partials with respect to \(f_3,\,f_4,\,f_5\). Upon inspection we find that the only nonzero mixed partials are
Applying this to (20), along with the fact that \(v_3=1\) and due to Clairaut’s Theorem,
Since \(\beta ^* w_4 + \beta ^* w_5 = \lambda _{\beta =\beta ^*}>0,\)
and
Now consider b. Among \(f_3,\,f_4,\,f_5\), only \(f_3\) exhibits a nonzero derivative with respect to \(\beta \). The nonzero partials \(\frac{\partial ^2 f_3}{\partial \beta \partial x_i}(E_0,\beta ^*)\) are
Hence,
As noted in Remark 1, \(w_2<0\) and \(w_2=w_2\) when \(w_3>0\). Thus, \(a>0\) if and only if
which is equivalent to hypothesis ().\(\square \)
Note that van den Driessche and Watmough (2002, Theorem 4) could also have been used to obtain this result.
Remark 2
By (3), the diseasefree equilibrium number of susceptible and vaccinated individuals is a function of e, the vaccination rate of adults. It follows from (5) that the vaccination coverage is also a function of e. Since the diseasefree equilibrium, and therefore the vaccination coverage, are independent of \(\beta \), the vaccination coverage is constant for each graph depicted in Fig. 2. The vaccine coverage, \(v_c(E_0)\), is monotone increasing in e. However, the right hand side of hypothesis () is a nonmonotone function of e.
Assuming that parameters other than e and \(\beta \) are as in Table 7 in Appendix A, we find that the backward bifurcation exists (() is true) for \(e\in (3.21\times 10^{4},0.107)\). Therefore, the backward bifurcation exists for a wide range of vaccine coverage from approximately 35.4% to approximately 99.5%.
Remark 3
The existence of a backward bifurcation corresponds to a region of bistability for \(\mathcal {R}_v<1\), i.e., existence of two positive endemic equilibria described in Proposition 2 (ii). As \(\mathcal {R}_v\) decreases, the nullclines corresponding to these equilibria come together at the vertex of the parabola (9). As seen in the graph on the left of Fig. 2, the vertex is also the point at which attractive and repulsive branches of equilibria collide, suggesting the point is a saddlenode bifurcation. We refer to the value of \(\mathcal {R}_v\) that corresponds to the vertex (or, equivalently, to this bifurcation point) as \(\mathcal {R}_{\text {crit}}\).
The stochastic SVLIARS model
We now consider a stochastic model in the form of a continuous time Markov chain which is related to the deterministic SVLIARS model (1). Informed by that model, we construct the CTMC, \(\mathbf {X}_t = (S(t), V(t), L(t), I(t), A(t), R(t))\), with the infinitesimal transition probability to state j from state i,
where \(\rho (i,j)\) is the transition rate associated with transition to j from i and can be found in Table 3.
The CTMC model characterized by (26) captures dynamics not captured by the deterministic model (1). In particular, model (26) is well suited to questions related to emergence and reemergence of a disease, when a small population of infectious individuals results in a high degree of randomness driving interactions. It also tracks integer numbers of individuals, making transitions into a state where the disease is extinct possible, rather than approached as a limit in ODE models.
The difference between these models can be seen in relation to the backward bifurcation, when it exists. In the case of model (1), the nullclines which are represented in Fig. 2 divide the solution space into basins of attraction which are forward invariant. However, in model (26), realizations can move between analogous regions with positive probability.
Consider the deterministic setting of model (1) and suppose that the model is at endemic equilibrium in the presence of a backward bifurcation and that \(\mathcal {R}_v\) is slightly greater than one. As a vaccination strategy is deployed, it reduces the reproduction number. However, the population will asymptotically return to endemic equilibria along the nullcline of Fig. 2 until \(\mathcal {R}_v\) decreases below \(\mathcal {R}_{\text {crit}}\), which is less than one.
In the remainder of this section, we explore two important natural questions related to the backward bifurcation and model (26). Does model (26) detect the backward bifurcation shown above for (1)? In other words, do numerical simulations of the probability of a minor epidemic in (26) change quantitatively and qualitatively in the parameter region for which the backward bifurcation exists for (1)? We also investigate whether the backward bifurcation can be detected in a branching process model commonly used to approximate the probability of a minor epidemic.
Multitype Branching Process approximation
As noted in the Introduction, it is common to formulate a branching process to approximate the probability of extinction in a Markov chain model. One of our primary objectives is to investigate whether CTMC models and the branching processes commonly used to approximate CTMCs detect a change in the dynamics associated to the presence of a backward bifurcation in the mean field system (1). For epidemic models with a single infectious individual type, a BienayméGaltonWatson branching process (BGWbp) is used, and a multitype branching process (MTbp) is used for multiple infectious individual types.
Branching process approximation is a linearization technique. In the context of epidemic modeling, the branching process used to approximate a CTMC model captures birth and death probabilities of each infectious type at the diseasefree equilibrium. As a result, branching process approximations are not appropriate to approximate behavior far away from the diseasefree equilibrium and do not capture behavior driven by nonlinear dynamics Milliken (2017).
By assuming the number of susceptible and vaccinated individuals are fixed at diseasefree levels, we can construct the MTbp \(Z_n=(L_n,I_n,A_n)\) with the offspring probability generating function (p.g.f.)
where \(f_i\) is the offspring p.g.f. for \(i=L,\,I,\,A\), respectively. Then \(f_i\) has the form
where \(p(r_L,r_I,r_A)\) is the probability that an individual of type i gives birth to \(r_j\) individuals of type j, for \(j=L,\,I,\,A\). Specifically,
and
The probability of a minor epidemic relative to the CTMC \(\mathbf {X}_t\) with infinitesimal transition probabilities (26) can be approximated by the extinction probability of the multitype branching process with generating function (27). Suppose that \(k_L, k_I, k_A\) individuals of types L, I, A, respectively, are introduced at the disease free quasistationary distribution. Suppose also that the multitype branching process satisfies the conditions of Harris (1963, Theorem 7.1). Then the probability of a minor epidemic is
where \(\mathbf {0}\le \mathbf {q}=(q_L,q_I,q_L)\le \mathbf {1}\) is the fixed point of
where \(\le \) is the standard partial order in \(\mathbb {R}^3\).
The threshold theorem of Allen and van den Driessche (2013) associates the criticality of the branching process to the reproduction number. Let \(\mathbf {q}\) be as above. Then the following theorem is a corollary to Harris (1963, Theorem 7.1) and the Threshold Theorem of Allen and van den Driessche (2013).
Theorem 3
The probability of extinction in the multitype branching process with generating function (27) is given by (30). If \(\mathcal {R_v}\le 1\), then \(\mathbf {q}=\mathbf {1}\). If \(\mathcal {R}_v>1\), then \(\mathbf {q}\) is the unique vector \(\mathbf {0}\le \mathbf {q}<\mathbf {1}\) such that
Proof
First consider
It follows that, if \(\mathbf {x},\mathbf {y}\in [0,1]^3\) with \(\mathbf {x}\le \mathbf {y}\), then
This together with the fact \(\mathbf {F}(\mathbf {0})>\mathbf {0}\), implies that the multitype branching process is not singular. Furthermore, the matrix of first moments \(\mathbb {M}=D\mathbf {F}(\mathbf {1})\) is primitive, since \(\mathbb {M}^2\) is positive Berman and Plemmons (1979). Therefore, the branching process is positive regular. The result follows from application of the Threshold Theorem of Allen and van den Driessche (2013) together with Harris (1963, Theorem 7.1).\(\square \)
The previous result illustrates an important implication of the Threshold Theorem of Allen and van den Driessche (2013) relative to branching process approximation of major epidemics in the presence of a backward bifurcation in the mean field system (1). The threshold theorem implies that the disease will go extinct almost surely in the approximating branching process. Since the mean field system is a kind of limit of the CTMC, the presence of a backward bifurcation there suggests we should be able to detect a backward bifurcation in the CTMC. However, the branching process approximation, according to the previous result, provides the same approximation of almost sure extinction throughout the region of bistability. In the next section, we use numerical simulations of sample paths of the CTMC to determine, by way of example, whether the backward bifurcation is detected in the CTMC or not.
Numerical results
In order to determine whether the CTMC detects the dynamical change suggested by the backward bifurcation in system (1), we estimate the probability of a minor epidemic as the frequency of minor epidemics in an ensemble of one thousand sample paths. The results are compared to the branching process approximation for the same choice of parameters. These experiments are performed for the parameters found in Table 7, except for \(\beta \) and e, which are allowed to vary. The parameter e is allowed to vary to investigate both the supercritical (no backward bifurcation, \(e=0.15\)) and subcritical (backward bifurcation, \(e=0.05\)) paradigms. In the absence of the backward bifurcation, \(\beta \) varies to investigate the two cases \(\mathcal {R}_v<1\) and \(\mathcal {R}_v>1\). In the presence of the backward bifurcation, \(\beta \) varies to investigate the three cases \(\mathcal {R}_v<\mathcal {R}_{\text {crit}}\), \(\mathcal {R}_{\text {crit}}<\mathcal {R}_v<1\), and \(\mathcal {R}_v>1\). The case \(\mathcal {R}_{\text {crit}}<\mathcal {R}_v<1\) represents the region of bistability in the presence of a backward bifurcation. There is no difference between this region and \(\mathcal {R}_v<\mathcal {R}_{\text {crit}}\) in the absence of the bifurcation. The case \(\mathcal {R}_v<\mathcal {R}_{\text {crit}}\) always corresponds to no positive equilibria and the case \(\mathcal {R}_v>1\) always corresponds to a unique positive equilibrium.
Numerical experiments are initialized at the diseasefree quasistationary distribution following the introduction of a single individual of infectious type L, I or A.
Table 4 contains the results of branching process approximation and numerical simulation in the absence of a backward bifurcation. These results correspond to the graph on the right in Fig. 2. We see that the branching process approximation captures both the character and accurately quantifies the probability of a minor epidemic for all three sets of initial conditions and for both values of \(\mathcal {R}_v\).
Table 5 contains the results of the branching process approximation and numerical simulation in the presence of the backward bifurcation and correspond the graph on the left of Fig. 2. They tell a different story. As noted in the discussion following Theorem 3, the branching process provides the same prediction across the entire region \(\mathcal {R}_v\le 1\), namely, that a major epidemic occurs with probability zero. Therefore, the branching process approximation does not detect any dynamical changes due to the presence of the backward bifurcation. Numerical simulation of the CTMC by the Gillespie algorithm does detect such changes. This indicates that a major epidemic occurs in one out of one thousand sample paths in the region where the deterministic model (1) exhibits bistability. We conclude that the CTMC has different dynamical behavior in this region that is not captured by the branching process approximation.
Results for the region \(\mathcal {R}_v>1\) provide further insight. In this region, the branching process approximation captures the qualitative behavior of the CTMC model – that major epidemics occur with positive probability \(1\mathbb {P}(\text {minor epidemic})\). However, numerical simulations suggest that the branching process may not accurately capture the behavior quantitatively. The evidence for this can be seen in the last two rows of Table 5 in the rows corresponding to a unique positive equilibrium. Here we see that the probability approximated by simulation (column Gillespie) is consistently less than the branching process approximation (column BP Approx). This signal in the data can be considered weak since the sample mean has standard deviation on the order of the reciprocal of the square root of the number of simulations. In this case, only 1,000 simulations were performed. The weakness of the signal may also be due to the complexity of the system.
A similar analysis is performed for the SVIRS model studied in Appendix B. In that case, the signal that numerical simulation predicts a lower probability of minor epidemic that branching process approximation is stronger. For that model, the branching process is a singletype BGWbp and the approximation corresponds to Whittle’s approximation for an SIR model Whittle (1955),
This relationship between \(\mathcal {R}_v\) and the probability of a minor epidemic is more representative of a model similar to Fig. 2(a) than to Fig. 2(b). That is, it is more similar to the case of the absence of a backward bifurcation.
Discussion
The phenomenon of bistability due to existence of a backward bifurcation has long been known to occur in SIRtype models that include vaccination, so it is not too surprising that an ODE SVLIARS model including imperfect waning vaccination, waning natural immunity, and diseaseinduced death, would exhibit the bistable behavior we proved here. The analysis of the SVLIARS model (1) is similar to that of similar SIRtype models, but serves as an important reminder that this dynamical behavior is present in many SIRtype epidemic models when they include demography. While vaccination always lowers the reproduction number, its imperfection and waning is also the source of the backward bifurcation in the deterministic model (1), with the important implication that the reproduction number must be lowered below the critical value \(\mathscr {R}_{\text {crit}}<1\) to guarantee the elimination of the disease.
There are many situations in which a stochastic model provides a very valuable complement or alternative to a deterministic ordinary differential equations system, including when considering the emergence or reemergence of a pathogen or variant. Indeed, they provide trajectories that are more realistic and have a nontrivial variance, and provide access to quantities such as mean first passage times that cannot be evaluated with ODEs. One class of stochastic models used in this context is continuous time Markov chains. Indeed, ODEs and CTMCs are very closely related and have many features in common. For instance, equilibria in a deterministic model are related to quasistationary distributions in CTMC models. However, there are also fundamental differences. For one, there is no welldefined separatrix or basins of attraction in CTMC models, so while the mean over a large number of realizations of a CTMC often tracks close to the solution of the corresponding ODE, in a case like the present one where the ODE exhibits bistability, the situation is more complicated.
The epidemiological consequences of a backward bifurcation to public health strategies and outcomes have been previously discussed in the literature; see, e.g., Dushoff et al. (1998); Greenhalgh and Griffiths (2009); Safan et al. (2006). Here we will just review the implications of this dynamical regime in two situations. In the case of an already occurring epidemic, the presence of a backward bifurcation means that the effective reproduction number must be reduced below a threshold \(\mathcal {R}_{\text {crit}}<1\) rather than simply below the threshold at one in order to guarantee the elimination of the disease. Therefore, the presence of the backward bifurcation indicates that additional effort in the way of control measures are needed to eradicate the disease. In the case of emergence or reemergence of the disease, if the basic reproduction number is below one but above \(\mathcal {R}_{\text {crit}}\), then the introduction of a few cases may not result in a major outbreak, but there is a critical number of cases, determined by the parameters, which would lead to a major outbreak. This unexpected behavior is even more likely due to the destabilizing effects of randomness.
For example, according to the deterministic model, the introduction of a few infected individuals generally results in a return to the diseasefree equilibrium. However, our numerical experiments show that, in the case of the CTMC model, there is a positive probability of a major outbreak, consistent with approaching the quasistationary distribution associated to the stable positive equilibrium. This is true despite the fact that the reproduction number is less than unity. This phenomenon occurs in the presence of the backward bifurcation. Simulation of the CTMC in the absence of the backward bifurcation shows the disease almost surely goes extinct following the introduction of a small number of cases when the reproduction number is less that one. The behavior of the CTMC model depends on whether or not there is a backward bifurcation in the related ODE model, particularly in the region \(\mathscr {R}_{\text {crit}}<\mathscr {R}_v<1\). We say the CTMC model detects the bifurcation.
However, as models become more complex, analysis and simulation of CTMC models becomes more difficult, often requiring the use of approximation methods. One such method, relatively simple and easy to implement, is referred to as branching process approximation. Herein lain the third broad question in this work: given a deterministic system exhibiting a bistable situation, would a CTMC and its branching process approximation detect the feature in the same way. The answer to this is negative: while the CTMC detects the backward bifurcation, the relevant branching process approximation does not. In both Sect. 3 and Appendix B, we have shown that, as proven by the combination of the Threshold Theorem of Allen and van den Driessche (2013) and the Criticality Theorem for branching processes Harris (1963, Theorem 7.1), the branching process indicates almost sure extinction of the disease when the reproduction number is below unity, regardless of the dynamical paradigm. In addition to the fact that the branching process approximation fails to detect the backward bifurcation when the reproduction number is less than one, it is also qualitatively inaccurate in the presence of the backward bifurcation when the reproduction number is greater than one. This is true for both the SVLIARS and the SVIRS models, but is more evident in the SVIRS example. This approximation error most likely stems from the fact that the branching process assumes a paradigm in which the probability of a minor epidemic is related to Whittle’s approximation (32). Near \(\mathcal {R}_v=1\) in this paradigm, the probability of a new infection (birth) and the probability of a recovery (death) are nearly equal. However, in the presence of a backward bifurcation (see Fig. 2(a)), the probability of a new infection is, in reality, much higher than the probability of a recovery. This results in greater directed motion away from the diseasefree boundary and a higher probability of a major outbreak (lower probability of a minor outbreak). Thus, the major conclusion about bistability exhibited by both the ODE and the CTMC is obfuscated when the branching process approximation is used.
References
Allen LJS, Bokil VA (2012) Stochastic models for competing species with a shared pathogen. Math Biosci Eng 9(3):461–485
Allen LJS, van den Driessche P (2006) Stochastic epidemic models with a backward bifurcation. Math Biosci Eng 3(3):445–458
Allen LJS, van den Driessche P (2013) Relations between deterministic and stochastic thresholds for disease extinction in continuous and discretetime infectious disease models. Math Biosci 243(1):99–108
Arino J, Bajeux N, Portet S, Watmough J (2020) Quarantine and the risk of COVID19 importation. Epidemiology & Infection 148:e298
Arino J, Boëlle PY, Milliken E, Portet S (2021) Risk of COVID19 variant importation  how useful are travel control measures? Infectious Disease Modelling 6:875–897
Arino J, Brauer F, van den Driessche P, Watmough J, Wu J (2006) Simple models for containment of a pandemic. J R Soc Interface 3(8):453–457
Arino J, McCluskey CC, van den Driessche P (2003) Global results for an epidemic model with vaccination that exhibits backward bifurcation. SIAM J Appl Math 64(1):260–276
Arino J, Portet S (2020) A simple model for COVID19. Infectious Disease Modelling 5:309–315
Arino J (2022) Describing, modelling and forecasting the spatial and temporal spread of COVID19  A short review. Fields Inst Commun 85:25–51
Aschwanden C (2020) The false promise of herd immunity: Why proposals embraced by Donald Trump’s administration and others could bring “untold death and suffering’’. Nature 587:26–28
Basnarkov L (2021) SEAIR Epidemic spreading model of COVID19. Chaos, Solitons & Fractals 142:110394
Berman A, Plemmons RJ (1979) Nonnegative Matrices in the Mathematical Sciences. Academic Press, New York
Bernoulli D (1760) Essai d’une nouvelle analyse de la mortalité causée par la petite vérole et des avantages de l’inoculation pour la prévenir. Mémoires de Mathématiques et de Physique, Académie Royale des Sciences, pages 1–45
Brauer F (2006) Some simple epidemic models. Math Biosci Eng 3:1–15
Cao L, Liu Q (2021) COVID19 Modeling: A Review. Available at SSRN, 2021
CastilloChavez C, Song B (2004) Dynamical models of tuberculosis and their applications. Math Biosci Eng 1(2):361–404
Chen TM, Rui J, Wang QP, Zhao ZY, Cui JA, Yin L (2020) A mathematical model for simulating the phasebased transmissibility of a novel coronavirus. Infect Dis Poverty 9:24
Cooper I, Mondal A, Antonopoulos CG (2020) A SIR model assumption for the spread of COVID19 in different communities. Chaos, Solitons & Fractals 139:110057 (14)
Desai AN, Majumder MS (2020) What is herd immmunity? JAMA 324(20):2113
Dushoff J, Huang W, CastilloChavez C (1998) Backwards bifurcations and catastrophe in simple models of fatal diseases. J Math Biol 36(3):227–248
Edholm CJ, Emerenini BO, Murillo AL, Saucedo O, Shakiba N, Wang X, Allen LJS, Peace A (2018) Searching for superspreaders: identifying epidemic patterns associated with superspreading events in stochastic models. In: Understanding complex biological systems with mathematics, vol. 14 of Assoc. Women Math. Ser., pp. 1–29. Springer, Cham
Greenhalgh D, Griffiths M (2009) Backward bifurcation, equilibrium and stability phenomena in a threestage extended BRSV epidemic model. J Math Biol 59(1):1–36
Hadeler KP, van den Driessche P (1997) Backward bifurcation in epidemic control. Math Biosci 146:15–35
Harris TE (1963) The Theory of Branching Processes. Springer, Berlin
Kermack WO, McKendrick AG (1927) A contribution to the mathematical theory of epidemics. Proc. Roy. Soc. London , Ser. A 115:700–721
KribsZaleta C, VelascoHernández J (2000) A simple vaccination model with multiple endemic states. Math Biosci 164:183–201
Li R, Pei S, Chen B, Song Y, Zhang T, Yang W, Shaman J (2020) Substantial undocumented infection facilitates the rapid dissemination of novel coronavirus (SARSCoV2). Science 368:489–493
Longini IM, Nizam A, Xu S, Ungchusak K, Hanshaoworakul W, Cummings DAT, Halloran ME (2005) Containing pandemic influenza at the source. Science (New York, N.Y.) 309:1083–1087
Lumley SF, O’Donnell D, Stoesser NE, Mathews PC, Howarth A, Hatch SB, Marsden BD, Cox S, James T, Warren F, Peck LJ, Ritter TG, de Toldedo Z, Warren L, Axten D, Cornall RJ, Jones EY, Stuart DI, Screaton G, Ebner D, Hoosdally S, Chand M, Crook DW, O’Donnell AM, Conlon CP, Pouwels KB, Walker AS, Peto TEA, Hopkins S, Walker TM, Jeffery K, Eyre DW (2021) Antibody status and incidence of SARSCoV2 infection in health care workers. N Engl J Med 384(6):533–540
Milliken E (2017) The probability of extinction of infectious salmon anemia virus in one and two patches. Bull Math Biol 79(12):2887–2904
Mohamadou Y, Halidou A, Kapen PT (2020) A review of mathematical modeling, artificial intelligence and datasets used in the study, prediction and management of COVID19. Appl Intell 50(11):3913–3925
Nguemdjo U, Meno F, Dongfack A, Ventelou B (2020) Simulating the progression of the COVID19 disease in Cameroon using SIR models. PLoS ONE 15(8):1–10
Ogden NH, Fazil A, Arino J, Berthiaume P, Fisman DN, Greer AL, Ludwig A, Ng V, Tuite AR, Turgeon P, Waddell LA, Wu J (2020) Modelling scenarios of the epidemic of COVID19 in Canada. Canada Communicable Disease Report (CCDR) 46(6):198–204
Paul G, Chad R (2021) Newborn antibodies to SARSCoV2 detected in cord blood after maternal vaccination. BMC Pediatr 21(138):1–2
Rădulescu A, Williams C, Cavanagh K (2020) Management strategies in a SEIRtype model of COVID19 community spread. Sci Rep 10:1–16
Safan M, Heesterbeek H, Dietz K (2006) The minimum effort required to eradicate infections in models with backward bifurcation. J Math Biol 53(4):703–718
Tsay C, Lejarza F, Stadtherr MA, Baldea M (2020) Modeling, state estimation, and optimal control for the us covid19 outbreak. Sci Rep 10:1–12
United States Centers for Disease Control and Prevention. CDC Different (COVID19) Vaccines, Accessed 20210301
van den Driessche P, Watmough J (2002) Reproduction numbers and subthreshold endemic equilibria for compartmental models of disease transmission. Math Biosci 180:29–48
VillavicencioPulido G, Barradas I, Beatriz L (2015) An epidemiological model with multiple endemic states. J Biol Syst 23(suppl.):S17–S31
Whittle P (1955) The outcome of a stochastic epidemic  A note on Bailey’s paper. Biometrika 42(1–2):116–122 (06)
World Health Organization. WHO Coronavirus Disease (COVID19): Vaccines, Accessed 20210310
World Health Organization. WHO Coronavirus Disease (COVID19) Dashboard, Accessed 20210610
Xiang Y, Jia Y, Chen L, Guo L, Shu B, Long E (2021) COVID19 epidemic prediction and the impact of public health interventions: A review of COVID19 epidemic models. Infectious Disease Modelling 6:324–342
Yang C, Wang J (2020) A mathematical model for the novel coronavirus epidemic in Wuhan. China. Mathematical Biosciences and Engineering 17(3):2708–2724
Acknowledgements
JA acknowledges partial support from the Natural Sciences and Engineering Research Council of Canada through a Discovery Grant and the Emerging Infectious Disease Modelling initiative, as well as the Canadian Institutes for Health Research through the Canadian Mathematical Modelling of COVID19 Task Force.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendices
Parameters for numerical simulations
Table 7 contains the parameter values used in Fig. 2 and for the numerical experiments in Sect. 3.2. While the values have been chosen to be reasonable for an infectious disease, they are not intended to represent any particular data set or to be accurate for the case of COVID19. Instead, these values were chosen to illustrate the existence of a backward bifurcation. Note that \(\eta =1\) is a simplifying assumption implying that symptomatic and asymptomatic individuals have the same rate of disease transmission. Note also that \(p=0\) reflects the assumption that all newborns are totally susceptible to the disease. While there is preliminary evidence that newborns may inherit a degree of vaccine induced immunity Paul and Chad (2021), more research needs to be done. Our assumption that newborns are totally susceptible does not change the bifurcation results qualitatively.
An SVIRS model
In this section, we study a simplified epidemic model applicable to the COVID19 pandemic. We propose deterministic and stochastic models of an SIRStype model with vaccination. The deterministic SVIRS model is a small variation on the model of Arino et al. (2003) obtained by including disease induced mortality and using mass action instead of proportional incidence. Note that we interpret the R compartment here as containing individuals who are immune (potentially for a limited time) to the disease because of diseaseacquired immunity. See Table 8 for a complete list of state variables used in the models. The flow diagram of the system takes the form shown Fig. 3.
Deterministic SVIRS model
The deterministic SVIRS model with imperfect and waning vaccine induced immunity as well as waning diseaseinduced immunity takes the form
As mentioned, (33) is very similar to the model in Arino et al. (2003) and so analysis results are similar to those found there.
Proposition 3
System (33) admits a unique diseasefree equilibrium \(E_0 = (S_0,V_0,0,0)\), where
are the equilibrium values of S and V at the unique equilibrium of the positively invariant subsystem
Proposition 4
The vaccine reproduction number of system (33) is given by
The diseasefree equilibrium \(E_0\) is locally asymptotically stable for \(\mathcal {R}_v<1\) and unstable for \(\mathcal {R}_v>1\).
Proof
The Jacobian of system (33) evaluated at the diseasefree equilibrium \(E_0\) is given by
The submatrix of the Jacobian associated to the infected classes is \(1\times 1\) and can be decomposed into \(FV\) where
Following van den Driessche and Watmough (2002) and since F and V are scalar,
and (36) follows when substituting the values \(S_0\) and \(V_0\) from (34).
Regarding stability, the Jacobian matrix is block upper triangular and admits the eigenvalues
Therefore, all eigenvalues of the linearized system are negative when \(\mathcal {R}_v<1\), while \(\lambda _3\) is positive when \(\mathcal {R}_v>1\), implying the result. \(\square \)
Proposition 5
Let \(\mathcal {D}=a_1^24a_0a_2\), where \(a_0,a_1,a_2\) are given by (38). System (33) admits endemic equilibria according to the following cases:

(i)
A unique positive endemic equilibrium if \(\mathcal {R}_v>1\) or \(\mathcal {R}_v<1\), \(a_1>0\) and \(\mathcal {D}=0\);

(ii)
Two positive endemic equilibria if \(\mathcal {R}_v<1\), \(a_1>0\) and \(\mathcal {D}>0\);

(iii)
Zero positive equilibria otherwise.
Proof
The I component of nonzero equilibria of system (33) are the roots of the quadratic equation
where
First, note that \(\mathsf {sgn}(a_0)=\mathsf {sgn}(\mathscr {R}_v1)\). So, since \(a_2<0\), from the Rule of Signs of Descartes, the endemic equilibrium is unique when \(\mathscr {R}_v>1\) and there is no endemic equilibrium if \(\mathscr {R}_v<1\) and \(a_1<0\).
Let now \(\mathcal {D}=a_1^24a_0a_2\) be the discriminant of (37) and
Then if I is the value of the I component at an equilibrium then the value of the other components is given by
Denote \(E^*=(S(I^*),V(I^*),I^*,R(I^*))\) and \(E_*=(S(I_*),V(I_*),I_*,R(I_*))\). Since \(S(I),\,V(I)\) and R(I) are positive when I is positive, the result follows from analysis of \(P(I)=0\).\(\square \)
In order to facilitate the analysis of the backward bifurcation that in the following theorem, let us define the condition:
Theorem 4
If () holds, then system (33) undergoes a backward bifurcation at \(E_0\) and \(\mathcal {R}_v=1\).
Proof
Consider \(\mathcal {R}_v=\mathcal {R}_v(\beta )\) and let \(\beta ^*\) be the critical value such that \(\mathcal {R}_v(\beta ^*)=1\). Then
At \(\beta =\beta ^*\), \(E_0\) is a hyperbolic equilibrium and center manifold theory can be applied to analyze the dynamics of system (33) near \(E_0\) for \(\beta \) in a neighborhood of \(\beta ^*\). Relabel \((S,V,I,R)^T\) as \(\mathbf {x}=(x_1,x_2,x_3,x_4)^T\) so that system (33) can be written \(\mathbf {x}=\mathbf {f}(\mathbf {x})\). Then the Jacobian of system (33) can be viewed as a function of both the state vector \(\mathbf {x}\) and the bifurcation parameter \(\beta \) and written \(D\mathbf {f}(\mathbf {x},\beta )\). The matrix \(D\mathbf {f}(E_0,\beta ^*)\) admits left and right eigenvectors \(\mathbf {v}\) and \(\mathbf {w}\), respectively. The left eigenvector \(\mathbf {v} = (0,0,1,0)\) and the right eigenvector \(\mathbf {w}^T = (w_1,w_2,w_3,w_4)\), where \(w_3\) is free and
where \(x_1^0 = S_0\) and \(x_2^0 = V_0\). In order to apply Theorem 4.1 of CastilloChavez and Song (2004), we must first calculate the parameters
Let \(w_3=1\). Since the only nonzero component of \(\mathbf {v}\) is \(v_3=1\), we have that
Additionally,
System (33) undergoes a backward bifurcation when \(a>0\), which is true whenever () holds. \(\square \)
Remark that if the vaccine has perfect efficacy, i.e., if \(\sigma =1\), then \(a_2=0\), implying that there is no backward bifurcation possible in this case. Furthermore, in the case where \(\sigma =1\), a positive solution to \(P(I)=0\) exists if \(a_0/a_1<0\), which is readily shown to be equivalent to \(\mathscr {R}_v>1\). Also, (36) takes the form
Stochastic SVIRS Model
We now consider a stochastic model in the form of a continuous time Markov chain which is related to the deterministic SVIRS model (33). Informed by that model, we construct the CTMC, \(\mathbf {X}_t = (S(t), V(t), I(t), R(t))\), with the infinitesimal transition probability to state j from state i,
where \(\rho (i,j)\) is the transition rate associated with transition to j from i and can be found in Table 9.
BienayméGaltonWatson Branching Proccess
Since the SVIRS model has a single infectious type, I, the CTMC can be approximated using a BGWbp. By assuming that Susceptible and Vaccinated individuals are fixed at diseasefree levels, we can construct the BGWbp \(I_n\) with the offspring probability generating function
The next result follows from Harris (1963, Theorem 7.1).
Theorem 5
The probability of a minor epidemic in the branching process \(I_n\) with initially \(i_0\) infectious individuals is
where
Proof
The branching process is positive regular and not singular. Therefore \(0\le q \le 1\) is the fixed point satisfying
where f is given in (41). Direct calculation shows that the roots of the fixed point equation (42) are
\(\square \)
Numerical results
In this section, we compare results of numerical simulation of the CTMC (40) with the results of approximation by the BGWbp characterized by (41). The purpose of these simulations is twofold: to determine if the effect of the backward bifurcation is detected in the CMTC model; and to compare the accuracy of the branching process approximation in the presence/absence of the backward bifurcation.
For these numerical experiments, the parameter e is used to select for the presence (\(e=0.05\)) or absence (\(e=0.15\)) of the backward bifurcation. The results are presented for various values of \(\mathcal {R}_v\) which differentiate between the paradigms of no positive equilibria (\(\mathcal {R}_v<\mathcal {R}_{\text {crit}}\)), two positive equilibria resulting in bistability (\(\mathcal {R}_{\text {crit}}<\mathcal {R}_v\)), and a unique positive equilibrium (\(\mathcal {R}_v>1\)). The value of \(\mathcal {R}_v\) is selected by varying the parameter \(\beta \). All other parameters are fixed and their values are given in Table 6. The results in the absence of the backward bifurcation are presented in Table 10 and in the presences of the backward bifurcation in Table 11.
Rights and permissions
About this article
Cite this article
Arino, J., Milliken, E. Bistability in deterministic and stochastic SLIARtype models with imperfect and waning vaccine protection. J. Math. Biol. 84, 61 (2022). https://doi.org/10.1007/s00285022017659
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s00285022017659
Keywords
 Epidemic model
 Waning immunity
 Backward bifurcation
 Continuous time Markov chain
 Branching process approximation
Mathematics Subject Classification
 92D30
 60J28
 60J85
 34C23