1 Introduction

Today, in order to comprehend the long-term behavior of a population, many researchers conduct extensive research on the dynamics of interacting prey-predator models. Various nonlinear ODE models are studied, and the interaction between predator and prey is analyzed [1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24]. The classic predator-prey model is the Lotka–Volterra model, which was independently proposed by Lotka in the United States in 1925 and Volterra in Italy in 1926. However, there are some specific classes among them, called the Gause type models [1, 2]. The research of predator-prey model and infectious disease model has always been a hot topic in biomathematics [1,2,3,4,5,6,7,8,9, 11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31]. In 1931, Allee discovered that the living state of the cluster is conducive to the growth of the population, but the density is too high and will inhibit the growth of the population and even become extinct due to resource competition. For each population, there must be an independent optimal density for growth and reproduction, the mechanism is called the Allee effect. There are also lots of people doing research on the predator-prey model with Allee effect in prey growth [3, 8, 9, 12, 14, 22, 24].

We consider the predator-prey model with Allee effect and Holling type-I functional response in predator growth [3] as follows:

$$ \begin{aligned} &\frac{dN}{dT} = Ng(N) - p(N)P, \\ &\frac{dP}{dT} = cp(N) - q(P)P, \end{aligned} $$
(1)

where \(g(N) = r(1 - \frac{N}{K})(N - L)\) and \(p(N) = aN\), and the initial condition is \(N(0),P(0) > 0\). N is the prey population and P is the predator population, \(q(P)\) is the average loss rate of predators, c is the conversion efficiency from prey to predator, K is the carrying capacity, \(g(N)\) is the per capita prey growth rate, r is the intrinsic growth rate of prey, L is the Allee effect threshold, \(p(N)\) is the prey dependent functional response, and a is the prey capture rate by their predators. So we get

$$ \begin{aligned} &\frac{dN}{dT} = Nr\biggl(1 - \frac{N}{K}\biggr) (N - L) - aNP, \\ &\frac{dP}{dT} = c(aN)P - mP, \end{aligned} $$
(2)

where a and m are all positive parameters. m is the intrinsic death rate of the predators.

2 Strong Allee effect

In order to reduce the number of parameters in the latter calculation, we can make model (2) dimensionless as follows:

$$ \begin{aligned} &\frac{dx}{dt} = x(1 - x) (x - \beta ) - \alpha xy, \\ &\frac{dy}{dt} = \gamma xy - \delta y, \end{aligned} $$
(3)

where \(x = \frac{N}{K}\), \(y = P\), \(t = KrT\), \(\alpha = \frac{a}{Kr}\), \(\beta = \frac{L}{K}\), \(\gamma = \frac{ca}{r}\) and \(\delta = \frac{m}{Kr}\). It is easy to see \(0 \le x \le 1\). The threshold of the Allee type is β and satisfies the conditions \(0 < \beta < 1\) for a strong Allee effect [3].

3 Equilibria and existence

In order to find the equilibrium point of model (3), we consider the prey and predator nullcline of this model (3), to get

$$\begin{aligned}& x(1 - x) (x - \beta ) - \alpha xy = 0, \\& \gamma xy - \delta y = 0, \end{aligned}$$

we easily see that model (3) exhibits four equilibrium points \(E_{s0} = (0,0)\), \(E_{s1} = (\beta ,0)\), \(E_{s2} = (1,0)\), \(E_{s^{*}} = (x_{*},y _{*})\). Here \(x_{*} = \frac{\delta }{\gamma } \), \(y_{*} = \frac{(1 - \frac{ \delta }{\gamma } )(\frac{\delta }{\gamma } - \beta )}{\alpha } \). For a positive equilibrium point, we have \(\beta < \frac{\delta }{\gamma } < 1\).

4 Boundedness of the model

Theorem 1

All the solutions of model which start in \(R_{ +}^{2}\) are uniformly bounded.

Proof

A function is defined by us that is \(\chi = x + \frac{\alpha }{ \gamma - \delta + \eta } y\). Therefore, the time derivative of the above equation along the solution of model (3) is

$$\begin{aligned} \frac{d\chi }{dt} =& \frac{dx}{dt} + \frac{\alpha }{\gamma - \delta + \eta } \frac{dy}{dt} \\ =& - x^{3} + (1 + \beta )x^{2} - \beta x - \alpha xy + \frac{\alpha }{ \gamma - \delta + \eta } (\gamma xy - \delta y). \end{aligned}$$

Now for each \(\eta > 0\) and \(0 \le x \le 1\), we have

$$\begin{aligned} \frac{d\chi }{dt} + \eta \chi =& - x^{3} + (1 + \beta )x^{2} - \beta x - \alpha xy + \frac{\alpha }{\gamma - \delta + \eta } (\gamma xy - \delta y) + \eta x + \frac{\eta \alpha }{\gamma - \delta + \eta } y \\ =& - x^{3} + (1 + \beta )x^{2} - \beta x + \eta x - \alpha xy + \frac{ \alpha \gamma }{\gamma - \delta + \eta } xy - \frac{\alpha \delta }{ \gamma - \delta + \eta } y + \frac{\eta \alpha }{\gamma - \delta + \eta } y \\ \le& - x^{3} + (1 + \beta )x^{2} - \beta x + \eta x - \alpha y + \frac{ \alpha \gamma }{\gamma - \delta + \eta } y - \frac{\alpha \delta }{ \gamma - \delta + \eta } y + \frac{\eta \alpha }{\gamma - \delta + \eta } y \\ \le& - x^{3} + (1 + \beta )x^{2} - \beta x + \eta x \\ \le& (1 + \beta )x^{2} - \beta x + \eta x \\ \le& 1 + \eta . \end{aligned}$$

Hence we can find \(\omega > 0\) such that

$$ \frac{d\chi }{dt} + \eta \chi = \omega . $$

In summary, we have \(\frac{d\chi }{dt} \le - \eta \chi + \omega \), which implies that

$$ \chi (t) \le e^{ - \eta t}\chi (0) + \frac{\omega }{\eta } \bigl(1 - e^{ - \eta t}\bigr) \le \max \biggl(\chi (0),\frac{\omega }{\eta } \biggr). $$

Moreover, we have \(\lim \sup \chi (t) \le \frac{\omega }{\eta } < M\) as \(t \to \infty \), which is not related to the initial conditions. □

5 Local stability analysis

In this section, we will analyze the local stability of model (3).

Theorem 2

  1. (1)

    \(E_{s0}\) is locally asymptotically stable.

  2. (2)

    If \(\gamma < \frac{\delta }{\beta } \), then \(E_{s1}\) is the saddle point, otherwise it is the unstable node.

  3. (3)

    When \(\gamma < \delta \), \(E_{s2}\) is locally asymptotically stable and is a saddle point otherwise.

  4. (4)

    The positive equilibrium \(E_{s^{*}}\) is locally stable when \(\beta < \frac{2\delta - \gamma }{\gamma } \) and is unstable node otherwise.

Proof

It can be concluded by calculating the Jacobian matrix of model (3) at \(E_{s0}\)

J s 0 = [ β 0 0 δ ] .

Also we can find that \(E_{s0}\) is locally asymptotically stable.

By evaluating the Jacobian matrix of model (3) at \(E_{s1}\), we find

J s 1 = [ β β 2 α β 0 γ β δ ] .

We find that the first eigenvalue \(\lambda _{1} = \beta - \beta ^{2}\) is positive, then \(E_{s1}\) is unstable as a saddle point if \((\beta - \beta ^{2})(\gamma \beta - \delta ) > 0\), that is, if \(\gamma > \frac{ \delta }{\beta } \), and is a stable saddle point otherwise.

We calculate the Jacobian matrix of model (3) at \(E_{s2}\); we have

J s 2 = [ β 1 α 0 γ δ ] .

We find that the first eigenvalue \(\lambda _{1} = \beta - 1\) is negative because of \(\beta < 1\), then \(E_{s2}\) is stable if \(\gamma < \delta \), and \(E_{s2}\) is a saddle point when \(\gamma > \delta \).

We calculate the Jacobian matrix of model (3) at \(E_{s^{*}}\) is given by

J s = [ ( 2 + 2 β ) x 3 x 2 β α y α x γ y 0 ] .

We can easily know that the characteristic polynomial is

$$ H(\lambda ) = \lambda ^{2} - T\lambda + D. $$

Here \(T = (2 + 2\beta )x_{*} - 3x_{*}^{2} - \beta - \alpha y_{*}\) and \(D = (1 - \frac{\delta }{\gamma } )(\frac{\delta }{\gamma } - \beta ) \delta \).

Thus, we have the following conclusions.

  1. (a)

    If \(T < 0\) and \(\beta < \frac{2\delta - \gamma }{\gamma } \), then the positive equilibrium is locally asymptotically stable.

  2. (b)

    If \(T > 0\) and \(\beta > \frac{2\delta - \gamma }{\gamma } \), then the positive equilibrium is unstable.

 □

6 Bifurcation analysis

6.1 Hopf bifurcation

From Theorem 2, model (3) undergoes a bifurcation if \(\beta = \frac{2 \delta - \gamma }{\gamma } \). The purpose of this section is to prove that model (3) will produce a Hopf bifurcation if \(\beta = \frac{2 \delta - \gamma }{\gamma } \).

First we choose β as the bifurcation parameter, and then analyze the conditions under which a Hopf bifurcation occurs at \(E_{s^{*}} = (x _{*},y_{*})\). Denote

$$ \beta _{0} = \frac{2\delta - \gamma }{\gamma }, $$

when \(\beta = \beta _{0}\), we have \(T = (2 + 2\beta )x_{*} - 3x_{*} ^{2} - \beta - \alpha y_{*} = 0\). Thus, the Jacobian matrix \(J_{s^{*}}\) has a pair of imaginary eigenvalues \(\lambda = \pm i\sqrt{(1 - \frac{\delta }{\gamma } )(\frac{\delta }{\gamma } - \beta _{0}) \delta } \). Let \(\lambda = A(\beta ) \pm B(\beta )i\) be the roots of \(\lambda ^{2} - T\lambda + D = 0\), then

$$\begin{aligned}& A^{2} - B^{2} - AT + D = 0, \\& 2AB - TB = 0 \end{aligned}$$

and

$$\begin{aligned}& A = \frac{T}{2}, \\& B = \frac{\sqrt{4D - T^{2}}}{2} , \\& \frac{dA}{d\beta } |_{\beta = \beta _{0}} = \frac{ \delta }{2\gamma } \ne 0. \end{aligned}$$

By the PoincareAndronov Hopf bifurcation theorem, we know that model (3) undergoes a Hopf bifurcation at \(E_{s^{*}} = (x _{*},y_{*})\) when \(\beta = \beta _{0}\). However, the directionality of the Hopf bifurcation also require us to further analyze the normal form of the model.

Set \(x = X + x_{*}\) and \(y = Y + y_{*}\), to \((x_{*},y_{*})\) as origin of co-ordinates \((X,Y)\). We have the following model:

$$\begin{aligned}& \frac{dX}{dt} = a_{11}X + a_{12}Y + F_{1}(X,Y), \\& \frac{dY}{dt} = a_{21}X + a_{22}Y + F_{2}(X,Y) , \end{aligned}$$

where

$$ a_{11} = (2 + 2\beta )x_{*} - 3x_{*}^{2} - \beta - \alpha y_{*}, \qquad a_{12} = - \alpha x_{*}, \qquad a_{21} = \gamma y_{*}, \qquad a_{22} = 0, $$

and

$$\begin{aligned}& F_{1}(X,Y) = A_{1}X^{2} + A_{2}XY + A_{3}Y^{2} + B_{1}X^{3} + B_{2}X ^{2}Y + B_{3}XY^{2} + B_{4}Y^{3} + P_{1}(X,Y), \\& F_{2}(X,Y) = C_{1}X^{2} + C_{2}XY + C_{3}Y^{2} + D_{1}X^{3} + D_{2}X ^{2}Y + D_{3}XY^{2} + D_{4}Y^{3} + P_{2}(X,Y), \\& A_{1} = 1 + \beta - 3x_{*},\qquad A_{2} = - \frac{\alpha }{2},\qquad A_{3} = 0, \\& B_{1} = - \frac{1}{2},\qquad B_{2} = 0,\qquad B_{3} = 0,\qquad B_{4} = 0, \\& C_{1} = 0,\qquad C_{2} = \frac{1}{2}\gamma , \qquad C_{3} = 0, \\& D_{1} = 0,\qquad D_{2} = 0,\qquad D_{3} = 0, \qquad D_{4} = 0, \end{aligned}$$

where \(P_{1}(X,Y)\), \(P_{2}(X,Y)\) are smooth functions of X and Y at least of order four.

Now, using the transformation \(u = X\), \(v = - \frac{1}{B}(a_{11}X + a_{12}Y)\), we obtain

$$\begin{aligned}& \frac{du}{dt} = - Bv + G_{1}(u,v), \\& \frac{dv}{dt} = Bu + G_{2}(u,v), \end{aligned}$$

where

$$\begin{aligned}& G_{1}(u,v) = F_{1}\biggl(u, - \frac{1}{a_{12}}(a_{11}u + Bv)\biggr), \\& G_{2}(u,v) = - \frac{1}{B}\biggl(a_{11}F_{1} \biggl(u, - \frac{1}{a_{12}}(a_{11}u + Bv)\biggr) + a_{12}F_{2}\biggl(u, - \frac{1}{a_{12}}(a_{11}u + Bv)\biggr)\biggr), \end{aligned}$$

so

$$\begin{aligned}& G_{1}(u,v) = (1 + \beta - 3x_{*})u^{2} - \biggl[\alpha u\biggl( - \frac{1}{a_{12}}(a_{11}u + Bv)\biggr) - \frac{1}{2}u^{3}\biggr], \\& G_{2}(u,v) = - \frac{1}{B}\biggl(a_{11}(1 + \beta - 3x_{*})u^{2} - \biggl[\alpha u\biggl( - \frac{1}{a_{12}}(a_{11}u + Bv)\biggr) - \frac{1}{2}u^{3} \biggr]\biggr) \\& \hphantom{G_{2}(u,v) =}{} - \frac{1}{2}\gamma u(a_{11}u + Bv), \end{aligned}$$

set

$$\begin{aligned} \sigma =& \frac{1}{16} \biggl[ \frac{\partial ^{3}G_{1}}{\partial u^{3}} + \frac{\partial ^{3}G_{1}}{\partial u\partial v^{2}} + \frac{\partial ^{3}G_{2}}{\partial u^{2}\partial v} + \frac{\partial ^{3}G_{2}}{ \partial v^{3}} \biggr] \\ &{}+\frac{1}{16B} \biggl[ \frac{\partial ^{2}G_{1}}{\partial u\partial v} \biggl( \frac{\partial ^{2}G_{1}}{\partial u^{2}} + \frac{\partial ^{2}G _{1}}{\partial v^{2}} \biggr) - \frac{\partial ^{2}G_{2}}{\partial u \partial v} \biggl( \frac{\partial ^{2}G_{2}}{\partial u^{2}} + \frac{ \partial ^{2}G_{2}}{\partial v^{2}} \biggr) \\ &{}- \frac{\partial ^{2}G_{1}}{ \partial u^{2}}\frac{\partial ^{2}G_{2}}{\partial u^{2}} + \frac{ \partial ^{2}G_{1}}{\partial v^{2}} \frac{\partial ^{2}G_{2}}{\partial v ^{2}} \biggr], \end{aligned}$$

where

$$\begin{aligned}& \frac{\partial ^{3}G_{1}}{\partial u^{3}} = - 3, \qquad \frac{\partial ^{3}G_{1}}{\partial u\partial v^{2}} = 0, \qquad \frac{\partial ^{3}G_{2}}{\partial u^{2}\partial v} = 0, \qquad \frac{\partial ^{3}G_{2}}{\partial v^{3}} = 0, \\& \frac{\partial ^{2}G_{1}}{\partial u\partial v} = - \alpha B, \qquad \frac{\partial ^{2}G_{2}}{\partial u\partial v} = - \alpha B - \frac{1}{2}\gamma B, \\& \frac{\partial ^{2}G_{1}}{\partial v^{2}} = 0, \qquad \frac{\partial ^{2}G_{2}}{\partial v^{2}} = 0, \\& \frac{\partial ^{2}G_{1}}{\partial u^{2}} = 2(1 + \beta - 3x_{*}) + \frac{2a _{11}\alpha }{a_{12}} - 3u, \\& \frac{\partial ^{2}G_{2}}{\partial u^{2}} = - \frac{2}{B}\bigl[a_{11}(1 + \beta - 3x_{*})\bigr] + \frac{2a_{11}\alpha }{a_{12}} - 3u - \gamma a_{11}. \end{aligned}$$

So

$$\begin{aligned} \sigma =& - \frac{3}{16} + \frac{1}{16} - \alpha \biggl( 2(1 + \beta - 3x_{*}) + \frac{2a_{11}\alpha }{a_{12}} - 3u \biggr) \\ &{}+ \biggl(\alpha + \frac{1}{2}\gamma \biggr) \biggl( - \frac{2}{B}\bigl[a_{11}(1 + \beta - 3x_{*}) \bigr] + \frac{2a_{11}\alpha }{a_{12}} - 3u - \gamma a_{11} \biggr) \\ &{}- \frac{1}{16B}\biggl(2(1 + \beta - 3x_{*}) + \frac{2a_{11}\alpha }{a_{12}} - 3u\biggr) \\ &{}\times \biggl( - \frac{2}{B} \bigl[a_{11}(1 + \beta - 3x_{*})\bigr] + \frac{2a_{11} \alpha }{a_{12}} - 3u - \gamma a_{11}\biggr). \end{aligned}$$

If \(\sigma < 0\), the equilibrium \(E_{s^{*}}\) is destabilized through a Hopf bifurcation that is supercritical and a Hopf bifurcation that is subcritical otherwise [10].

7 Weak Allee effect

Next, we start to study a model with weak Allee effect and Holling type-I functional response in predator growth. For simplicity, we rewrite the dimensionless model in [3] in the following form:

$$ \begin{aligned} &\frac{dx}{dt} = x(1 - x) (x + \beta ) - \alpha xy, \\ &\frac{dy}{dt} = \gamma xy - \delta y. \end{aligned} $$
(4)

8 Equilibria and existence

In order to find the equilibrium points of model (4), which follow from

$$\begin{aligned}& x(1 - x) (x + \beta ) - \alpha xy = 0, \\& \gamma xy - \delta y = 0, \end{aligned}$$

we easily see that model (4) exhibits three equilibrium points, \(E_{w0} = (0,0)\), \(E_{w2} = (1,0)\), \(E_{w^{*}} = (\bar{x}_{*},\bar{y}_{*})\). Here, \(\bar{x}_{*} = \frac{\delta }{\gamma } \), \(\bar{y}_{*} = \frac{(1 - \frac{ \delta }{\gamma } )(\frac{\delta }{\gamma } + \beta )}{\alpha } \). For a positive equilibrium point, we have \(\frac{\delta }{\gamma } < 1\).

9 Stability analysis

In this section, we will analyze the stability of model (4).

9.1 Local stability

Theorem 3

  1. (1)

    \(E_{w0}\) is a saddle point.

  2. (2)

    \(E_{w2}\) is stable for \(\gamma < \delta \), \(E_{w2}\) is a saddle point for \(\gamma > \delta \).

  3. (3)

    Positive equilibrium \(E_{w^{*}}\) is locally asymptotically stable when \(\beta > 1 - 2\bar{x}_{*}\), \(E_{w^{*}}\) is an unstable node when \(\beta < 1 - 2\bar{x}_{*}\).

Proof

It can be concluded by calculating the Jacobian matrix of model (4) at \(E_{w0}\) that

J w 0 = [ β 0 0 δ ] .

Hence \(E_{w0}\) is always a saddle point.

It can be concluded by calculating the Jacobian matrix of model (4) at \(E_{w2}\) that

J w 2 = [ β 1 α 0 γ δ ] .

We can find that the first eigenvalue \(\lambda _{1} = - \beta - 1\) is negative, hence \(E_{w2}\) is stable if \(\gamma < \delta \), and \(E_{w2}\) is a saddle point when \(\gamma > \delta \).

We calculate the Jacobian matrix of model (4) at \(E_{w^{*}}\) that is given by

J w = [ ( 2 2 β ) x ¯ 3 x ¯ 2 + β α y ¯ α x ¯ γ y ¯ 0 ] .

The characteristic polynomial is

$$ H(\lambda ) = \lambda ^{2} - \bar{T}\lambda + \bar{D}, $$

where \(\bar{T} = (2 - 2\beta )\bar{x}_{*} - 3\bar{x}_{*}^{2} + \beta - \alpha \bar{y}_{*}\) and \(\bar{D} = (1 - \frac{\delta }{\gamma } )(\frac{ \delta }{\gamma } + \beta )\delta \).

Thus, we have the following conclusions.

  1. (a)

    If \(\bar{T} < 0\) and \(\beta > 1 - 2\bar{x}_{*}\), we can find that \(E_{w^{*}}\) is locally asymptotically stable.

  2. (b)

    If \(\bar{T} > 0\) and \(\beta < 1 - 2\bar{x}_{*}\), we can find that \(E_{w^{*}}\) is unstable.

 □

9.2 Global stability

Here we first prove that \(E_{w2} = (1,0)\) is globally stable when \(( \frac{\alpha + \gamma }{\alpha } )^{2} - \frac{4 \delta }{\alpha } < 0\).

Consider the Lyapunov function:

$$ V(x,y) = \frac{1}{2}(x - 1)^{2} + y. $$

The derivative of V along the solution of model (4) is

$$\begin{aligned} \dot{V} =& (x - 1)\bigl[x(1 - x) (x + \beta ) - \alpha xy\bigr] + \gamma xy - \delta y \\ =& - x(1 - x)^{2}(x + \beta ) - (x - 1)\alpha xy + \gamma xy - \delta y \\ \le& - (x - 1)\alpha xy + \gamma xy - \delta y \\ =& - \alpha x^{2}y + \alpha xy + \gamma xy - \delta y \\ =& - y\bigl(\alpha x^{2} - \alpha x - \gamma x + \delta \bigr) \\ =& - \alpha y \biggl[ \biggl(x^{2} - \biggl( \frac{\alpha + \gamma }{\alpha } \biggr)x + \frac{\delta }{\alpha } \biggr) \biggr]. \end{aligned}$$

If \(x^{2} - ( \frac{\alpha + \gamma }{\alpha } )x + \frac{ \delta }{\alpha } > 0\), then \(\dot{V} < 0\). So, \(\Delta = ( \frac{ \alpha + \gamma }{\alpha } )^{2} - \frac{4\delta }{\alpha } < 0\).

Next, we prove that \(E_{w^{*}} = (\bar{x}_{*},\bar{y}_{*})\) is globally stable for model (4). Here, we will prove the global stability of \(E_{w^{*}} = (\bar{x}_{*},\bar{y}_{*})\) based on the fact that \(E_{w^{*}} = (\bar{x}_{*},\bar{y}_{*})\) is locally asymptotically stable by using Th. 2 in [11]. In order to use this theorem better, we can rewrite model (4) as follows:

$$\begin{aligned}& \frac{dx}{dt} = xg(x) - \alpha yp(x), \\& \frac{dy}{dt} = \gamma yp(x) - \delta y . \end{aligned}$$

Here \(g(x) = (1 - x)(x + \beta )\) and \(p(x) = x\). Here \(g(x)\) and \(p(x)\) satisfy the following three conditions:

  1. 1.

    \(g \in C([0,\infty ),\mathbb{R}) \cap C^{1}((0,\infty ),\mathbb{R})\), \(g(0) = (1 - 0)(0 + \beta ) > 0\), \(g(1) = 0\) and \((x - 1)g(x) < 0\) for \(x \in [0,1) \cup (1,\infty )\).

  2. 2.

    \(p \in C([0,\infty ),\mathbb{R}) \cap C^{1}((0,\infty ),\mathbb{R})\), \(p(0) = 0\) and \(p'(x) = 1 > 0\) for all \(x \ge 0\).

  3. 3.

    The positive equilibrium point \(E_{w^{*}} = (\bar{x}_{*},\bar{y}_{*})\) is calculated by \(\gamma p(\bar{x}_{*}) - \delta = 0\) and \(\bar{x}_{*}g( \bar{x}_{*}) - \alpha \bar{y}_{*}p(\bar{x}_{*}) = 0\), \(0 < \bar{x} _{*} < 1\), \(\bar{y}_{*} > 0\) and further \(\frac{d}{dx} ( \frac{xg(x)}{p(x)} ) = - (1 - x)(x + \beta ) < 0\), for all \(\bar{x}_{*} < x < 1\).

Here we explain the conditions. In fact, we can proceed from calculating from the local stability of \(E_{w^{*}}\). So we can find the prey nullcline \(y = \frac{(1 - x)(x + \beta )}{\alpha } \equiv r(x)\) is continuous curve, we say \(x = x_{1}\) is a local maximum point at the points \((0,\frac{ \beta }{\alpha } )\) and \((1,0)\) such that \(0 < x_{1} < 1\). Note that \(r(x) = \frac{xg(x)}{p(x)}\). We can find that the condition for satisfying local asymptotic stability of \(E_{*}\) is that \(x = \bar{x} _{*}\) on the right side of \(x = x_{1}\) and should intersect the prey nullcline, hence \(0 < \bar{x}_{*} < x < 1\) holds. Hypothesis \(x_{1}\) is the local maximum of \(y = r(x)\), we know that \(E_{w^{*}}\) is locally asymptotically stable, so that \(\frac{d}{dx}r(x) < 0\) for \(0 < x_{*} \le x \le 1\). Obviously, the above inequalities are still satisfied that \(r(x) = \frac{xg(x)}{p(x)}\).

Next, we apply Th. 2 in [11] to prove that \(E_{w^{*}}\) is globally stable under the assumption of local asymptotic stability.

Theorem 4

The following condition holds: \(\frac{d}{dx} ( \frac{f(x) - f(\bar{x}_{*})}{p(x) - p(\bar{x}_{*})} ) < 0\) for \(0 \le x \le 1\) and \(E_{w^{*}}\) is locally asymptotically stable. \(E_{w^{*}}\) is globally asymptotically stable where \(f(x) = \frac{d}{dx}(xg(x)) - \frac{p'(x)xg(x)}{p(x)}\).

Proof

For model (4), we can see that the definition of \(f(x)\) is

$$\begin{aligned} f(x) =& (1 - x) (x - \beta ) + x(1 - x) - x(x + \beta ) - \frac{x(1 - x)(x - \beta )}{x} \\ =& x(1 - x) - x(x + \beta ). \end{aligned}$$

Hence we can calculate

$$\begin{aligned}& \frac{d}{dx} \biggl( \frac{f(x) - f(\bar{x}_{*})}{p(x) - p(\bar{x}_{*})} \biggr) \\& \quad = \biggl(\frac{x(1 - x) - x(x + \beta ) - \bar{x}_{*}(1 - \bar{x} _{*}) + \bar{x}_{*}(\bar{x}_{*} + \beta )}{x - \bar{x}_{*}}\biggr)' \\& \quad = \frac{1 - \beta - 4x}{x - \bar{x}_{*}} - \frac{x - \beta x - 2x^{2} - (\bar{x}{}_{*} - \beta \bar{x}_{*} - 2\bar{x}_{*}^{2})}{(x - \bar{x}_{*})^{2}} \\& \quad = \frac{x - \beta x - 4x{}^{2} - (\bar{x}_{*} - \beta \bar{x}_{*} - 4x \bar{x}_{*}) - x + \beta x + 2x^{2} + (\bar{x}{}_{*} - \beta \bar{x} _{*} - 2\bar{x}_{*}^{2})}{(x - \bar{x}_{*})^{2}} \\& \quad = \frac{ - 2x{}^{2} + 4x\bar{x}_{*} - 2\bar{x}_{*}^{2}}{(x - \bar{x} _{*})^{2}} . \end{aligned}$$

We find \(- 2x{}^{2} + 4x\bar{x}_{*} - 2\bar{x}_{*}^{2} < 0\) for any \(x > 0\). □

10 Hopf bifurcation

Theorem 5

By selecting β as the bifurcation parameter, model (4) undergoes a Hopf bifurcation that occurs at \(E_{w^{*}} = ( \bar{x}_{*},\bar{y}_{*})\) if \(\beta = 1 - 2\bar{x}_{*}\).

Proof

If \(\bar{T} = (2 - 2\beta )\bar{x}_{*} - 3\bar{x}_{*} ^{2} + \beta - \alpha \bar{y}_{*} = 0\) and \(\det J_{w^{*}} > 0\), then use the implicit function theorem we have learned; when the stability of the equilibrium point \(E_{w^{*}} = (\bar{x}_{*},\bar{y}_{*})\) changes, Hopf bifurcation occurs, thereby generating a periodic orbit. Using these two conditions, the critical value of the Hopf bifurcation parameter is found to be \(\beta = 1 - 2\bar{x}_{*}\). Obviously given the condition by [4],

  1. (i)

    \(\bar{T} = (2 - 2\beta )\bar{x}_{*} - 3\bar{x}_{*}^{2} + \beta - \alpha \bar{y}_{*} = 0\),

  2. (ii)

    \(\det J_{*} > 0\), and

  3. (iii)

    \(\frac{d\bar{T}}{d\beta } \vert _{\beta = \beta _{0}} = - \frac{\delta }{\gamma } \ne 0\) at \(\beta = \beta _{0}\) model (4) undergoes a Hopf bifurcation around \(E_{w^{*}} = (\bar{x}_{*}, \bar{y}_{*})\).

 □

11 Simulations tests

In this section, we numerically simulate the above theoretical derivation by MATLAB.

11.1 Strong Allee effect

The ODE model (3) has four parameters: α, β, γ, δ. We choose the parameters

$$\begin{aligned}& \alpha = 0.5,\qquad \beta = 0.2,\qquad \gamma = 0.355,\qquad \delta = 0.2, \end{aligned}$$
(5)
$$\begin{aligned}& \alpha = 0.5,\qquad \beta = 0.2,\qquad \gamma = 0.36,\qquad \delta = 0.4, \\ \end{aligned}$$
(6)
$$\begin{aligned}& \alpha = 0.5,\qquad \beta = 0.2,\qquad \gamma = 0.29,\qquad \delta = 0.2. \end{aligned}$$
(7)

According to Fig. 1, we can find \(E_{s0} = (0,0)\) that it is asymptotically stable. If \(\gamma < \delta \) then \(\gamma = 0.36 < \delta = 0.4\), \(E_{s2} = (1,0)\) is asymptotically stable as shown in Fig. 2. If \(\beta < \frac{2\delta - \gamma }{\gamma } \) then \(0.2 < \frac{2*0.2 - 0.29}{0.29} \approx 0.379\), \(E_{s^{*}} = (x_{*},y_{*}) = (0.689,0.303)\) is asymptotically stable as shown in Fig. 3 we also find the saddle point \(E_{s1} = (0.2,0)\) like Fig. 1. Moreover, we find that there may be two stable equilibrium points; this is what we call a bistable system as shown in Fig. 4.

Figure 1
figure 1

\(E_{s0} = (0,0)\) is stable, \(E_{s1} = (0.2,0)\) is a saddle point and \(E_{s2} = (1,0)\) is a saddle point

Figure 2
figure 2

\(E_{s2} = (1,0)\) is stable

Figure 3
figure 3

\(E_{s^{*}} = (x_{*},y_{*}) = (0.689,0.303)\) is stable

Figure 4
figure 4

Bistable system

According to Fig. 5, we find that bifurcation occurs at approximately \(r = 0.3\), that is, a Hopf bifurcation. As we have demonstrated in the article, when \(\beta = 0.3\), model (3) undergoes a Hopf bifurcation.

Figure 5
figure 5

Bifurcation diagram

11.2 Weak Allee effect

The ODE model (4) has four parameters: α, β, γ, δ. We choose the parameters

$$\begin{aligned}& \alpha = 0.5,\qquad \beta = 0.2,\qquad \gamma = 0.36,\qquad \delta = 0.4, \end{aligned}$$
(8)
$$\begin{aligned}& \alpha = 0.5,\qquad \beta = 0.2,\qquad \gamma = 0.36,\qquad \delta = 0.2, \end{aligned}$$
(9)
$$\begin{aligned}& \alpha = 0.5,\qquad \beta = 0.2,\qquad \gamma = 0.36,\qquad \delta = 0.2. \end{aligned}$$
(10)

According to Fig. 6, we can find \(E_{w0} = (0,0)\) to be a saddle point. If \(\gamma < \delta \) then \(\gamma = 0.36 < \delta = 0.4\), \(E_{w2} = (1,0)\) is asymptotically stable as shown in Fig. 7. If \(\beta > 1 - 2x _{*}\) then \(0.2 > 1 - 2*0.556 = - 0.112\), \(E_{w^{*}} = (\bar{x}_{*}, \bar{y}_{*}) = (0.556,0.671)\) is asymptotically stable as shown in Fig. 8.

Figure 6
figure 6

\(E_{w0} = (0,0)\) is a saddle point, \(E_{w2} = (1,0)\) is a saddle point and \(E_{w^{*}} = (\bar{x}_{*},\bar{y}_{*}) = (0.556,0.671)\) is stable

Figure 7
figure 7

\(E_{w2} = (1,0)\) is stable

Figure 8
figure 8

\(E_{w^{*}} = (\bar{x}_{*},\bar{y}_{*}) = (0.556,0.671)\) is stable

According to Fig. 9, we find that bifurcation occurs at approximately \(r = - 0.112\), that is, Hopf bifurcation. As we have demonstrated in the article, when \(\beta = - 0.112\), model (4) undergoes Hopf bifurcation.

Figure 9
figure 9

Bifurcation diagram

12 Conclusions

In this paper, a prey-predator model with Allee effect in prey growth, a Holling type-I functional response in predator growth is given. The prey-predator model with strong Allee effect is analyzed, and the four equilibrium points and the conditions for each equilibrium point are obtained. We analyze the Hopf bifurcation occurring at \(E_{s^{*}} = (x _{*},y_{*})\) by choosing β as the bifurcation parameter, obtain the conditions for generating a Hopf bifurcation and further calculation of the Hopf bifurcation. If \(\sigma < 0\), the equilibrium \(E_{s^{*}}\) is destabilized through a Hopf bifurcation that is supercritical and the Hopf bifurcation is subcritical otherwise. The prey-predator model with weak Allee effect is also analyzed and we obtain stability conditions for three equilibrium points, the global stability of \(E_{w2} = (1,0)\) and \(E_{w^{*}} = (\bar{x}_{*},\bar{y}_{*})\) is proved. We also analyze the Hopf bifurcation occurring at \(E_{w^{*}} = (\bar{x}_{*}, \bar{y}_{*})\) by choosing β as the bifurcation parameter, the conditions for generating a Hopf bifurcation are obtained. Finally, using computer simulations we draw the position of each equilibrium point in the phase diagram, and we draw the bifurcation diagram under the strong and weak Allee effect. It is worth noting that there are some differences between the special case of bistability and the Allee effect as regards strength and weakness. If the positive equilibrium point of the model is stable, model (3) with strong Allee effect must be a bistable system. However, in the case of the weak Allee effect, the model is not necessarily a bistable system because the axial equilibrium point is unstable under certain conditions.