Introduction

Last few decade, aquatic ecologists are fascinated by the dynamics of explosive phytoplankton blooms (i.e., the rapid growth and decay in their population) (Huppert et al. 2005). The blooms are of two types, one is spring bloom and other is red bloom. The spring bloom is seasonal, it is due to change in temperature and nutrient level associated with season. On the other hand, red bloom is localized out break associated with change in water temperature and with greater stability of water column (Truscott and Brindley 1994). The classification of phytoplankton blooms are reported in literature (Agusti et al. 1987; Bratbak et al. 1995). Sometimes blooms are viewed as a signal of approaching eutrophication, indicating that nutrients may have reached at unacceptably high levels, at least high enough to support the bloom formation (Huppert et al. 2005). In reality, phytoplankton bloom is a natural event of ecosystem which is not a cause of concern or danger to water quality. In real world, frequent outcome of a planktonic bloom formation leads to massive cell lysis and rapid disintegration of large planktonic population. This is closely followed by an equally rapid increase in bacterial number and in turn, by fast deoxygenating of water, which could be detrimental to aquatic plants and animals (Sarkar and Malchow 2005). Several researchers have tried to explain the nature of bloom dynamics in planktonic system using different approaches namely: nutrient upwelling, spatial patchiness and species diversity (Edward and Brindley 1996; Mathews and Brindley 1996; Pitchford and Brindley 1998; Truscott and Brindley 1994). The role of different functional forms in zooplankton-phytoplankton interaction was studied (Baghel et al. 2012; Ruan 1993). During recent years, many models were proposed to study the plankton system with nutrients availability. The eutrophication has already been applied to many coastal ecosystems all over the world (Zhang et al. 2004). It has been observed that synthetic eutrophication plays a significant role for excitable behavior of the system and depends upon the ratio of nitrogen to phosphorous (Egg and Heimdal 1994). Researchers have suggested that eutrophication resulting from human activities has led to an increase in phytoplankton production in Kattegat throughout the annual period in which nutrients are favorable for the growth of phytoplankton (Baghel et al. 2011, 2012; Richardson and Heilmann 1995).

In spatial ecology, the fundamental importance of patterns in biology is self-evident (Murray 2003). Pattern formation studies have often been criticized for their lack of inclusion of factors in the models. It should be remembered that the generation of pattern and form, particularly in development, is usually a long way from the level of the genome (Petrovskii and Malchow 2001). Many of the evolving patterns could hardly have been anticipated solely by genetic information. Much of the research in developmental biology, both experimental and theoretical, is devoted to trying to determine the underlying mechanisms which generate pattern and form in early development (Cantrell and Cosner 2004; Murray 2003).

It is well known natural phenomenon that a substance goes from high density regions to low density regions and hence spatial patterns are formed in nature. Our understanding is such that whatever pattern, observe in the animal world, it is almost certain that the process that produced it is still unknown. Moreover, the spatial element of ecological interactions have been identified as an crucial factor in how ecological communities are shaped (Medvinsky et al. 2002; Murray 2003; Petrovskii and Malchow 1999; Yi et al. 2009). Recently, few articles on plankton dynamics in spatiotemporal domain with instant nutrient replenishment in closed environment have been published (Baghel et al. 2011; Dhar et al. 2012) and the disease class phytoplankton with three dimensional pattern formation is also obtained (Baghel et al. 2012).

Several investigators have studied the dissolve oxygen on the existence of interacting planktonic population (Khare and Kumar 2013; Naik and Manjapp 2010) and also many authors have analyzed depletion of dissolved oxygen in eutrophied water bodies (Misra 2010; Shuklaa and Misrac 2008).

Keeping in view the above discussion, we have proposed a mathematical model to study the role of dissolved oxygen on the plankton dynamics and its schematic flow is shown in Fig. 1, where P, Z and D are respectively densities of phytoplankton, zooplankton population and concentration of dissolved oxygen in water.

Fig. 1
figure 1

Schematic diagram of proposed model

Our main intension in this paper is to analyze the proposed mathematical models in both temporal and spatiotemporal domain. The rest of this paper is organized as follows: In “Formulation of mathematical model”, we have proposed temporal model and studied the local stability and existence of Hopf-bifurcation with direction and stability of Hopf-bifurcating periodic solution. In “Model with diffusion”, we have proposed model with diffusion, analyzed the diffusion instability and also carried out numerical simulation in order to obtain the different types of spatial pattern. In “Higher order stability analysis”, we have conducted the higher order stability analysis for spatiotemporal system. Finally, last section “Conclusions” is given.

Formulation of mathematical model

Keeping in view the above, we consider P(t) and Z(t) are representation of densities of phytoplankton and zooplankton population respectively at any time t, and the interaction among the phytoplankton and zooplankton with Holling type-II functional response, because initially phytoplankton is more vulnerable to predation by zooplankton till the population density of phytoplankton reaches certain threshold value. Let D(t) stands for concentration of dissolved oxygen in water at any time t. Further, \(D_0\) is the constant intake of dissolved oxygen in water. The intrinsic growth rate of phytoplankton increase with respect to D and suppose that the maximum growth rate is \(r/\zeta\) at \(D=D_0\). Then, we can consider the growth rate function of phytoplankton due to the uptake of dissolved oxygen as \(\frac{r}{\zeta +D_0-D}\). Also, \(\delta _1\), \(\delta _2\) are the natural death rates of phytoplankton and zooplankton which includes the natural washout respectively. The up-taking rate of phytoplankton by zooplankton and conversion rate of phytoplankton into zooplankton are represented by \(\beta\) and \(\beta _1\) respectively. Again, the dissolved oxygen may not directly involve for the growth of zooplankton, but it will be utilized by them for their survival, let \(\alpha _1\), \(\alpha _2\) be the rates of uptake of dissolved oxygen by per capita phytoplankton and zooplankton respectively. We have taken \(\eta\) as the rate of replenishment of oxygen in the water reservoir. The dynamical system is governed by the following set of ordinary differential equations:

$$\begin{aligned} \frac{dP}{dt}= & {} \frac{r P}{(\zeta +{D_0}-D)}-{\delta _1} P - \frac{\beta P Z}{(P+a)}, \end{aligned}$$
(1)
$$\begin{aligned} \frac{dD}{dt}= & {} \eta ({D_0}-D)- {\alpha _1} P -{\alpha _2} Z, \end{aligned}$$
(2)
$$\begin{aligned} \frac{dZ}{dt}= & {} \frac{\beta _1 P Z}{(P+a)} - {\delta _2} Z, \end{aligned}$$
(3)

with non-negative initial conditions \(P(0) > 0, D(0) > 0, Z(0) > 0.\) The Holling type-II functional response \(\frac{P Z}{(P+a)}\) has been used earlier by many other researchers also Holling (1959).

Equilibria and local stability analysis

Now, we will study the existence of all possible steady states of the temporal system. The system (1)–(3) has three feasible equilibriums,

  1. (i)

    \(E_0 = (0, D_0, 0)\),

  2. (ii)

    \(E_1 = \left( \frac{\eta (r-{\delta _1} \zeta )}{{\alpha _1} {\delta _1}},(D_0+ \zeta )-\frac{r}{{\delta _1}}, 0 \right)\) exits when \(\frac{r}{\delta _1}-D_0<\zeta <\frac{r}{\delta _1}\),

  3. (iii)

    \(E_2 = (P^*, D^*, Z^*)\) where \(P^*= \frac{a \delta _2}{\beta _1-\delta _2}\) exits when \(\beta _1 > \delta _2\), \(Z^*= \frac{a \beta _1}{\beta (\beta _1 -\delta _2)}(\frac{r}{\zeta +D_0-D^*}-\delta _1)\) and \(D^* = (D_0-\frac{a \alpha _1 \delta _2}{\eta (\beta _1-\delta _2)}-\frac{\alpha _2 Z^*}{\eta })\).

Corresponding to the equilibrium point \(E_0=(0,D_0,0)\), Jacobian \(J_1\) is given by

$$\begin{aligned} J_1= \left[ \begin{array}{ccc} 0 &{} 0 &{} 0 \\ -{\alpha _1} &{} -\eta &{} -{\alpha _2} \\ 0 &{} 0 &{} 0 \end{array} \right] . \end{aligned}$$

The Jacobian \(J_1\) has the eigenvalues \(\lambda _1=0\), \(\lambda _2=-\eta\), \(\lambda _3=0\).

Hence, \(E_0\) is one directional stable and two directional unstable.

The variation matrix corresponding to the equilibrium point \(E_1\) is given by Jacobian \(J_2\) where

$$\begin{aligned} J_2= \left[ \begin{array}{ccc} 0 &{} \frac{\eta \delta _1(r-\delta _1 \zeta )}{\alpha _1} &{} \frac{-\beta \eta (r-\delta _1\zeta )}{a\alpha _1\delta _1+\eta (r-\delta _1\zeta )} \\ -{\alpha _1} &{} -\eta &{} -{\alpha _2} \\ 0 &{} 0 &{} 0 \end{array} \right] . \end{aligned}$$

The characteristic equation is given by

$$\begin{aligned} \lambda ^3+B_1 \lambda ^2+B_2 \lambda +B_3=0, \end{aligned}$$

where \(B_1=\eta ,\) \(B_2=\frac{\eta \delta _1}{\alpha _1}(\zeta \delta _1-r),\) \(B_3=\frac{\eta \delta _1 \alpha }{\alpha _1}(\zeta \delta _1^2-r).\) Hence, using Routh–Hurwitz criteria \(E_1\) is locally asymptotically stable, if \(B_i> 0, \ i=1, 2, 3\) and \(B_1 B_2 > B_3\).

The general variational matrix corresponding to the equilibrium point \(E_2\) is given by

$$\begin{aligned} J^*= \left[ \begin{array}{ccc} \frac{\beta Z^*}{a+P^*}-\frac{a \beta Z^*}{(a+P^*)^2} &{} \frac{rP^*}{(\zeta +D_0-D^*)^2} &{} -\frac{ \beta P^*}{a+P^*} \\ -{\alpha _1} &{} -\eta &{} -{\alpha _2} \\ \frac{a \beta _1 Z^*}{(a+P^*)^2} &{} 0 &{} 0 \end{array} \right] , \end{aligned}$$

and its characteristic equation is:

$$\begin{aligned} \lambda ^3+A_1 \lambda ^2+A_2 \lambda +A_3=0, \end{aligned}$$
(4)

where

$$\begin{aligned} A_1= & {} \eta - \frac{\beta P^*Z^*}{(a+P^*)^2},\\ A_2= & {} \frac{r \alpha _1P^*}{(\zeta +D_0-D^*)^2}+ \frac{\beta P^*Z^*}{(a+P^*)^2}\left( \frac{a \beta _1}{a+P^*}- \eta \right) ,\\ A_3= & {} \frac{a \beta _1P^*Z^*}{(a+P^*)^2}\left( \frac{r \alpha _2}{(\zeta +D_0-D^*)^2}+\frac{r \beta }{(a+P^*)}\right) . \end{aligned}$$

Hence, using Routh–Hurwitz criteria \(E_{2}\) is locally asymptotically stable, if \(A_i> 0, \ i=1, 2, 3\) and \(A_1 A_2 > A_3\).

Existence of Hopf bifurcation

In this subsection, we will study the Hopf-bifurcation of system (1)–(3), taking “r” (i.e., the growth rate of phytoplankton due to the up-taking of dissolved oxygen) as the bifurcation parameter. Now, the necessary and sufficient condition for the existence of the Hopf-bifurcation, if there exists \(r = r_0\) such that (i) \(A_i(r_0) > 0, i = 1, 2, 3,\) (ii) \(A_1(r_0)A_2(r_0)-A_3(r_0) = 0\) and (iii) if we consider the eigenvalues of the characteristic equation (4) of the form \(\lambda _i = u_i + iv_i\), then \(Re \frac{d}{dr} (u_i) \ne 0, i = 1, 2, 3.\)

Now, we will verify the condition (iii) of Hopf-bifurcation. Put \(\lambda = u + iv\) in (4), we get

$$\begin{aligned} (u + iv)^3 + A_1 (u + iv)^2 + A_2 (u + iv) + A_3 = 0. \end{aligned}$$
(5)

On separating the real and imaginary parts and eliminating v between real and imaginary parts, we get

$$\begin{aligned} 8 u^3 + 8 A_1 u^2 + 2\left( A_1^2 + A_2\right) u + A_1 A_2 - A_3 = 0. \end{aligned}$$
(6)

Now, we have \(u(r_0)=0\) as \(A_1(r_0) A_2(r_0) - A_3(r_0) = 0\). Further, \(r=r_0\), is the only positive root of \(A_1(r_0) A_2(r_0) - A_3(r_0) = 0\), and the discriminate of \(8 u^2 + 8 A_1 u + 2(A_1^2 + A_2)= 0\) is \(-64A_2 < 0\). Here, differentiating (6) with respect to r, we have \(\left( 24 u^2 + 16 A_1 u + 2(A_1^2 +A_2)\right) \frac{d u}{d r} + \left( 8 u^2 + 4 A_1 u \right) \frac{d A_1}{d r} + 2 u \frac{d A_2}{d r} + \frac{d}{d r}(A_1 A_2 - A_3)= 0.\) Now, since at \(r=r_0\), \(u(r_0) = 0\), we get \(\left[ \frac{d u}{d r} \right] _{r=r_0} = \frac{-\frac{d}{d r}(A_1 A_2 - A_3)}{2(A_1^2 +A_2)} \ne 0,\) which ensures that the above system has a Hopf-bifurcation. It is shown graphically in Figs. 2, 3.

Fig. 2
figure 2

The time series and phase space representation of three species around the endemic equilibrium, with r = 0.29

Fig. 3
figure 3

The time series and phase space representation of three species around the endemic equilibrium, with r = 0.445533

Direction and stability of the hopf bifurcation

Let \(x_1=P-P^*, y_1=D-D^*, z_1= Z-Z^*\), then put in the system (1)–(3), we can shift the equilibrium to the origin:

$$\begin{aligned} \frac{dx_1}{dt}&= \frac{r x_1}{(\zeta + D_0-D^*-y_1)}+ \frac{r P^* y_1}{(\zeta + D_0-D^*-y_1)(\zeta + D_0-D^*)}\nonumber \\&- \frac{\beta (x_1z_1+x_1Z^*+P^*z_1)}{(a+P^*+x_1)}+ \frac{\beta P^*Z^*x_1}{(a+P^*+x_1)(a+P^*)}-\delta _1 x_1, \end{aligned}$$
(7)
$$\begin{aligned} \frac{dy_1}{dt}&= -\left( \eta y_1+\alpha _1 x_1+\alpha _2 z_1\right) , \end{aligned}$$
(8)
$$\begin{aligned} \frac{dz_1}{dt}&= \frac{\beta _1(x_1z_1+x_1Z^*+P^*z_1)}{(a+P^*+x_1)}- \frac{\beta _1 P^*Z^*x_1}{(a+P^*+x_1)(a+P^*)}-\delta _2 z_1. \end{aligned}$$
(9)

Its jacobian matrix J at point \(E_2(P^*, D^*, Z^*)\)is

$$\begin{aligned} J(0)= \left[ \begin{array}{ccc} \frac{\beta P^* Z^*}{(a+P^*)^2} &{} \frac{rP^*}{(\zeta +D_0-D^*)^2} &{} -\frac{ \beta P^*}{a+P^*} \\ -{\alpha _1} &{} -\eta &{} -{\alpha _2} \\ \frac{a \beta _1 Z^*}{(a+P^*)^2} &{} 0 &{} 0 \end{array} \right] , \end{aligned}$$

and its corresponding characteristic equation is

$$\begin{aligned} \lambda ^3+A_1 \lambda ^2+A_2 \lambda +A_3=0, \end{aligned}$$

where \(A_1A_2=A_3\),

$$\begin{aligned} (\lambda ^2+A_2 )(\lambda +A_1 )=0. \end{aligned}$$
(10)

Obviously Eq. (10) has a pair of purely imaginary conjugate roots \(\lambda _{1,2}= \pm i \omega\) and a real root \(\lambda _3= -A_1\) where \(A_1=(\beta P^* H-\eta )\) and \(H = \frac{Z^* }{(a+P^*)^2}.\)

Now, we apply the normal form theory (Hassard et al. 1981), we can state the following theorem:

Theorem

(Hassard et al. 1981) There is a Hopf bifurcation when r passes through \(r_0\) for system (7)–(9), and

  1. (i)

    if \(\mu _2 > 0 (< 0)\), the direction of bifurcation is supercritical (subcritical),

  2. (ii)

    if \(\beta _2 < 0 (> 0)\), the solutions of bifurcation periodic solutions are orbitally stable (unstable),

  3. (iii)

    \(\tau _2 > 0 (< 0)\), the periods of bifurcation periodic solutions increase (decrease). Here, we use \(\mu _2, \beta _2\) and \(\tau _2\) for more detail in Appendix-I.

A numerical example

Taking, the parametric values are \(\delta _1=0.1\), \(\beta =0.4\), \(\beta _1=0.4\), \(D_0=3\), \(\alpha _1=0.18\), \(\alpha _2=0.2\), \(\delta _2=0.3\), \(\eta =2.85\), \(\zeta =0.2\), \(a=3\) and \(r=0.445533\). It follows from the results in “Direction and stability of the hopf bifurcation” that \(\mu _2 = 0.00648118\), \(\beta _2 = -0.00292106\) and \(\tau _2 = 0. + 0.00508774 i\). In the light of Theorem, since \(\mu _2 > 0\), the Hopf bifurcation is supercritical. Since, \(\beta _2 < 0\), each individual periodic solution is stable and \(\tau _2 > 0\), periods of bifurcating periodic solutions increase (see Figs. 2, 3).

Model with diffusion

We now consider the plankton dynamics with diffusion in system (1)–(3). In this case population densities will become space and time dependent, i.e., P(txy), D(txy) and Z(txy) are the population densities of phytoplankton, dissolved oxygen and zooplankton at time t and space coordinate (xy). Then, our proposed model can stated by the following reaction diffusion system:

$$\begin{aligned} \frac{\partial P}{\partial t}&= \frac{r P}{(\zeta +{D_0}-D)}-{\delta _1} P - \frac{\beta P Z}{(P+a)}+ D_a \nabla ^2 P,\end{aligned}$$
(11)
$$\begin{aligned} \frac{\partial D}{\partial t}&= \eta ({D_0}-D)- {\alpha _1} P -{\alpha _2} Z + D_b \nabla ^2 D,\end{aligned}$$
(12)
$$\begin{aligned} \frac{\partial Z}{\partial t}&= \frac{\beta _1 P Z}{(P+a)} - {\delta _2} Z+ D_c \nabla ^2 Z, \end{aligned}$$
(13)
$$\begin{aligned}&P(x,y,0)>0, \ \ D(x,y,0)>0, \ \ Z(x,y,0)>0 \ \ (x,y)\ \epsilon \ \Omega \ \ and \end{aligned}$$
(14)
$$\begin{aligned} \frac{\partial P}{\partial n}&= \frac{\partial D}{\partial n} = \frac{\partial Z}{\partial n} = 0, \ \ (x,y)\ \epsilon \ \partial \Omega , \ \ t>0, \end{aligned}$$
(15)

where \(( \nabla ^2=\frac{\partial ^2}{\partial x^2}+\frac{\partial ^2}{\partial y^2})\) is the Laplacian operator in two-dimensional cartesian coordinate on a bounded domain \(\Omega\) and n is the outward normal to \(\partial \Omega .\) \(D_a\), \(D_b\) and \(D_c\) are diffusivity coefficients for the phytoplankton, dissolved oxygen and zooplankton population respectively and other parameters \(\zeta\), \(\beta\), \(\beta _1\), \(\eta\), \(\alpha _1\), \(\alpha _2\), \(\delta _1\), \(\delta _2\) are positive constant. The no-flux boundary condition is used.

Next, we will investigate the effect of diffusion on steady state of the reaction diffusion system. Obviously, the interior equilibrium point \(E^*\) for the non-spatial system (1)–(3) is a spatially homogeneous steady-state for the reaction-diffusion system (11)–(13). We assume that \(E^*\) is stable in the non-spatial system, which means that the spatially homogeneous equilibrium is stable with respect to spatially homogeneous with following perturbations:

$$\begin{aligned} P(x,y,t)&= {} P^* + \epsilon \ exp((k_x+k_y)i+\lambda _kt), \end{aligned}$$
(16)
$$\begin{aligned} D(x,y,t)&= {} D^* + \eta \ exp((k_x+k_y)i+\lambda _kt), \end{aligned}$$
(17)
$$\begin{aligned} Z(x,y,t)&= {} Z^* + \rho \ exp((k_x+k_y)i+\lambda _kt), \end{aligned}$$
(18)

where \(\epsilon\), \(\eta\) and \(\rho\) are chosen to be small and \(k^2 = (k_x^2+k_y^2)\) is the wave number. Substituting (16)–(18) into (11)–(13), we get the following characteristic equation of the linearized system around \(E^*\):

$$\begin{aligned} |J_k-\lambda _k I_3|=0, \end{aligned}$$
(19)

with

$$\begin{aligned} J_k = \left[ \begin{array}{cccc} &{} a_{11}-D_ak^2 &{} a_{12} &{} a_{13} \\ &{} a_{21} &{} a_{22}- D_b k^2 &{} a_{23} \\ &{} a_{31} &{} a_{32} &{} a_{33}-D_c k^2 \end{array} \right] , \end{aligned}$$

where \(a_{11}= \frac{\beta P^* Z^*}{(a+P^*)^2}\), \(a_{12}= \frac{rP^*}{(\zeta +D_0-D^*)^2}\), \(a_{13}= -\frac{ \beta P^*}{a+P^*}\), \(a_{21}= -{\alpha _1}\), \(a_{22}= -\eta\), \(a_{23}= -{\alpha _2}\), \(a_{31}= \frac{a \beta _1 Z^*}{(a+P^*)^2}\), \(a_{32}= 0\), \(a_{33}= 0\). The eigenvalues are the solutions of the characteristic equation,

$$\begin{aligned} \lambda ^3+p_2 \lambda ^2+p_1 \lambda +p_0=0, \end{aligned}$$
(20)

where

$$\begin{aligned} p_2&= \frac{1}{2}\left[ (D_a+D_b+D_c)k^2+\eta -\frac{PZ\beta }{(a+P)^2}\right] , \end{aligned}$$
(21)
$$\begin{aligned} p_1&= \frac{1}{4}\left[ k^4(D_aD_b+D_aD_c+D_bD_c)+k^2 \left( \eta (D_a +D_c)-\frac{PZ\beta }{(a+P)^2}(D_b+D_c)\right) \right. \nonumber \\&\left. +\frac{PZ\beta }{(a+P)^2}\left( \frac{P\beta _1}{(a+P)}-\eta \right) +\frac{Pr \alpha _1}{(\zeta +D_0-D)^2}\right] , \end{aligned}$$
(22)
$$\begin{aligned} p_0&= \frac{1}{8}\left[ D_aD_bD_ck^6+k^4 \left( D_aD_b\eta -\frac{D_bD_cPZ\beta }{(a+P)^2}\right) +k^2\left( \frac{D_bP^2Z\beta \beta _1}{(a+P)^3} -\frac{D_cPZ\beta \eta }{(a+P)^2}+\frac{D_cPr\alpha _1}{(\zeta +D_0-D)^2}\right) \right. \nonumber \\&\left. +\frac{P^2Zr\beta _1\alpha _2}{(a+P)^2(\zeta +D_0-D)^2} +\frac{P^2Z\beta \beta _1\eta }{(a+P)^3}\right] . \end{aligned}$$
(23)

According to the Routh–Hurwitz criterium, all the eigenvalues have negative real parts if and only if the following conditions hold:

$$\begin{aligned}&(a)\quad p_2 > 0, \end{aligned}$$
(24)
$$\begin{aligned}&(b)\quad p_0 > 0, \end{aligned}$$
(25)
$$\begin{aligned}&(c)\quad Q = p_0-p_1p_2<0. \end{aligned}$$
(26)

This is clear from the invariants of the matrix and of its inverse matrix

$$\begin{aligned} J_k^{-1} = \frac{1}{det{(J_k)}} \left( \begin{array}{ccc} M_{11} &{} M_{12} &{} M_{13} \\ M_{21} &{} M_{22} &{} M_{23} \\ M_{31} &{} M_{32} &{} M_{33} \end{array} \right) , \end{aligned}$$

where \(M_{11}=0\), \(M_{12}=0\), \(M_{13}=-(\frac{\alpha _2r P}{(\zeta +D_0-D)^2}+\frac{\eta \beta P}{(a+P)})\), \(M_{21}= - \frac{a \alpha _2 \beta _1 Z}{(a+P)^2}\), \(M_{22}=\frac{a \beta \beta _1 P Z}{(a+P)^3}\), \(M_{23}= \frac{\alpha _2 \beta P Z}{(a+P)^2}+\frac{\alpha _1\beta P}{a+P}\), \(M_{31}=\frac{\eta a \beta _1 Z}{(a+P)^2}\), \(M_{32}=\frac{a r \beta _1 PZ}{(a+P)^2(\zeta +D_0-D)^2}\), \(M_{33}=\frac{\alpha _1 r P}{(\zeta +D_0-D)^2}-\frac{\eta \beta PZ}{(a+P)^2}\).

Here, matrix \(M_{ij}\) is the adjunct of \(J_k\).

It is obvious that these conditions possess a symmetry with respect to \(J_k\) and \(J_k^{-1}\). Contradiction of any one of the above conditions implies the existence of an eigenvalue with positive real part, hence instability. We obtain the following conditions of the steady-state stability (i.e., stability for any value of k):

  1. (i)

    All diagonal cofactors of matrix \(J_{k}\) must be positive.

  2. (ii)

    All diagonal elements of matrix \(J_k\) must be negative.

The two above condition taken together are sufficient to ensure stability of a give steady state. It means that instability for some \(k>0\) can only be observed if at least one of them is violated. Thus we arrive at the following necessary condition for the Turing instability (Baghel et al. 2012; Qian and Murray 2003):

(i) The largest diagonal element of matrix \(J_{k}\) must be positive and/or (ii) the smallest diagonal cofactor of matrix \(J_k\) must be negative.

By the Routh–Hurwitz criteria, instability takes place if and only if one of the conditions (24)–(26) is broken. We consider (25) for instability condition:

$$\begin{aligned} p_0(k)&= D_aD_bD_ck^6-(D_aD_ba_{33}+D_bD_ca_{11}+D_aD_ca_{22})k^4\nonumber \\&\quad +(D_aM_{11}+D_bM_{22}+D_3M_{33})k^2-detJ. \end{aligned}$$
(27)

According to Routh–Hurwitz criterium \(p_0(k^2)<0\) is sufficient condition for matrix \(J_k\) being unstable. Let us assume that \(M_{33}<0\). If we choose \(D_a=0, D_b=0\) and

$$\begin{aligned} p_0(k^2)&= D_c M_{33}k^2-det(J_k)\nonumber \\&= - \left( \frac{P^2Zr\beta _1\alpha _2}{(a+P)^2(\zeta +D_0-D)^2} +\frac{P^2Z\beta \beta _1\eta }{(a+P)^3}\right) < 0. \end{aligned}$$
(28)

Hence, in this system diffusion-driven instability occur.

Now, we obtained the eigenvalues of the characteristic equation (20) numerically of the spatial system (11)–(13). Here, we choose some parametric values of \(r=0.445532\), \(a=3.0\), \(\zeta =0.2\), \(\delta _1=0.1\), \(\beta =0.2\), \(\beta _1=0.4\), \(D_0=3\), \(\alpha _1=0.18\), \(\alpha _2=0.2\), \(\delta _2=0.3\), \(\eta =2.085\). From (28), in this set of values \(P_0(k^2)<0\), \(\forall \ \ k>0\), (see Fig. 4).

Fig. 4
figure 4

Maximum Re\((\lambda (k))\) against k. The other parametric values are given in text. Here, we can observe that diffusion driven instability in this system

Spatiotemporal pattern formation

It is well known that the analytical solution of the coupled reaction-diffusion system is not always possible. Hence, one has to use numerical simulations to solve them. In this section, the two-dimensional spatiotemporal system (11)–(13) is solved numerically using a finite difference approximation method for the spatial derivatives. In order to avoid numerical artifacts steps of time and space have been chosen sufficiently small. Since we have chosen a closed environment, so all the numerical simulations use the zero-flux boundary conditions in a square habitat of size \(100 \times 100\) and \(200 \times 200\) and iterations are performed for different step sizes in time.

Now, we obtained that the spatial distributions of plankton dynamics in the time evaluation in Figs. 5, 6 and 7. By varying coupling parameters, we observe that if one parameter value changes then spatial structure changes over the time of the spatial system. In Figs. 5, 6 and 7, it has been observed well organized structures for the spatial distribution population also observed that as time T increases from 100 to 1000 the density of different classes of population becomes uniform throughout the space. Finally, all these figures show the qualitative changes in spatial density distribution of the spatial system for the each species.

Fig. 5
figure 5

Spatial distribution of phytoplankton (first column), dissolved oxygen (second column) and zooplankton (third column) population density of the system (11)–(13). Spatial patterns are obtained with diffusivity coefficient \(D_a=0.06, D_b=0.04, D_c=0.02\) at different time levels: for plot \(T =300 (a, b, c)\), \(T = 500 (d, e, f)\), \(T = 1000 (g, h, i)\)

Fig. 6
figure 6

Spatial distribution of phytoplankton (first column), dissolved oxygen (second column) and zooplankton (third column) population density of the system (11)–(13). Spatial patterns are obtained with diffusivity coefficient \(D_a=0.03, D_b=0.02, D_c=0.1\) at different time levels: for plot T =200 (a, b, c), T = 400 (d, e, f), T = 1000 (g, h, i)

Fig. 7
figure 7

Spatial distribution of phytoplankton (first column), dissolved oxygen (second column) and zooplankton (third column) population density of the system (11)–(13). Spatial patterns are obtained with diffusivity coefficient \(D_a=0.1, D_b=0.2, D_c=0.03\) at different time levels: for plot T =100 (a, b, c), T = 500 (d, e, f), T = 1000 (g, h, i)

Also, we have shown the effect of the diffusivity coefficients in the system (11)–(13) and observed that the system is stabilized as diffusivity coefficients increases (see Figs. 8, 9).

Fig. 8
figure 8

Spatial distribution of phytoplankton density (first column), dissolved oxygen density (second column) and zooplankton density (third column) of the spatial system (11)–(13). Spatial patterns are obtained at fixed time \(T = 500\) with diffusivity coefficients \(D_a=0.3\), \(D_b=0.2\) and for different values of \(D_c\): in \(D_c = 0.06 (a, b, c)\), \(D_c = 0.6 (d, e, f)\), \(D_c = 2.0 (g, h, i)\)

Fig. 9
figure 9

Spatial distribution of phytoplankton density (first column), dissolved oxygen density (second column) and zooplankton density (third column) of the spatial system (11)–(13). Spatial patterns are obtained at fixed time \(T = 300\) with diffusivity coefficient \(D_b=0.02\), \(D_c=0.02\) and for different values of \(D_a\): in \(D_a = 0.1 (a, b, c)\), \(D_a = 0.6 (d, e, f)\), \(D_a = 1.0 (g, h, i)\)

Higher order stability analysis

In this section, we will study the stability of the higher-order spatiotemporal perturbation terms (Riaz et al. 2007). Without loss of generality our proposed system (11)–(13) can be described as three dimensional reaction-diffusion system as follows:

$$\begin{aligned} u_t&= f(u, v, w)+ D_a (u_{xx}+u_{yy}), \end{aligned}$$
(29)
$$\begin{aligned} v_t&= g(u, v, w)+ D_b (v_{xx}+ v_{yy}), \end{aligned}$$
(30)
$$\begin{aligned} w_t&= h(u, v, w)+ D_c(w_{xx}+w_{yy}), \end{aligned}$$
(31)

with initial distribution and no-flux boundary conditions of population within 2D closed domain. The non-zero equilibrium \(E_2\) of the system (1)–(3) is a spatially homogeneous equilibrium for the system (29)–(31). We consider that in the temporal model \(E^* = (u^*, v^*, w^*)\) is locally asymptotically stable and also taking the spatial perturbations in spatial system u(txy), v(txy) and w(txy) around the steady states \(u^*, v^*, w^*\) defined by \(u = u^* + n(t, x, y)\), \(v = v^* + p(t, x, y)\), \(w = w^* + m(t, x, y)\) and finally expanding the temporal part using Taylor series up to second order, we get following three expressions:

$$\begin{aligned} n_t&= f_u n+f_v p+f_w m+ \frac{f_{uu}}{2}n^2+\frac{f_{vv}}{2} p^2+ \frac{f_{ww}}{2} m^2+f_{uv} n p \nonumber \\&\quad + f_{v w} p m+f_{uw} n m + D_a(n_{xx}+n_{yy}), \end{aligned}$$
(32)
$$\begin{aligned} p_t&= g_u n+g_v p+g_w m+ \frac{g_{uu}}{2}n^2+\frac{g_{vv}}{2} p^2+ \frac{g_{ww}}{2} m^2+g_{uv} n p \nonumber \\&\quad + g_{vw} p m+g_{uw} n m+ D_b (p_{xx}+ p_{yy}). \end{aligned}$$
(33)
$$\begin{aligned} m_t&= h_u n+h_v p+h_w m+ \frac{h_{uu}}{2}n^2+\frac{h_{vv}}{2} p^2+ \frac{h_{ww}}{2} m^2+h_{uv} n p \nonumber \\&\quad + h_{vw} p m+h_{uw} n m+ D_c (m_{xx}+ m_{yy}). \end{aligned}$$
(34)

Now, we taking particular periodic type of spatial perturbations:

$$\begin{aligned} n(t, x, y)&= n(t) \cos (k_x x) \cos (k_y y), \\ p(t, x, y)&= p(t) \cos (k_x x) \cos (k_y y),\\ m(t, x, y)&= m(t) \cos (k_x x) \cos (k_y y), \end{aligned}$$

with boundary conditions, we get the following three system of equations:

$$\begin{aligned} n_t&= f_u n+f_v p+f_w m+ \frac{f_{uu}}{2}n^2+\frac{f_{vv}}{2} p^2+ \frac{f_{ww}}{2} m^2+f_{uv} n p \nonumber \\&\quad + f_{v w} p m+f_{uw} n m - D_a k^2 n, \end{aligned}$$
(35)
$$\begin{aligned} p_t&= g_u n+g_v p+g_w m+ \frac{g_{uu}}{2}n^2+\frac{g_{vv}}{2} p^2+ \frac{g_{ww}}{2} m^2+g_{uv} n p \nonumber \\&\quad + g_{vw} p m+g_{uw} n m - D_b k^2 p. \end{aligned}$$
(36)
$$\begin{aligned} m_t&= h_u n+h_v p+h_w m+ \frac{h_{uu}}{2}n^2+\frac{h_{vv}}{2} p^2+ \frac{h_{ww}}{2} m^2+h_{uv} n p \nonumber \\&\quad + h_{vw} p m+h_{uw} n m - D_c k^2 m. \end{aligned}$$
(37)

It is observed from above three equations that the increase or decrease of first-order perturbation terms depends upon the second-order perturbation terms. Again, multiplying (35) by 2n and neglecting the contribution of third-order perturbation terms, we find the dynamical equation of \(n^2\) in terms of second-order perturbation as

$$\begin{aligned} (n^2)_t&= 2f_u n^2+2f_v n p+2 f_w n m-2 D_a k^2 n^2, \end{aligned}$$
(38)

and similarly, we can obtain the dynamical equations for the rest of the second-order perturbations as

$$\begin{aligned} (p^2)_t&= 2g_u np+2g_v p^2+2g_w p m - 2 D_b k^2 p^2, \end{aligned}$$
(39)
$$\begin{aligned} (m^2)_t&= 2h_u n m+2h_v p m+2h_w m^2 - 2 D_c k^2 m^2, \end{aligned}$$
(40)
$$\begin{aligned} (n p)_t&= g_u n^2+f_v p^2+(f_u+g_v)np-k^2(D_a+ D_b)n p, \end{aligned}$$
(41)
$$\begin{aligned} (p m)_t&= h_v p^2+g_w m^2+g_u n m+h_u n p+(g_v+h_w)p m \nonumber \\&\quad -k^2(D_b+ D_c) p m, \end{aligned}$$
(42)
$$\begin{aligned} (n m)_t&= h_u n^2+f_w m^2+f_v p m+h_v n p+(f_u+h_w)n m \nonumber \\&\quad -k^2(D_a+ D_c) n m. \end{aligned}$$
(43)

In the dynamical equations (35)–(43), we have truncated all third and higher-order terms in Taylor series expansion and also neglected all third and higher-order terms, it resulting us to a closed system of equations for n, p, m, \(n^2\), \(p^2\), \(m^2\), n p, p m, n m. Otherwise, it is impossible to avoid infinite hierarchy of dynamical equations for perturbation terms. Implication of the analysis for the system (11)–(13) can be justified with the perturbation terms up to order two with special choice of parameter values. Rewriting the dynamical equations (35)–(43) in matrix form as follows:

$$\begin{aligned} \frac{d X}{dt} = AX, \end{aligned}$$
(44)

where, \(X = [n, p, m, n^2, p^2, m^2, n p, p m, n m]^T\) and

$$\begin{aligned} A=\left[ \begin{array}{cccccccccccc} &{} a_{11} &{} f_v &{} f_w &{} \frac{f_{uu}}{2} &{} \frac{f_{vv}}{2} &{} \frac{f_{ww}}{2} &{} f_{uv} &{} f_{vw} &{} f_{uw} \\ &{} g_u &{} a_{22} &{} g_w &{} \frac{g_{uu}}{2} &{} \frac{g_{vv}}{2} &{} \frac{f_{ww}}{2} &{} g_{uv} &{} g_{vw} &{} g_{uw}\\ &{} h_u &{} h_v &{} a_{33} &{} \frac{h_{uu}}{2} &{} \frac{h_{vv}}{2} &{} \frac{h_{ww}}{2} &{} h_{uv} &{} h_{vw} &{} h_{uw} \\ &{} 0 &{} 0 &{} 0 &{} a_{44} &{} 0 &{} 0 &{} 2f_v &{} 0 &{} 2f_w \\ &{} 0 &{} 0 &{} 0 &{} 0 &{} a_{55} &{} 0 &{} 2 g_u &{} 2g_w &{} 0\\ &{} 0 &{} 0 &{} 0 &{} 0 &{} 0 &{} a_{66} &{} 0 &{} 2 h_v &{} 2 h_u\\ &{} 0 &{} 0 &{} 0 &{} g_u &{} f_v &{} 0 &{} a_{77} &{} 0 &{} 0 \\ &{} 0 &{} 0 &{} 0 &{} 0 &{} h_v &{} g_w &{} h_u &{} a_{88} &{} g_u\\ &{} 0 &{} 0 &{} 0 &{}h_u &{} 0 &{} f_w &{} h_v &{} f_v &{} a_{99}\\ \end{array} \right] , \end{aligned}$$

with \(a_{11} = f_u- D_a k^2\), \(a_{22} = g_v-D_b k^2\), \(a_{33} = h_w - D_c k^2\), \(a_{44} = 2(f_u-D_a k^2)\), \(a_{55} = 2(g_v-D_bk^2)\), \(a_{66}=2(h_w-D_c k^2)\), \(a_{77}=f_u+g_v-k^2(D_a+D_b)\), \(a_{88}=g_v+h_w-k^2(D_b+D_c)\), \(a_{99}=f_u+h_w-k^2(D_a+D_c)\).

Choosing the solution of the system of (44) in the form \(X(t) \sim e^{\lambda t}\), we can get the characteristic equation for the matrix A

$$\begin{aligned} |A- \lambda I_5 | = 0, \end{aligned}$$
(45)

and the roots of (45) are \(\lambda \equiv \lambda (k)\), which are eigenvalues of A. For the instability condition requires at least one of the eigenvalues of matrix A must have positive real part, i.e., \(Re(\lambda (k)) > 0\) for at least one \(r\epsilon (1, 2, 3, \ldots , 9)\). Again, existence of at least one eigenvalue with positive real part implies that spatiotemporal perturbation diverge with the advancement of time. Here, using numerical simulations, we will find an interval for k where at least one eigenvalues of A have positive real part.

Now, we consider the system (11)–(13) and taking some parameter values \(r=0.445532\), \(a=3.0\), \(\zeta =0.2\), \(\delta _1=0.1\), \(\beta =0.2\), \(\beta _1=0.4\), \(D_0=3\), \(\alpha _1=0.18\), \(\alpha _2=0.2\), \(\delta _2=0.3\), \(\eta =2.085\), \(D_a=0.3\), \(D_b=0.2\) and four different values of \(D_c=0.5, 0.9, 2.0, 6.0\). In this case, the interior equilibrium point \((P^*, D^*, Z^*) = (9, 1.67182, 5.74631)\) is locally asymptotically stable for the temporal model (1)–(3). For finding the possibility that one eigenvalue of the system (11)–(13) having positive real part, we have plotted largest \(Re\{\lambda (k)\}\equiv\) linear obtained by solving (20) along with largest \(Re\{\lambda (k)\}\equiv\) higher order computed numerically for the characteristic equation (45) for a range of wavelengths values of k, shown in Fig. 10. It is observed that in the case of linear the \(max Re\{\lambda (k)\}\) is positive after certain value of k, and in higher order \(max Re\{\lambda (k)\} < 0\), for all values of k. These results ensure that the linearly unstable system may become stable in higher order.

Fig. 10
figure 10

Maximum of Re(\(\lambda (k)\)) plots for (black line) linear and (red line) non-linear system versus k. The parametric values are given in the text

Conclusions

In this paper, we have studied a three dimensional plankton dynamics with and without diffusion. We have obtained the local stability and existence of Hopf-bifurcation with respect to r as a bifurcation parameter (i.e., r the growth rate of phytoplankton due to the up-taking of dissolved oxygen) of the temporal system. If r, crosses its threshold value, i.e., \(r=r_0\), then phytoplankton, dissolved oxygen and zooplankton population start oscillating around the endemic equilibrium. The above result has been shown numerically in Figs. 2, 3 for different values of r. Also we have obtained analytically the stability of the bifurcating solution of the temporal system. Furthermore, it has been established analytically as well as numerically that the diffusion driven instability occurs in the spatial system (see Fig. 4). We have obtained the nature of spatial patterns with respect to time (see Figs. 5, 6, 7). Also, we have shown the effect of diffusion on the spatiotemporal system in two dimensional case and it is shown that sufficiently large diffusivity coefficients are stabilized the system (see Figs. 8, 9). Further from higher-order stability analysis, and have observed that stability behavior remains unchanged for second order (see Fig. 10). Our results have suggested that modeling using reaction-diffusion equation is one of the appropriate tool for investigating fundamental mechanisms of complexity for the spatiotemporal dynamics. It may help us for better understanding of the plankton dynamics in a real environment.