1 Introduction

Einstein’s theory of gravity predicts the accelerating expansion of the late-time universe, which has been confirmed by the cosmological observations from type Ia Supernovae (SNIa) [1, 2]. The expansion of the universe can be explained by the simplest model of the cosmological constant that currently gives the best fit with the current observational data from Cosmic Microwave Background (CMB) radiation, the measurement of Type Ia Supernovae (SNIa), Baryon Acoustic Oscillation (BAO), and \(H_0\) measurement [3, 4]. However, some issues remain for the cosmological constant or \(\varLambda \)CDM model as encountered from the observations [3, 5, 6] and a seriously theoretical inconsistency [7, 8], and for a review, one may refer to [9, 10]. In these regards, several modified theories of gravity have been proposed to refine or provide alternatives. Without exhaustion, we list down some of the theories which deviate from the standard cosmological model:

Scalar–tensor theory [11,12,13,14,15], vector-tensor [16], tensor-tensor theory [17,18,19], massive gravity [20,21,22], higher order derivative theory, in particular, the f(R)-gravity for cosmology [23,24,25,26], and higher-dimensional and string motivated theory [27,28,29,30, 44, 45]. For the nice review, one can be referred to [31, 32]. Also, there are many dark energy models under these frameworks such as

Chevallier Polarski Linder (CPL) model [33, 34], Holographic Dark Energy model and its constraint [35,36,37,38,39], Generalized holographic cosmology via AdS/CFT constraint with low redshift [40], and Chaplygin gas model [41, 42] to name a few. One can refer to [43] for model comparison using observational data from Planck 2015.

It is well-known that Lovelock’s theorem is a natural generalization to general relativity, which satisfies the diffeomorphism and local Lorentz invariance in D-dimensional space-time and, in particular, leads to second-order field equations [44, 46, 47]. A special case of this is the second order in Lanczos-Lovelock gravity Lagrangian density so-called Einstein–Gauss–Bonnet gravity. Consequently, one possible modification of General Relativity is the \(D\ge 5\) Gauss-Bonnet (GB) gravity which satisfies the properties in Lovelock’s theorem, including the ghost-free [48], natural generalization with Einstein, and cosmological terms [49]. For its study of higher dimensions in cosmology, one can refer to [50,51,52]. However, the GB term in 4D is topologically invariant, so it does not modify Einstein’s theory since it does not contribute to gravitational dynamics. Nevertheless, the GB term can contribute to the 4D dynamical equations if one introduces a coupling function of a scalar field to the GB term [53, 54]. Due to the extra scalar degree of freedom, this consideration leads to many gravity studies, including cosmic acceleration in inflationary models of the early universe and gravitational wave, and tested against the observational data [55,56,57,58,59,60,61,62,63]. Recently, the observational data using black hole image has been investigated in GB gravity as well [64, 65].

The 4D EGB model proposed in [66] introduces a scaling coupling constant \(\alpha \rightarrow \alpha /(D-4)\), where D is the space-time dimensions, and considers the limit \(D\rightarrow 4\). This model gives rise to nontrivial contributions to the gravitational dynamics due to the extra contribution in the equations of motion (EoM) from the GB term as the consequence of the scaling coupling constant without introducing extra degrees of freedom. Notice that in this model the space-time was assumed to be continuous [67]. To be less exhaustive, there is an interesting work in cosmology adopting this model with the observational constraints which can resolve the coincidence problem [68] and also indicate that the re-scaling coupling constant of the model still needs the help of the cosmological constant to explain the accelerated expansion. For a review of the model, one may refer to [69].

Due to its richness and peculiar consequences, comments and arguments on this novel 4D EGB theory have been raised [70,71,72,73,74,75,76], and the diffeomorphism invariant regularization is also considered in [77,78,79,80,81,82] to point out that the theory advertised in [66] is the subclass of Horndeski theory. However, the arguments from Horndeski theory still rely on a \(2+1\) degrees of freedom where higher dimensions are compactified and where in [66] the space-time is based on the D-dimensional direct product and \(D\rightarrow 4\) limit, and further investigation into this regularized tensor-scalar theory leading to a strong-coupling scalar field is studied in [79, 83] and without the strong coupling field in [84]. Another investigation into the regularized 4D EGB theory is that looking at diffeomorphism invariant property reveals the inconsistency in the regularized 4D EGB theory [73, 75, 76]. Nevertheless, the consistent study of \(D \rightarrow 4\) EGB theory can be achieved up to spatially diffeomorphism invariance by using Hamiltonian formalism so-called minimally modified gravity theory; otherwise, an extra degree of freedom is required [85, 86]. Therefore, we will proceed by introducing an additional degree of freedom but still exploiting the regularization scheme which is expected to render the finite term that contributes to the dynamics. That is, we will scale \(\alpha \rightarrow \alpha /(D-4)\) and take the limit \(D\rightarrow 4\) after introducing the non-minimal coupling function to the GB term. In this regard, we are interested in generalizing this concept by combining the role of the non-minimal coupling function often used in ordinary 4D gravity with the scaling coupling constant advocated in the regularized 4D EGB gravity together. This seems to be a redundant consideration at first because the role of scaling coupling is to render the term of the overall factor (\(D-4\)) coming from the GB term so that these higher curvature terms become relevant, which is also the role of the non-minimal coupling function. As a result, in the current study, we accept the necessity of the extra scalar degree of freedom in the framework of regularized 4D EGB.

In this works, we study the extension of regularized 4D EGB theory by introducing the non-minimal coupling to the GB term and redefining the coupling function

$$\begin{aligned} \xi (\phi ) \rightarrow \xi ^{(D-4)}(\phi ), \end{aligned}$$

with flat FRW metric in D-dimensions then take the limit \(D \rightarrow 4\). The motivation of the form of coupling function is obvious so that divergence of the terms associated to the scaling of \(\alpha \) remains well-defined in the EoM. From this consideration, it is obvious that the action could be ambiguous but not ill-defined since this happens to the original regularized 4D EGB where its action might be investigated further [77,78,79,80,81,82]; this issue is not our concern here. From this, we apply the dynamical system approach (DSA) [87,88,89,90,91] with the exponential of the potential and the coupling function of the scalar field into the dynamical equations of the model. We find the fixed points and analyze the stability of the autonomous system equations including the consideration of the evolution of the phase space universe. Particularly we consider the evolution of the cosmological parameters as the function of the red-shift and constraint on the potential parameter with the observational bounds from CMB, BAO, SnIa, and \(H_0\) measurement.

This article is organized as follows. In Sect. 2, we introduce our setup and derive the EoM for our model. As a result, there appear two types of additional contributions in the 4D EoM each coming from the non-minimal coupling of the scalar field to the GB term and the scaling coupling constant of the GB term. Thus, it is imperative for us to study their respective role and their dynamic evolution throughout the cosmic history of the universe. To investigate the dynamical evolution of the universe for our model, we rewrite the background EoM in the autonomous system form in Sect. 3 and apply the dynamical system approach, which gives a robust description of the cosmic history based on the existence of critical points and their stability. In Sect. 4, we obtain not only the critical fixed points of the system but also consider the stability of the universe at each point. We solve the dynamical equations for a broader time scale to better understand how the aforementioned GB contributions evolve, especially at the late time, and provide our numerical result with their implications. A summary of our results in this paper and a conclusion are given in Sect. 5.

2 The setup and equations of motion

In this work, we consider the action in D-dimensional space-time as follow,

$$\begin{aligned} S =&\int \textrm{d}^D x\sqrt{-g}\Bigl [\frac{1}{2\kappa ^2}R-\frac{1}{2}g^{\mu \nu }\partial _\mu \phi \partial _\nu \phi -V(\phi )\nonumber \\&-\frac{\alpha }{2}\xi (\phi ){\mathcal {G}} \Bigr ]+S_{\text {m,r}}, \end{aligned}$$
(1)

where R, \(\alpha \), \(V(\phi )\), \(\xi (\phi )\) are Ricci scalar, a coupling constant, potential function and the coupling function of scalar field respectively.

$$\begin{aligned} {\mathcal {G}} \equiv R^2-4R_{\mu \nu }R^{\mu \nu }+R_{\mu \nu \rho \sigma }R^{\mu \nu \rho \sigma }, \end{aligned}$$

is GB term, \(S_{\text {m,r}}\) represents the standard matter and radiation components, \(\kappa ^2=8\pi G\), and G is Newtonian constant. From this action, after obtaining the EoM, we re-scale \(\alpha \rightarrow \alpha /(D-4)\) and then take the limit \(D\rightarrow 4\). The problem arises when we introduce \(\xi (\phi )\) couples to GB term since the expected finite terms from \(\xi (\phi )\) which appear in the EoM contain no factor of (\(D-4\)). As a result, \(1/(D-4)\) from the scaling \(\alpha \) will diverge. We propose the redefining the coupling function

$$\begin{aligned} \xi (\phi )\rightarrow \xi ^{(D-4)}(\phi ), \end{aligned}$$

first and then take the limit \(D\rightarrow 4\). Therefore, denominator \(1/(D-4)\) will be canceled out with the overall factor (\(D-4\)) coming from the redefined coupling function. From the least-action principle, the field equations after scaling \(\alpha \) and redefining \(\xi (\phi )\) are

$$\begin{aligned}&R_{\mu \nu }-\frac{1}{2}g_{\mu \nu }R=\kappa ^2\left( T^{(\phi )}_{\mu \nu }+T^{\text {(m,r)}}_{\mu \nu }+T^{\text {(GB)}}_{\mu \nu }\right) , \end{aligned}$$
(2)
$$\begin{aligned}&\Box \phi -V_\phi -\frac{\alpha }{2(D-4)}(D-4)\xi ^{(D-5)}\xi _\phi {\mathcal {G}}=0, \end{aligned}$$
(3)

where \(\Box \equiv \nabla _\mu \nabla ^\mu \), \(V_\phi =dV/d\phi \), \(\xi _\phi =d\xi /d\phi \), and \(T^{(\phi )}_{\mu \nu },\) \(~T^{\text {(m,r)}}_{\mu \nu },~T^{\text {(GB)}}_{\mu \nu }\) are stress-energy-momentum tensor of scalar field, GB term and matter term respectively, which we find

$$\begin{aligned} T^{(\phi )}_{\mu \nu }&=\partial _\mu \phi \partial _\nu \phi -\frac{1}{2}g_{\mu \nu }\left( g^{\rho \sigma }\partial _\rho \phi \partial _\sigma \phi +2V \right) , \end{aligned}$$
(4)
$$\begin{aligned} T^{(\text {m,r})}_{\mu \nu }&=(\rho +P)U_\mu U_\nu + P g_{\mu \nu }, \end{aligned}$$
(5)
$$\begin{aligned} T^{(\text {GB})}_{\mu \nu }&=\frac{\alpha }{(D-4)}\Biggl \{\xi ^{(D-4)}\Bigl (-4R_\mu ~ ^\alpha R_{\nu \alpha }+2R R_{\mu \nu }\nonumber \\&\quad -4R^{\alpha \beta }R_{\mu \alpha \nu \beta } +2R_\mu ~^{\alpha \beta \gamma } R_{\nu \alpha \beta \gamma } -\frac{1}{2} g_{\mu \nu } {\mathcal {G}} \Bigr ) \nonumber \\&\quad +(D-4)(D-5)\xi _\phi ^2\xi ^{(D-6)} \Biggl [ g_{\mu \nu }\Bigl (2R \nabla ^\alpha \phi \nabla _\alpha \phi \nonumber \\&\quad -4R_{\alpha \beta }\nabla ^\alpha \phi \nabla ^\beta \phi \Bigr )-4R_{\mu \nu }\nabla ^\alpha \phi \nabla _\alpha \phi \nonumber \\&\quad +4R_{\mu \alpha \nu \beta }\nabla ^\alpha \phi \nabla ^\beta \phi +4R_{\nu \alpha }\nabla ^\alpha \phi \nabla _\mu \phi \nonumber \\&\quad +4R_{\mu \alpha } \nabla ^\alpha \phi \nabla _\nu \phi -2R\nabla _\mu \phi \nabla _\nu \phi \Biggr ]+(D-4)\xi ^{(D-5)}\nonumber \\&\quad \times \Biggl [\xi _\phi \Bigl (-4R_{\mu \nu }\Box \phi +2R_{\mu \alpha \nu \beta } \nabla ^\beta \nabla ^\alpha \phi +2R_{\mu \beta \nu \alpha } \nabla ^\beta \nabla ^\alpha \phi \nonumber \\&\quad +g_{\mu \nu }\Bigl (2R\Box \phi -4R_{\alpha \beta }\nabla ^\beta \nabla ^\alpha \phi \Bigr )+4R_{\nu \alpha }\nabla _\mu \nabla ^\alpha \phi \nonumber \\&\quad +4R_{\mu \alpha }\nabla _\nu \nabla ^\alpha \phi -2R\nabla _\nu \nabla _\mu \phi \Bigr )+\xi _{\phi \phi }\nonumber \\&\quad \times \Bigl (-4R_{\mu \nu }\nabla ^\alpha \phi \nabla _\alpha \phi +4R_{\mu \alpha \nu \beta }\nabla ^\alpha \phi \nabla ^\beta \phi \nonumber \\&\quad +g_{\mu \nu }\Bigl ( 2R\nabla ^\alpha \phi \nabla _\alpha \phi -4R_{\alpha \beta }\nabla ^\alpha \nabla ^\beta \phi \Bigr )\nonumber \\&\quad +4R_{\nu \alpha }\nabla ^\alpha \phi \nabla _\mu \phi +4R_{\mu \alpha }\nabla ^\alpha \phi \nabla _\nu \phi -2R\nabla _\mu \phi \nabla _\nu \phi \Bigr ) \Biggr ] \Biggr \}, \end{aligned}$$
(6)

where \(U_\mu =(1,0,0,0)\) is four-velocity and \(\rho ,~P\) are the energy density and pressure in perfect fluid respectively. The homogeneous and isotropic universe spatially flat \(k=0\) of Friedmann-Robertson-Walker (FRW) metric in D-dimensions is given

$$\begin{aligned} \text {d}s^2=-\text {d}t^2+a^2(t)(\text {d}\chi _1^2+\text {d}\chi _2^2+\text {d}\chi _3^2+\cdots +\text {d}\chi _{D-1}^2),\nonumber \\ \end{aligned}$$
(7)

where a(t) is a scale factor. Notice that the above line element is a D-dimensional product space. By solving the field equations with flat FRW metric in arbitrary dimensions we can write the EoM in general dimensions for the components tt, ii, and scalar field equation as the following

$$\begin{aligned}&\frac{(D-2)(D-1)}{2\kappa ^2}H^2 =\frac{1}{2}{\dot{\phi }}^2+V+\rho _\text {m}+\rho _\text {r}\nonumber \\&\qquad +2\alpha (D-3)(D-2)(D-1){\dot{\xi }}\xi ^{(D-5)}H^3\nonumber \\&\qquad +\frac{1}{2}\alpha (D-3)(D-2)(D-1)\xi ^{(D-4)}H^4, \end{aligned}$$
(8)
$$\begin{aligned}&\qquad -\left[ \frac{(D-3)(D-2)}{2\kappa ^{2}}H^2+\frac{(D-2)}{\kappa ^{2}}\frac{\ddot{a}}{a} \right] \nonumber \\&\quad = \frac{1}{2}\dot{\phi ^2}-V+p_\text {r}-4\alpha (D-3)(D-2){\dot{\xi }}\xi ^{(D-5)}H\frac{\ddot{a}}{a}\nonumber \\&\qquad -2\alpha (D-3)(D-2)\xi ^{(D-4)}H^2\frac{\ddot{a}}{a}\nonumber \\&\qquad -2\alpha (D-3)(D-2)H^2\nonumber \\&\qquad \times \left[ (D-5){\dot{\xi }}^2\xi ^{(D-6)}+\ddot{\xi }\xi ^{(D-5)} \right] \nonumber \\&\qquad -2\alpha (D-4)(D-3)(D-2){\dot{\xi }}\xi ^{(D-5)}H^3\nonumber \\&\qquad -\frac{1}{2}\alpha (D-3)(D-2)(D-5)\xi ^{(D-4)}H^4, \end{aligned}$$
(9)
$$\begin{aligned}&0=\ddot{\phi }+V_\phi +(D-1){\dot{\phi }}H\nonumber \\&\qquad +2\alpha (D-3)(D-2)(D-1)\xi _\phi \xi ^{(D-5)}H^2\frac{\ddot{a}}{a}\nonumber \\&\qquad +\frac{\alpha }{2}(D-4)(D-3)(D-2)(D-1)\xi _\phi \xi ^{(D-5)}H^4, \end{aligned}$$
(10)

where \(V_\phi =dV/d\phi \), \(H \equiv {\dot{a}}/a\), denote the derivative of potential with respect to scalar field and Hubble’s parameter respectively. A dot mean derivative with respect to the cosmic time, \(\rho _\text {m}\) and \(\rho _\text {r}\) are the energy density of matter corresponding to pressure \(p_\text {m}=0\) and radiation corresponding to \(p_\text {r}=\rho _\text {r}/3\) respectively. Then, determining the limit \(D\rightarrow 4\) for the Eqs. (8)–(10), we derive the explicit dynamical equations in 4-dimensions as

$$\begin{aligned}&\frac{3H^2}{\kappa ^2} =\Bigl (\rho _\text {m}+\rho _\text {r}+\frac{1}{2}{\dot{\phi }}^2+V+12\alpha \frac{{\dot{\xi }}}{\xi }H^3+3\alpha H^4 \Bigr ), \end{aligned}$$
(11)
$$\begin{aligned}&\frac{2{\dot{H}}+3H^2}{\kappa ^2} =-\Biggl [\frac{\rho _\text {r}}{3}+\frac{{\dot{\phi }}^2}{2}-V-8\alpha \frac{{\dot{\xi }}}{\xi } H({\dot{H}}+H^2)-3\alpha H^4\nonumber \\&\quad -4\alpha H^2{\dot{H}}-4\alpha \left( -\frac{{\dot{\xi }}^2}{\xi ^2}+\frac{\ddot{\xi }}{\xi } \right) H^2\Biggr ], \end{aligned}$$
(12)
$$\begin{aligned}&\ddot{\phi }+V_\phi +3{\dot{\phi }}H+12\alpha \frac{\xi _\phi }{\xi }H^2\left( {\dot{H}}+H^2\right) =0, \end{aligned}$$
(13)

where \(\xi _\phi =d\xi /d\phi \), \(\xi _{\phi \phi }=d^2\xi /d\phi ^2\) and \({\dot{\xi }}=\xi _\phi {\dot{\phi }}\) and in (11), the quartic term in Hubble parameter is the term that appears in [66], but our equations add the cubic terms in Hubble parameter and terms associated with \(\xi (\phi )\) due to the regularization of the non-minimal coupling function to the GB term. These additional terms might give explanations of the history of the universe from the early to the late-time universe. The continuity equation of radiation density is

$$\begin{aligned} \dot{\rho _\text {r}}+4H\rho _\text {r}=0. \end{aligned}$$
(14)

By using the redefinition of some quantities, we can rewrite Eqs. (11) and (12) as

$$\begin{aligned} 3H^2&=\kappa ^2\left( \rho _\text {m}+\rho _\text {r}+\rho _\phi \right) , \end{aligned}$$
(15)
$$\begin{aligned} 2{\dot{H}}+3H^2&=-\kappa ^2\left( \frac{1}{3}\rho _\text {r}+p_\phi \right) , \end{aligned}$$
(16)

where the energy density and the pressure of the scalar field is defined as

$$\begin{aligned} \rho _\phi&=\frac{1}{2}{\dot{\phi }}^2+V+12\alpha \frac{{\dot{\xi }}}{\xi }H^3+3\alpha H^4, \end{aligned}$$
(17)
$$\begin{aligned} p_\phi&=\frac{{\dot{\phi }}^2}{2}-V-8\alpha \frac{{\dot{\xi }}}{\xi } H({\dot{H}}+H^2)-3\alpha H^4-4\alpha H^2{\dot{H}}\nonumber \\&\quad -4\alpha \left( -\frac{{\dot{\xi }}^2}{\xi ^2}+\frac{\ddot{\xi }}{\xi } \right) H^2. \end{aligned}$$
(18)

The components of \(\rho _\phi \) and \(p_\phi \) satisfy the conservation equation and the Eq. (13) can also be rewritten as

$$\begin{aligned} \dot{\rho _\phi }+3H(1+w_\phi )\rho _\phi =0, \end{aligned}$$
(19)

where the equation of state (EoS) for the scalar field can be defined as \(w_\phi \equiv p_\phi /\rho _\phi \), and the effective EoS can also be defined as

$$\begin{aligned} w_\text {eff}\equiv -1-\frac{2{\dot{H}}}{3H^2}. \end{aligned}$$
(20)

3 Dynamical system approach

To understand the cosmological dynamics of this system, we apply the dynamical system approach studied in [87,88,89,90,91]. First, we define the dimensionless variables in order to conveniently investigate the dimensionless dynamical equations. Then, we find the fixed points of the autonomous system equations and analyze the stability. From that, we work further on the time evolution of cosmological parameters. We can rewrite (11) as

$$\begin{aligned} 1=&\frac{\kappa ^2 \rho _\text {m}}{3H^2}+\frac{\kappa ^2 \rho _\text {r}}{3H^2}+\frac{\kappa ^2{\dot{\phi }}^2}{6H^2}+\frac{\kappa ^2 V}{3H^2}+\frac{ 4\alpha \kappa ^2{\dot{\xi }}H}{\xi }+\alpha \kappa ^2 H^2, \end{aligned}$$
(21)

and define the dimensionless variables as

$$\begin{aligned} x=&\frac{\kappa {\dot{\phi }}}{\sqrt{6}H}, ~~y=\frac{\kappa \sqrt{V}}{\sqrt{3}H},~~\alpha _{\text {GB}}=\sqrt{\alpha }\kappa H ,\nonumber \\ \mu =&-\frac{\sqrt{6}\xi _\phi }{\kappa \xi },~~\lambda =-\frac{V_\phi }{\sqrt{6} \kappa V},~~\epsilon =-\frac{{\dot{H}}}{H^2}. \end{aligned}$$
(22)

From (22), the Friedmann equation (11) can be written as

$$\begin{aligned} 1&=\varOmega _\text {m}+\varOmega _\text {r}+\varOmega _\phi , \end{aligned}$$
(23)
$$\begin{aligned} \varOmega _\text {m}&= \frac{\kappa ^2 \rho _\text {m}}{3H^2}, \end{aligned}$$
(24)
$$\begin{aligned} \varOmega _\text {r}&= \frac{\kappa ^2 \rho _\text {r}}{3H^2}, \end{aligned}$$
(25)
$$\begin{aligned} \varOmega _\phi&=x^2+y^2+\alpha _{\text {GB}}^2-4x \alpha _{\text {GB}}^2 \mu . \end{aligned}$$
(26)

We also introduce the variable \(N=\text {ln}a\) and \(dN=Hdt\) so that by taking the derivative of these with respect to N, we derive the following system of equations

$$\begin{aligned} \frac{dx}{dN}&=\frac{\kappa \ddot{\phi }}{\sqrt{6}H^2}-\frac{\kappa {\dot{\phi }}{\dot{H}}}{\sqrt{6}H^3}=x(\epsilon -\delta ), \end{aligned}$$
(27)
$$\begin{aligned} \frac{dy}{dN}&=\frac{\kappa V_\phi {\dot{\phi }}}{2\sqrt{3}\sqrt{V}H^2}-\frac{\kappa \sqrt{V}{\dot{H}}}{\sqrt{3}H^3}=y (\epsilon -3x\lambda ), \end{aligned}$$
(28)
$$\begin{aligned} \frac{d\alpha _{\text {GB}}}{dN}&=\frac{\sqrt{\alpha } \kappa {\dot{H}}}{H}=-\alpha _{\text {GB}}\epsilon , \end{aligned}$$
(29)
$$\begin{aligned} \frac{d\varOmega _\text {r}}{dN}&=-\frac{2\kappa ^2 \rho _\text {r}{\dot{H}}}{3H^4}+\frac{\kappa ^2 {\dot{\rho }}_\text {r}}{3H^3}=-4\varOmega _\text {r}+2\varOmega _\text {r}\epsilon , \end{aligned}$$
(30)
$$\begin{aligned} \frac{d\mu }{dN}&=\frac{\sqrt{6}\xi _\phi ^2 {\dot{\phi }}}{\kappa \xi ^2 H}-\frac{\sqrt{6}\xi _{\phi \phi }{\dot{\phi }}}{\kappa \xi H}=x\mu ^2(1-\varDelta ), \end{aligned}$$
(31)
$$\begin{aligned} \frac{d\lambda }{dN}&=\frac{V_\phi ^2 {\dot{\phi }}}{\sqrt{6}\kappa V^2 H}-\frac{V_{\phi \phi }{\dot{\phi }}}{\sqrt{6}\kappa V H}=6x \lambda ^2(1-\varGamma ), \end{aligned}$$
(32)

where

$$\begin{aligned} \varGamma \equiv&\frac{V_{\phi \phi }V}{V_\phi ^2}, \quad \varDelta \equiv \frac{\xi _{\phi \phi }\xi }{\xi _\phi ^2},\nonumber \\ \delta \equiv&-\frac{\ddot{\phi }}{{\dot{\phi }}H}=3-\frac{3y^2 \lambda }{x}-\frac{2\alpha _{\text {GB}}^2 \mu }{x}+\frac{2\alpha _{\text {GB}}^2\mu \epsilon }{x}. \end{aligned}$$
(33)

The autonomous system equations can also be written as

$$\begin{aligned} \frac{dx}{dN}&=-3x+3y^2\lambda +2\alpha _{\text {GB}}^2 \mu -2\alpha _{\text {GB}}^2\mu \epsilon +x\epsilon , \end{aligned}$$
(34)
$$\begin{aligned} \frac{dy}{dN}&=-3x y \lambda +y \epsilon , \end{aligned}$$
(35)
$$\begin{aligned} \frac{d\alpha _{\text {GB}}}{dN}&=-\alpha _{\text {GB}}\epsilon , \end{aligned}$$
(36)
$$\begin{aligned} \frac{d\varOmega _\text {r}}{dN}&=-4\varOmega _\text {r}+2\varOmega _\text {r}\epsilon , \end{aligned}$$
(37)
$$\begin{aligned} \frac{d\mu }{dN}&=x\mu ^2(1-\varDelta ), \end{aligned}$$
(38)
$$\begin{aligned} \frac{d\lambda }{dN}&=6x \lambda ^2(1-\varGamma )\,, \end{aligned}$$
(39)

where it is worth noting that these equations are invariant under \(y\rightarrow -y\). From second Friedmann’s equation (12), we derive

$$\begin{aligned} \epsilon \equiv&-\frac{{\dot{H}}}{H^2}=\frac{1}{2+4\alpha _{\text {GB}}^2(-1+2x\mu +2\alpha _{\text {GB}}^2 \mu ^2)}\Biggl [3-3\alpha _{\text {GB}}^2\nonumber \\&-4x \alpha _{\text {GB}}^2 \mu +8\alpha _{\text {GB}}^4 \mu ^2+3y^2(-1+4\lambda \alpha _{\text {GB}}^2 \mu )+3x^2\nonumber \\&+4x^2 \alpha _{\text {GB}}^2 \mu ^2 (1-\varDelta )+\varOmega _\text {r} \Biggr ]. \end{aligned}$$
(40)

Eq. (40) diverges for

$$\begin{aligned} x\equiv x_\text {div}=\frac{-1+2\alpha _\text {GB}^2-4\alpha _\text {GB}^4\mu ^2}{4\alpha _\text {GB}^2\mu }\,, \end{aligned}$$
(41)

which is unphysical. To avoid from this unphysical divergence the denominator must not be zero, i.e., \(x\ne x_\text {div}\). From Eqs. (17), (18) and (20), we derive the EoS parameters for both the scalar field and the effective as

$$\begin{aligned} w_\phi&=\Biggl \{\left( -3y^2+12y^2 \alpha _{\text {GB}}^2 \lambda \mu \right) +x^2\Bigl [3+4 \alpha _{\text {GB}}^2 \mu ^2(1-\varDelta )\Bigr ] -4x \alpha _{\text {GB}}^2 \mu (4+\varOmega _\text {r})+\alpha _{\text {GB}}^2\Bigl [3+2\varOmega _\text {r}-4\alpha _{\text {GB}}^2 \mu ^2(1+\varOmega _\text {r}) \Bigr ] \Biggr \}\nonumber \\&\quad \times \frac{1}{3(x^2+y^2+\alpha _{\text {GB}}^2-4x \alpha _{\text {GB}}^2\mu )(1+4\alpha _{\text {GB}}^4\mu ^2-2\alpha _{\text {GB}}^2+4x \alpha _{\text {GB}}^2\mu )}, \end{aligned}$$
(42)
$$\begin{aligned} w_\text {eff}&\equiv -1-\frac{2{\dot{H}}}{3H^2}=-1+\frac{2\epsilon }{3}. \end{aligned}$$
(43)

4 The stability of fixed points and numerical results

In this section, we investigate the stability of the autonomo- us system described by Eqs. (34)–(39) for the potential \(V(\phi )\) and the coupling function \(\xi (\phi )\) are given as

$$\begin{aligned} V(\phi )=V_0 e^{-\sqrt{6}\kappa \lambda \phi },~~~\text {and}~~~\xi (\phi )=\xi _0 e^{-\kappa \mu \phi /\sqrt{6}}, \end{aligned}$$
(44)

where \(\lambda \) and \(\mu \) are arbitrary constants. It is straightforward to show that \(\varDelta =1\) and \(\varGamma =1\) by substituting Eq. (44) into Eq. (33). Thus, the autonomous system equations Eqs. (34)–(37) are sufficient for further study. We first obtain fixed points and, then, check the stability of the system at those fixed points through the linear stability theory, which is based on analyzing the eigenvalues of the Jacobian matrix for the autonomous system equations. In particular, a sign of the real part of the eigenvalues of the Jacobian matrix plays an important role in determining the system’s stability. If the real parts of all the eigenvalues are negative, it implies that the fixed point is stable or attractors. In contrast, the real parts of all the eigenvalues with a positive sign indicate that the fixed point is unstable or repellers. The fixed point is identified as a saddle point if some of the eigenvalues are negative while others are positive.

We list all fixed points of our system in Table 1 and present their eigenvalues, as well as stability analyses of each fixed point, in Table 2. In Table 1, all the fixed points are arranged into two groups: (i.) the GR fixed points, including from \(A^{\pm }_{1}\) to \(A^{\pm }_{6}\), where \(\alpha _\text {GB}=0\) and (ii.) the GB fixed points, from \(A^{\pm }_{7}\) to \(A^{\pm }_{10}\), where \(\alpha _\text {GB}\ne 0\). Since the stability of the GR fixed points is well investigated in the literature [88, 91], we focus on understanding the stability of the GB fixed points in this work. In Fig. 1, we plot the phase portraits of the autonomous system in the “xy” plane. We only present the positive “y”-axis because the background equations are symmetric under the change of \(y\rightarrow -y\). These symmetric properties of the EoM imply that the \(A_7^\pm \) and \(A_8^\pm \) fixed points in Table 1 are basically the same points.

Table 1 The fixed points and cosmological parameters of the system Eqs. (34)–(37) with \(\varDelta =1\) and \(\varGamma =1\)
Table 2 The eigenvalues and the stability analyses of fixed points the system Eqs. (34)–(37)
Fig. 1
figure 1

Phase space portraits of the autonomous system on a x vs. y plane. The acceleration of the universe is possible within the gray-shaded region. The green and red lines are particular attractor trajectories toward the fixed points \(A_{7,8}^\pm \), \(A_{9}^\pm \), and \(A_{10}^\pm \) when their stability conditions are satisfied. The dashed lines at \(x=x_\text {div}\) indicate the divergence of dynamical equations, see Eq. (41)

Table 2 shows that the system is stable at the \(A^{\pm }_{7,8}\) fixed points if the following conditions are satisfied:

$$\begin{aligned} \text {con}_1&= \left\{ \begin{array}{@{}lr@{}} 0< \mu \le \frac{3\lambda ^2}{-8\lambda ^3+2\sqrt{16\lambda ^6 + 17\lambda ^4+\lambda ^2}} &{} \text {for } \lambda< 0\,\\ \frac{-3\lambda ^2}{8\lambda ^3+2\sqrt{16\lambda ^6+17\lambda ^4+\lambda ^2}} \le \mu <0 &{} \text {for } \lambda > 0 \end{array}\right. \,, \end{aligned}$$
(45)

and also at the \(A_{9}^\pm \) and \(A_{10}^\pm \) fixed points if the following conditions are satisfied:

$$\begin{aligned} \text {con}_2&= \left\{ \begin{array}{@{}lr@{}} -\frac{3}{4\sqrt{5}} \le \mu< 0\, &{} \text {for } \lambda< 0\\ 0 < \mu \le \frac{3}{4\sqrt{5}}\, &{} \text {for } \lambda >0 \end{array}\right. \,. \end{aligned}$$
(46)

For obtaining Eq. (45), we take the existence conditions of the \(A^{\pm }_{7,8}\) points into account, which implies the \(\mu \) and \(\lambda \) parameters should have the opposite signs, see the existence column of \(A^\pm _{7,8}\) in Table 1. The stability conditions in Eqs. (45) and (46) put constraints on the \(\{\lambda ,\mu \}\) values. For example, from Eq. (45), one can calculate that the largest (smallest) value for \(\mu \) is \(\mu _\text {max}\simeq 0.2271\) (\(\mu _\text {min}\simeq -0.2271\)) when \(\lambda \simeq -0.3357\) (\(\lambda \simeq 0.3357\)). In both the small and the large \(|\lambda |\) limit, the range of \(\mu \) shrinks and eventually approaches to zero from both the negative and the positive sides. On the other hand, from Eq. (46), we see that the range of \(\mu \) is determined depending on the sign of \(\lambda \), but not on the amplitude. By taking these constraints on the numerical values of \(\{\lambda , \mu \}\) into account, we plot the phase portraits of our dynamical system in Fig. 1.

The blue points in the fig indicate the GB fixed points; namely the \(A_{7,8}^\pm \), \(A_{9}^\pm \), and \(A_{10}^\pm \) fixed points, and the numerical values of \(\{\lambda , \mu \}\) are given such a way that most trajectories, including the red and green ones, are attracted to these stable points. The gray shaded regions represent the region where the EoS parameter \(\omega _\text {eff}=\omega _\phi <-1/3\) such that the accelerated expansion of the universe is possible. The dashed lines show the divergence lines given in Eq. (41).

The right column of Fig. 2 shows the time evolution of \(\varOmega _{i}(z) (i=r, m, \phi )\) and the EoS parameter of the scalar field \(\omega _\phi (z)\), as well as the effective EoS of the system \(\omega _\text {eff}(z)\), while the left one shows the time evolution of the autonomous variables, \(\{x(z),y(z),\alpha _\text {GB}(z)\}\). In the fig, from top to down, the numerical value of \(\lambda \) changes as \(\lambda =0.1, 0.3\), and 0.6 for the \(\mu =0.3\). If we change the \(\mu \) value within the range given in Eqs. (45) and (46) for each given \(\lambda \), there is no noticeable change occurs because the \(\mu \) value is too small to make significant contributions. In other words, we find that the cosmic phase transitions, as well as the time evolution of the autonomous variables, are more sensitive to the \(\lambda \) value than the \(\mu \) value as long as the stability conditions of the GB fixed points are concerned.

The initial conditions of the autonomous variables are given in such a way that the universe experiences the right \(\varOmega _\text {r} \rightarrow \varOmega _\text {m} \rightarrow \varOmega _{\phi }\) phase transitions. Thus, the effective EoS parameter starts evolving from \(\omega _{\text {eff}} = 1/3\) to some value \(\omega _{\text {eff}} < -1/3\), for allowing the late-time universe to experience the accelerated expansion. To replicate the viable cosmic history, the time evolution of \(\{x,y,\alpha _{\text {GB}}\}\) must depend on fine-tuned initial conditions: \(y> \alpha _{\text {GB}} > x\) in our case.

Fig. 2
figure 2

Left: The red-shift evolution of the \(\varOmega _i(z)\), where \(i=r, m, \phi \), the EoS parameter \(\omega _\phi \), and the effective EoS of the system \(\omega _\text {eff}\). Right: The red-shift evolution of the xy, \(\alpha _\text {GB}\). In both columns, the \(\lambda \) value increases from top to bottom; \(\lambda =0.1, 0.3,\) and 0.6, respectively

We show that at the onset of the radiation-dominated phase, the contribution of the GB term must be the second largest after the potential energy contribution of the scalar field, and its time evolution \(\alpha _{\text {GB}}(z)\) experiences a continuous decrease over time. As a result, the present-day value of \(\alpha _\text {GB}(z=0)\) is negligible, and so are the effects of the GB term. On contrary, the initial value of x, or the kinetic energy contribution of the scalar field, starts off as the smallest in the radiation-dominated phase, but its time evolution experiences a drastic increment during the matter-dominated phase after a short decrease towards the end of radiation dominated era, and it eventually catches up with the potential energy contributions, the y(z), in the present universe. Thus, from Fig. 2, it is explicit that the potential energy contribution of the scalar field plays the most dominant role throughout the cosmic history of the universe, and its present-day value is also the largest among the others. For the given \(\mu \), Fig. 2 also shows that the present-day value of the EoS parameter increases as the \(\lambda \) value increases, and it eventually surpasses “\(-1/3\)”, ending the scalar field-dominated phase. In our case, the universe experiences the late-time acceleration, driven by the scalar field coupled to the GB term, if \(\lambda <0.746\).

To put a further constraint on the potential parameter \(\lambda \) in light of the observational bounds from CMB, BAO, SnIa, and \(H_0\) data [92], we plot in the red-shift evolution of the EoS \(\omega _{\phi }(z)\) in Fig. 3. In the fig, the parameter space for \(\lambda \) is represented by the different colors and we adopted the Chevallier-Polarski-Linders (CPL) parameterization of the EoS that reads [34],

$$\begin{aligned} \omega (z) = \omega _{0} + \frac{z}{1+z}\omega _a. \end{aligned}$$
(47)

The result confirms our observation of Fig. 2 that the smaller values of \(\lambda \) are more preferred. For instance, the preferred parameter space for \(\lambda \) is \(\lambda \lesssim 0.3166\) to be consistent with the observational data at the \(1\sigma \) level at present. The range is tighter being \(\lambda \lesssim 0.1\) to be consistent with the data for red-shift up to \(z=1\). Thus, now we can provide tighter constraints on the parameters of our model given in Eq. (44). In order for the universe to be stable at the GB fixed points and experience the late-time accelerated expansion, the parameters \(\{\lambda ,\mu \}\) of our model must be within the following range:

$$\begin{aligned}&\text {For } A^\pm _{7,8}: -0.2268\lesssim \mu<0 ~ \text {when} ~ 0 < \lambda \le 0.3166\,, \end{aligned}$$
(48)
$$\begin{aligned}&\text {For } A^\pm _{9,10}: 0<\mu \lesssim \frac{3}{4\sqrt{5}} \quad \text {when} \quad 0 < \lambda \le 0.3166\,. \end{aligned}$$
(49)
Fig. 3
figure 3

The red-shift evolution of the \(\omega _\phi \) for different values of \(\lambda \). The background dark-gray and light-gray shaded regions represent the observational bounds from the CMB, BAO, SnIa, and \(H_0\) data using the CPL parameterization [92]. The colored regions show the different parameter spaces of \(\lambda \)

5 Conclusions

In this work, we have extended regularized 4D EGB gravity by introducing the non-minimal coupling function and the regularization scheme introduced in [66]. Along this consideration, a redefinition \(\xi (\phi ) \rightarrow \xi ^{(D-4)}(\phi )\) is required so that EoM is well-defined. In the spatially flat space-time dimensions of FRW metric, we can write the EoM in arbitrary D-dimensions and then take the \(D\rightarrow 4\) limit. As a solution, we derived the extended version of EoM obtained in [66] for non-trivial \(\xi (\phi )\), which is often associated with the cubic term in Hubble parameter and could be interesting in a further study of the cosmic evolution and the observational data constraint.

To explore the cosmological dynamics from this extension, we applied the dynamical system approach and analyzed the stability of critical fixed points for given exponential forms of the potential and the coupling function of the scalar field in Eq. (44). We obtained ten fixed points, of which \(A^\pm _1\) to \(A^\pm _{6}\) are called the GR fixed points and \(A^\pm _7\) to \(A^\pm _{10}\) are called the GB fixed points because their existence is due to the presence of non-minimal coupling function \(\xi (\phi )\rightarrow \xi ^{(D-4)}(\phi )\) and rescaling of the coupling constant \(\alpha \rightarrow \alpha /(D-4)\), and they exist and stable under specific conditions listed in Tables 1 and 2. The GB fixed points correspond to the de-Sitter solution with the EoS parameter \(\omega _{\text {eff}}=-1=\omega _\phi \) that admits the late-time accelerating universe under the conditions in Eqs. (45) and (46). The phase space plots in Fig. 1 confirm the stable and accelerating solutions.

We also present the cosmic history of the universe, \(\varOmega _\text {r} \rightarrow \varOmega _\text {m} \rightarrow \varOmega _{\phi }\), in Fig. 2 along with the time evolution of dynamical variables; x, y, and \(\alpha _\text {GB}\), associated with the kinetic and potential energy contribution of the scalar field and the GB contribution, respectively. Both kinetic and potential energies of the scalar field play the most important role in the present day, particularly the potential energy, while the effect of the GB term is appreciated at the beginning of the radiation-dominated epoch. However, the GB contribution decreases in time, and, eventually, it does not play many roles in the present universe.

The time evolution of the EoS parameter for different values of \(\lambda \), the potential parameter, is presented in Fig. 3 together with the upper bounds from the observational data. The effective EoS starts evolving from \(\omega _{\text {eff}}=1/3\) to some value \(\omega _{\text {eff}}<-1/3\), which indicates the late-time universe experiences accelerated expansion. If \(\lambda <0.746\), our model explains the late-time accelerated expansion of the universe driven by the scalar field coupled to the GB term and the EoS satisfies the observational constraint by CMB, BAO, SnIa, and \(H_0\) data if \(\lambda \lesssim 0.1\) at \(1\sigma \) C.L. In conclusion, our model suggests that the universe can be stable at the GB fixed points and experiences the late-time accelerated expansion when the values of the model parameters \(\{\lambda ,\mu \}\) are in the range given in Eqs. (48) and (49).

From the above discussion, that there is no missing cosmic history of the universe and the cosmological parameters are constrained by the observational data, we conclude that the contribution of GB term is evident, especially in the early radiation-dominated era. To reconstruct more reliable self-consistent cosmic history, the current study can be extended by the considerations of the cosmographic approach, a model-independent approach to constrain cosmological evolution by observational data [93]. The authors of Ref. [94] studied the role of the higher curvature terms in \(F(R, {\mathcal {G}})\) theory adopting a cosmographic approach and they showed that the theory addresses inflation, matter-dominated, and dark energy regimes. Thus, it is imperative for us to extend the current study in that direction and compare our findings with that of Ref. [94]. The generic functions of \(F(R,{\mathcal {G}})\) and their behavior are investigated in the context of cosmic inflation in Ref. [95], where the presence of the quartic, but not the cubic, term in H is obvious. On the other hand, due to regularization of 4D EGB gravity with the non-minimal coupling, we have both the cubic and quartic terms of H in the dynamical equations. Therefore, it is important to investigate how these additional terms behave and how important their roles are during inflation. We leave these works as the future extension of our study.