Slow-roll versus stochastic slow-roll inflation

We consider the classical wave equation with a thermal and Starobinsky-Vilenkin noise which in a slow-roll and long wave approximation describes the quantum fluctuations of the graviton-inflaton system in an expanding metric. We investigate the resulting consistent stochastic Einstein-Klein-Gordon system in the slow-roll regime. We show in some models that the slow-roll requirements (of the negligence of $\partial_{t}^{2}\phi$) can be satisfied in the probabilistic sense for the stochastic system with quantum and thermal noise for arbitrarily large time and an infinite range of fields. We calculate expectation values of some inflationary variables taking into account quantum and thermal noise. We show that the mean acceleration $\langle \partial_{t}^{2}a\rangle$ can be negative or positive (depending on the model) when the random fields take values beyond the classical range of inflation.


I. INTRODUCTION
In the standard classical approach to inflation the slowroll approximation is very useful. Fortunately, it applies just in the range of field configuration where it is needed,i.e., during the time of the accelerated expansion. However, in the description of the early stages of the universe evolution quantum and thermal fluctuations are unavoidable. With the fluctuations the usual criteria of the slow-roll strictly speaking do not apply. In fact such fluctuations can lead to an eternal inflation, i.e. the inflation never ends as suggested first by Linde [1]. We are going to investigate the quantum and thermal fluctuations quantitatively on the basis of differential equations which are supposed to describe the exact time evolution at least at the early stages. Our approach is based on the Starobinsky approach [2] to quantum fluctuations and the description of thermal fluctuations known from the theory of Brownian motion [3] and applied to inflation in [4][5] [6][7] [8]. Starobinsky [2] suggested an approach which treats quantum scalar field non-perturbatively in classical Einstein equations. The idea is based on an earlier observation [9][10] [11] [12]that the quantum scalar field in an expanding universe behaves as a classical diffusion process. In such a case we obtain a stochastic Einstein-Klein-Gordon (EKG)system. In the slow-roll limit the stochastic EKG system is approximated by a first order differential equation of a diffusion process. The approximation applies well for deterministic systems in the range of slow-roll. If we restrict the range of evolution of φ in the stochastic equation in order to cut it to the classical range of inflation then we must introduce boundary conditions as is done in [13] [14]. However, the stochastic equation makes sense in an unbounded field configuration space till a random explosion time. If we calculate this conditional probability distribution then it satisfies the usual Fokker-Planck equation. We prefer the approach based on an unbounded field evolution. On the * Electronic address: zbigniew.haba@uwr.edu.pl basis of the Fokker-Planck equation we study the problem of probabilistic estimates of the error of the slow-roll approximation. We hope that as in the theory of the Brownian motion of a particle in the medium with a friction the first order equation well approximates the second order stochastic non-linear oscillator equation [3].
The plan of the paper is the following. In sec.2 we recall the basic equations of the inflaton model. We describe the standard slow-roll approximation in sec.3. The diffusion process corresponding to slow-roll approximation is discussed in sec.4. In sec.5 we describe some models of the inflaton potential and calculate the scale factor as a function of the field. In sec.6 the slow-roll approximation is discussed on the basis of the probability distribution of the inflaton and its time derivatives. The aim is to set a framework which allows to estimate corrections to the slow-roll. In sec.7 we review standard results of the theory of diffusion processes in order to explain what happens with solutions of the inflaton models. In sec.8 we calculate the stationary probability distribution of the inflaton diffusion process. In the main sec.9 of this paper we calculate some large time expectation values using the stationary probability distribution (this section can be considered as an application of the methods and results of [15]). In the Appendix we explain the minor changes which come out from a change of time (from cosmic time to the e-fold time).

II. INFLATON WAVE EQUATION
In the standard approach to inflation [16] we consider a flat expanding background metric Accelerated expansion is generated by the scalar field satisfying a non-linear wave equation (where H = a −1 ∂ t a) The expansion scale a is determined by the Friedman equation We are going to neglect ∂ 2 t φ in eq.(1). Hence, we require |∂ 2 t φ| << |3H∂ t φ|. This condition is satisfied if are small. We calculate (differentiating eq.(2) with the neglect of ∂ 2 t φ). We have an acceleration ifǫ < 1.

III. STOCHASTIC EINSTEIN-KLEIN-GORDON SYSTEM
We consider a modified version of eq.(1) (6) Eq.(6) is to describe the inflaton in the long wave limit and includes a noise η resulting from quantum fluctuations of refs. [2][9]- [12] as well as from the random interaction with the environment at the temperature β −1 introduced in [17] [18] ( β has been omitted in [18]). βγ 2 is the friction coming from the environment ( in [17] βγ 2 is denoted as γ 2 ). In [17] eq.(6) is derived under different assumptions (especially in Appendix B of ref. [17]) than in [18]. With our assumptions concerning the masses and couplings of the environmental fields [18] we obtain eq.(6) in the long wave limit (the short wave limit of the environmental noise in an expanding universe will be discussed in [19]). With both random fluctuations the noise η on the rhs of eq.(6) takes the form where the first term is the thermal noise. The second term describes the diffusive behaviour of the high frequency part of the inflaton in an expanding universe. The factor a − 3 2 in the thermal noise comes from the metric weight det |g µν | is chosen in order to reproduce the correlation functions of the quantum scalar field in an expanding universe [20]. We express the thermal noise by the Brownian motion B. This is a continuous Gaussian process whose derivative has the covariance ∂ t W (in eq. (7)) is an independent Gaussian stochastic process with the same covariance (8).
With the thermal noise we would violate the conservation law for the scalar energy-momentum T µν (φ). If (T 0ν (φ)) ;ν = Q then we introduce a compensating dark energy density ρ d such that ∂ t ρ d + 3H(w + 1)ρ d = −Q with w = −1 (then ρ d = − dtQ see [15] for more details). Then, eq.(2) still remains true in a differential form. In such a case we obtain a closed random dynamical system (in the first order form) with the Starobinsky-Vilenkin noise W and the environmental noise B [15] dφ = Πdt, with eq.(11) replacing eq.(2). We interprete the stochastic equations in the Stratonovitch sense and use the •notation for Stratonovitch differentials following ref. [21]. From eq.(12) Hds.

IV. DIFFUSION EQUATION FOR THE SLOW-ROLL INFLATION
The program outlined at the end of sec.3 to solve the stochastic Einstein-Klein-Gordon (EKG) equations for the (a, H, φ, Π) variables and calculate the probability distribution is difficult to perform in a non-perturbative way. We shall rely on approximations. On the preliminary stage we neglect the spatial derivatives in eq.(1). We omit the noise in eq.(10) and the βγ 2 terms. Then, it follows from eqs.(9)-(12) that and Using, eqs.(9)- (12) we can obtain the Fokker-Planck equation for the probability distribution of (a, φ, Π). On a formal level we make the next simplifying assumption dΠ ≃ 0 and γ ≃ 0 in eqs.(9)- (12). We justify this approximation (if H is large) in sec.5 on the level of probability distributions . Then, the system of eqs.(9)-(12) is reduced to with explicit functions H(φ) and a(φ). The approximation of the stochastic non-linear wave equation (6) by a diffusion equation has been extensively discussed in the theory of Brownian motion [3]. The main arguments for this approximation will be discussed in sec.5. Eq. (16) in the Stratonovich interpretation of the stochastic equations [21] leads to the equation (retrospective Kolmogorov equation) for the transition function P (t, φ; s, φ ′ ) [22] and to the adjoint (prospective Kolmogorov or Fokker-Planck) equation for the probability distribution The dependence of a on φ is determined in the slowroll approximation by eq.(15). Let us consider some examples of potentials appearing in inflation models [23] [24][25] [26]. For a chaotic inflation [1] we have The potential for the " natural inflation" [26] describing the axion inflation can be defined as From eq.(15) we obtain Here, −π ≤ λφ ≤ π.
In subsequent sections we also consider the double-well in the form (where g n is a dimensional coupling constant) then

VI. SLOW-ROLL APPROXIMATION FOR THE PROBABILITY DISTRIBUTION
The approximation of eq.(6) by eq. (16) can be expressed as an omission of ∂ 2 t φ. For a deterministic system this approximation can be controlled by a solution of the slow-roll equation. In a stochastic system solely estimates of probabilities make sense. We must estimate the probability that ∂ 2 t φ is small.In the system of differential equations (9)-(12) a is a random variable. In principle, we could write down a partial differential equation for the probability distribution P of (a, φ, Π) and subsequently integrating it over a and Π we could reduce it to the probability distribution of φ (this is the probability of finding φ no matter what are the values of a and Π). This is however technically difficult to achieve. We follow the approximations of secs.4-5. We assume that H (14) and a (15) are explicit functions of φ and Π. The transition function P ret t (φ, Π; φ ′ , Π ′ ) of the process (9)-(10) (neglecting the βγ 2 terms, i.e., assuming βγ 2 << 3H) satisfies the equation (retrospective Kolmogorov equation) In eq.(28)we make a change of variables (φ, Π) → (X, Y ) where In new coordinates the transition function (28) reads The change of coordinates in the Fokker-Planck equation (29) is We wish to get rid off the dependence of P on Y altogether. We impose the slow-roll requirement on the probability distribution P assuming that the dependence (14) of H on Π is negligible and we neglect ∂ φ 1 H in eqs.(32)-(33) (the assumption that H is slowly varying). In eqs.(28)-(29) the order of derivatives over Π and multiplicative factors is not relevant when the dependence of H and a on Π is neglected. However, after a change of variables the multiplicative factors become dependent on X and Y . When we subsequently perform a limit of large H (slow-roll) then the order of factors becomes significant. So, the approximation has to be performed in a consistent way. In these equations we approxi- . We integrate the transition function over Y ,i.e., dY P ret (s, X, Y ; t, X ′ , Y ′ ) ≡ P ret (s, X; t, X ′ , Y ′ ). Then, the limit of slowly varying H and small Y H for the integrated (over Y ) transition function is The probability distribution of X iŝ P t = dY P (s, X ′ , Y ′ ; t, X, Y ). It follows that the integral over Y of the Fokker-Planck equation (33) gives This equation is different from the Fokker-Planck equation (18) which we get from the stochastic equation (16). The difference concerns the terms ∂ φ 1 3H which must be neglected in a consistent way. An alternative procedure is to defineP = a −3 P ret insert it in eq.(34) (for the integrated transition function) and take the adjoint of this equation. As a result we obtain which coincides with eq. (18).
In this way we have achieved the slow-roll approximation of the stochastic system (9)-(12) on the basis of probability distributions. The approximation could be controlled by estimating the neglected terms of the exact probability distributions (28)- (29).

VII. APPLICATION OF SOME GENERAL RESULTS ON DIFFUSIONS
We consider a diffusion equation of the form where σdB is Ito differential [21] and In general, solutions of eq.(37) exist till the random explosion time τ . Nevertheless, probability distributions of sec.6 (satisfying the Kolmogorov equations) are well defined for arbitrary time as conditional probabilities P t (A) ≡ P (ξ t ∈ A|t < τ (ξ)). There is a useful criterion [27] when the stochastic process ξ can be defined for arbitrarily large time. Define a Lyapunov function L(x) as a twice differentiable positive function increasing to +∞ when |x| → ∞ and satisfying the inequality where α and r are positive constants and A is the differential operator on the rhs of the retrospective Kolmogorov equation. The basic theorem of diffusion processes states [27] that if for the given diffusion process (defined by A) there exists a Lyapunov function then the process can be defined for arbitrarily large time.
Let us consider as a simple example σ = const. Take L = x 2 , then for the process (37) If 2βx ≥ αx 2 − r with r ≥ 0 then the inequality (38) is satisfied. It holds true if β = V ′ with V = x 2n and fails for V = x 2n−1 (natural n).
Next, we can calculate the asymptotic probability distribution. Ifβ is a continuous function, σ is continuously differentiable and σ 2 > 0 then the Fokker-Planck equation has a unique solution. If f * = 1 where with a certain finite K > 0 then for any bounded normalized f ≥ 0 there exists the unique limit f * when t → ∞ of the Markov semigroup P t f [27] [28]. This f * is called the stationary probability distribution . In our case and β = 1 3H V ′ . In most models of inflation if γ 2 > 0 (the thermal noise is non-zero) then σ 2 > 0. If there is no thermal noise then σ ≃ 0 if H 2 ≃ V ≃ 0 what happens in the examples of sec.5. Hence, without the thermal noise there may be difficulties with the limit t → ∞.

VIII. STATIONARY PROBABILITY DISTRIBUTION OF THE INFLATON
The stationary probability P ∞ (φ) is the limit of P t for t → ∞ [28]. In the Stratonovitch interpretation it can be obtained from the requirement ∂ t P ∞ = 0 which gives (after an integration over φ) The stationary solution of eq.(41) without the Starobinsky-Vilenkin noise is (from eq.(39)) where the exponential factors in eq.(42) come from the formula for a 3 (eq.(15)). For a large |φ| we have a(φ) → 0 in most of our models of sec.5. Hence, we can neglect the γ −2 term. Then, If γ = 0 (the thermal noise is absent) then we obtain the Starobinsky solution (discussed also by Vilenkin [12] and Linde [29]) The solution (44) is not normalizable if V ≥ 0 and V = 0 at a certain φ or V does not decay fast enough for large φ.
The authors [13] [14] impose boundary conditions excluding the regions where P ∞ (44) is not integrable. Then, one has to study whether the dependence on boundary conditions has some consequences on calculated expectation values. With γ = 0 in eq.(41) we writẽ Then, the equation forP is .
Using the formulas for H and for a (eq.(15)) we obtain lnP = −6 dφHa 3 (γ 2 + 9 If V ′ ≥ 0 and 1 + 10 3 G 2 V − 32πG 3 V 3 (V ′ ) −2 ≥ 0 theñ P improves integrability and we can use the saddle point method for calculations. If lnP ≥ γ −2 K with a certain constant K then for any f we have | f P ∞ | ≤ exp(γ −2 K) |f |Ha − 3 2 . This estimate can be sufficient for integrability. In general, we have to find a φ-dependent upper bound on lnP in order to prove integrability.
For most potentials of sec.5 a → 0 for |φ| → ∞ then a 3 H 5 → 0. Hence, we get from eqs.(45)-(46) P ∞ ≃ Ha 3 2 at large γ coinciding with the formula (43). As an explicit example we consider the chaotic inflation potential V = gφ 2n . The integrand lnP in eq.(46) is a bounded function of φ because a ≃ exp(−2πGn −1 φ 2 ).Then, the formula (45) gives for a large |φ| (small a) At small φ we have a 3 H 5 → 0 . So, the formula (43) is applicable for small as well as large φ. The Starobinsky formula (44) (obtained without the thermal noise) gives P ∞ which is not integrable at φ = 0. When a 3 H 5 → ∞ and we neglect γ 2 in eq.(46) then (48) We can calculate the rhs of eq.(48) and convince ourselves that in this case we reach the Starobinsky formula (44). In the estimates of integrals with respect to P ∞ in the next section we cannot let γ 2 → 0.

IX. PROBABILISTIC ESTIMATES OF THE SLOW-ROLL REGIME
We would like to estimate on the basis of the Fokker-Planck equation (18) the probability that |∂ 2 t φ| << |3H∂ t φ|. As a consequence of the (deterministic) equations of sec.2 we can calculate In the classical EKG equations of sec.3 the regime of smallǫ andη is closely related with the inflation regime according to eq.(5). We can study both problems in probabilistic terms by a calculation of the mean values of the acceleration and the derivatives of the inflaton (as in eq.(49)). So, according to eq.(5) (strictly speaking this criterion applies if the rhs of eq.(49) is small) The inequality aH 2 > aH 2ǫ depends on the probability distribution of φ determined by the stochastic equation (16). However, without the deterministic inflation the stochastic approximation to the quantum noise is hard to justify. One should rather consider eq.(50) as a condition for the preservation of inflation by quantum and thermal fluctuations. In order to calculate the probability distribution of the variables in eqs.(49)-(50) we would need to solve the stochastic equations or the Fokker-Planck equations. We are able to calculate only the mean values (49)-(50) at large time using the stationary probability distribution. Nevertheless, such calculations give some hints on the role of thermal and quantum fluctuations in the evolution of inflation. So, in the model V = gφ 2n (n > 1) with the thermal noise we have on the basis of the approximation(47) and η = 2(2n − 1) n − 1 So, ǫ and η are never small. The reason is that in the φ 2n models ǫ and η behave as n 2 φ −2 . The probability distribution of the stochastic process φ t gives big weight to small values of φ. For this reason the expectation values of ǫ and η cannot be small. As a consequence the approximation on which the stochastic equation (16) is based does not seem to be applicable. Nevertheless, if we still insist on applying eq.(50) then for large n (owing to the term H 2 ≃ φ 2n ) because the expectation value |φ| r is an increasing function of r . Let us consider next the double-well potential (26). The Starobinsky formula (44) does not give an integrable stationary probability because 1 V is singular at gφ 2 = µ 2 . If the quantum noise is absent then where for a large γ the last factor in eq.(53) is irrelevant. It can be seen thaat ǫ and η are infinite because of the singularity of the integral at φ 2 = µ 2 g . Nevertheless, we can calculate for large γ ∂ 2 a is positive (because x α exp(−x 2 ) is an increasing function of α). If we calculate the integral (53) at γ → 0 by means of the saddle point method then there are saddle points at φ = 0 and at φ = ± µ √ g . The saddle points give zero to the first term in eq.(50) (and the corresponding term in the integral (53)) and non-zero contribution to the second term. Hence, acceleration can be negative for a small γ. ǫ and η are finite in a model with the double-well (26)(n ≥ 4). Then, we havẽ and for a large γ For a large Gµ 2 ng we obtain ǫ ≃ n 2 g 4πGµ 2 and a similar result for η . Hence, both ǫ and η are small if γ and Gµ 2 ng are large. ǫ and η can also be small for small γ. In fact, for n > 4 these expectation values can be arbitrarily small when γ → 0 as can be seen from calculations by the saddle point method. It can also be shown that for n ≥ 4 the mean value of the acceleration is positive for large γ (this result could be treated as an argument for an eternal inflation [1] [30])and negative for small γ .
As a next example (when the Starobinsky formula (44) does not give a stationary probability) let us consider V = g exp(λφ). If only the thermal noise is present then (according to eqs.(42) and (22)) With both quantum and thermal noises we must ensure for integrability that the last term in the brackets (46) is positive. This will be the case if Hence, λ 2 > 9, 6πG (ensures the previous requirement λ 2 > 24πG). Then,ǫ = 1 16πG λ 2 > 3 2 andη > 3 so that in eq.(49) |η −ǫ| > 3 2 . The mean acceleration (50) is negative for λ 2 > 24πG (for these values of λ 2 it is also negative in the exact deterministic model (9)-(12) [31]). However, becauseǫ andη with the quantum noise are not small the application of the diffusive approximation to the quantum noise and at the next step a reduction of eq.(6) to eq.(16) cannot be justified.
In the case of the Starobinsky potential (21) [25] according to eq.(22) We obtain that lnP is bounded for negative φ. For positive φ we have lnP < K λγ 2 φ with K > 0. Hence, P ∞ is integrable for a sufficiently large λ (depending on γ). ǫ and η are infinite. ∂ 2 t a is finite and negative for large λ. We get finite ǫ and η if instead of the Starobinsky potential we take with n ≥ 4. For the natural inflation (23) the Starobinsky stationary distribution (44) does not exist because of the singularity of 1 V at λφ = π. The stationary probability distribution (45)-(46) is well-defined and integrable because a 3 H 5 is bounded. ǫ and η are infinite as a consequence of the singularity ofǫ andη at λφ = π. The acceleration of eq.(50) is (up to a positive normalization constant) where we applied the notation of eq.(46). lnP is a regular bounded function hence its contribution to the integral is negligible (at large γ). The P ∞ integral of powers of sin 2µ−1 is equal to 2 2µ−2 Γ(µ) 2 (Γ(2µ)) −1 . Hence, ∂ 2 a is negative for large λ. It can be seen from our calculations that if instead of the potential (23) we considered with n ≥ 2 then expectation values ofǫ andη would be finite as follows from the approximation (43) for the stationary probability distribution Then the singularity ofǫ andη cancels with the corresponding factor in P ∞ .

X. SUMMARY AND CONCLUSIONS
The slow-roll approximation is a useful tool in the study of deterministic as well as stochastic EKG systems.
In the deterministic case we stop using it as soon as the parameters (functions of φ)ǫ andη become large. In the stochastic version we should argue that we stop applying slow-roll for a time t such that the probability that e.g.ǫ > 1 2 andη > 1 2 becomes large. This time is difficult to estimate. As in the theory of Brownian motion [3] we suggest that with the strong "friction" H the first order equation (16) may be a reliable approximation to the second order differential equation (6). However, for a stochastic approximation of the quantum noise the requirement of smallǫ andη seems unavoidable. We distinguish a class of models where the expectation values of these inflation parameters are indeed small. We calculate expectation values ofǫ ,η and ∂ 2 t a with respect to the stationary probability which gives the probability distribution for a large time. We show that in some models the acceleration can be positive showing that quantum and thermal fluctuations do not destroy inflation even at large time. The sign of the acceleration can depend on the friction as we have shown in the double-well model.

XI. APPENDIX:E-FOLD TIME
In the calculation of the power spectrum [32] [33] in order to take into account fluctuations of the quantum gravitational field the use of the e-fold time ν defined by is crucial. The change of time does not have substantial role in the discussion in this paper (because we discuss solely the fluctuations of the φ-field) as can be seen from the basic equations expressed in the e-fold time. Eq.(16) takes the form Eq.(18) whereP is defined by the same formula (46). So, the change of time has a minor effect on the expectation values ofǫ ,η and ∂ 2 a but does not change substantially our conclusions.