Stochastic inflation with quantum and thermal noise

We add a thermal noise to Starobinsky equation of slow roll inflation. We calculate the number of e-folds of the stochastic system. The power spectrum and the spectral index are evaluated from the fluctuations of e-folds using an expansion in the quantum and thermal noise terms.


I. INTRODUCTION
The standard ΛCDM model describes the evolution of the universe in agreement with observations [1]. The fast expansion at the early stages of the evolution can be explained in terms of a scalar field (inflaton). A quantization of the scalar field and gravitational perturbations leads to fluctuations which can explain structure formation and the power spectrum of density fluctuations in the universe [2][3] [4][5] [6] [7]. The model is introducing some new (dark) forms of matter and energy which are not interacting with the inflaton. If we assume that there are some interactions of the inflaton with the unknown forms of matter then the wave equation for the inflaton is transformed into a stochastic equation which in a flat expanding metric ( with the scale factor a and H = a −1 ∂ t a) takes the form where γ 2 is a friction related to the Gaussian noise η(t)η(s) = δ(t − s) (2) according to the fluctuation-dissipation relation. Eq. (1) has been derived in [8](see also [9]). The friction γ 2 is proportional to temperature. The noise η comes from the thermal (Gibbs) distribution of the initial positions and velocities of the particles of the environment ( in general, the environment may consist of any degrees of freedom which are unobservable and averaged in a description of an interaction with φ). Eq.(1)is a basis of the warm inflation [10]. In such a model the resonant reheating is unnecessary as the temperature during inflation does not fall to zero owing to the creation of radiation as a result of the decay of the inflaton. The quantum fluctuations of the inflaton and gravitational perturbations are usually described [3][7] in a linear approximation. Starobinsky [4] [11] (see also [12]) discovered that quantum fields at large time in an expanding universe behave like a classical diffusion process. Then, the high momentum part of the * Electronic address: zhab@ift.uni.wroc.pl quantum field can be treated as an additional (quantum) noise in the inflaton wave equation. Such a treatment of quantum fluctuations during inflation goes beyond a linear approximation. The quantum noise has been widely studied in refs. [13]- [22]. The Fokker-Planck equation for the probability distribution of the inflaton has been explored in detail. In principle, the Fokker-Planck equation contains all the information about the probability distribution. In particular, the power spectrum of fluctuations could be calculated as discussed in [20][21] (see also Appendix B here). However, in [22] (following [11], see also [23][24]) an alternative method has been proposed for a calculation of the power spectrum of the quantum noise based on fluctuations of the e-folds. In this paper we extend the method to the calculation of the power spectrum of the system which contains both the quantum noise and the thermal noise. The plan of this paper is the following. In sec.2 we discuss the stochastic equation with the quantum and thermal noises in the slow roll approximation. In sec.3 following refs. [22][25] we obtain general formulas for the expectation values of e-folds and the fluctuations of e-folds (spectral function). Then, in sec.4 we discuss approximations leading to some explicit formulas for the spectral function and the spectral index.
In Appendices A and B we discuss fluctuations in soluble models and the relation between Ito and Stratonovitch stochastic equations.

II. SLOW ROLL STOCHASTIC EQUATIONS
We consider two sources of noise in eq.(1) the thermal noise η and the quantum noise η S [4][11] [12]. The quantum noise comes from the large momentum part (above the Hubble horizon) of the scalar field. It can be considered as a part of the quantum inflaton equation. The thermal noise results from an approximation of the interaction with an environment by a Markov process. In Einstein equations the environment could be represented as dark matter or dark energy if we properly choose the environmental interactions [26][27] [28]. We consider eq. (1) in the slow-roll approximation In eq.(3) we write η = ∂ t B, η S = ∂ t W and assume that W and B are independent Gaussian variables. We use the notation •dW (after [29] ) for the Stratonvitch interpretation of the stochastic differential and the conventional notation of the differential in the Ito interpretation. The difference between Ito and Stratonovitch integrals consists in a different discrete time approximations of the Riemann sums approximating the integral. The Stratonovitch integral f • dW treats time approximation of f and W (in the Riemann sum) in a symmetric way (so called middle point approximation) whereas in the Ito integral the time in dW is later than in f . For an integral with a differentiable function W the various discrete approximations would lead to the same result. However, W is not differentiable. We discuss both interpretations of the stochastic differential for an easy comparison with literature on the subject. The Ito stochastic differential equation can be expressed by the Stratonovitch equation using the rule [29] f • dW = f dW + 1 2 df dW . So, both equations differ by a correction term. The Stratonovitch form is convenient for calculations because it preserves the standard rules of differentiation (the Leibniz rule) [29]. It must be checked in mathematical models which form of the stochastic equation better describes physical processes.
In order to simplify further discussion we assume that 3H >> γ 2 and V ′ >> 3 2 γ 2 Hφ.The friction term γ 2 ∂ t φ is usually related to the decay of the inflaton into radiation [30]. The omission of the γ 2 terms on the lhs of eq.(1) means a negligible density of radiation (which can be true during inflation [31]). Now, the stochastic equation (3) reads (4) The Starobinsky [11][12] slow-roll (quantum) system corresponds to the limit γ → 0 of eq.(4). In order to obtain an agreement with the inhomogeneous inflaton and gravity perturbations (most easily treated in the uniform curvature gauge [32][33]) we must change the world time t into the e-folding time ν [20][21] [22](usually denoted by N ; we change notation for typographical reasons) describing the change of the scale factor Now, the diffusion (small roll) system reads together with the differential form of the Friedman equation ( taking a derivative in the Friedman equation can allow to treat the environment as a dark energy [26]) We can insert in eq.(4) either a(φ) as a function of φ or a = a 0 exp(ν) (in such a case we obtain a non-stationary stochastic equation).
In the slow-roll approximation we can derive from eq.(7) in the no-noise limit ( V entering eq.(6) can be determined by H from the wave equation up to an arbitrary constant). Then, from eqs.(4)-(5) in the no noise limit We could take in eq.(9) the noise into account by means of perturbation methods (the relation between a(ν) and φ(ν) will still be discussed in Appendices A and B). The probability distribution of the solution of eq.(4) (Stratonovitch interpretation) satisfies the Fokker-Planck equation [29][25] [34] In the Ito interpretation of eq.(4) If in the e-folding time we treat a as depending on φ (not on ν), then we obtain a stationary form of the Fokker-Planck equation which for the Ito version is If we express a by the ν time then eq.(13) reads It can be seen from eqs. (6) and (14) that quantum and thermal fluctuations are of the same order if γ 2 ≃ e 3ν H(ν) 5 . The estimate of the dissipation strength γ is relevant for the estimate of the power spectrum and the spectral index at the end of sec.4.
Eq. (14) does not depend on the a(φ) approximation. H(φ) as a function of φ in eqs.(10)- (14) can be obtained from eq. (8). The dependence of a on φ in eqs.(10)- (13) in the slow-roll approximation is determined by eq.(9). Let us consider simple examples. If V = gφ n (chaotic inflation [35]) then For a flat potential we have For "natural inflation" [36] Then, In the case of the double-well potential The noise corrected a(φ) relation could in principle be derived from the solution of eq.(6) but in general this is possible only on a perturbative level (see Appendix A).

III. EXPECTATION VALUE OF E-FOLDS
We treat ν (in eq.(5)) as a random time (because a is random). Let us consider a differential of a function of the stochastic process (6) in the e-folding time in the Stratonovitch sense For the Ito stochastic equation In the rest of this section we follow refs. [22][25] [37]. In the Stratonovitch case we choose a function f and in the Ito case Then, integrating df between ν = 0 and ν corresponding to the values φ(0) = φ in and φ(ν) = φ we obtain (the expectation value of the Ito integral is equal to zero) Let where and (Ito interpretation) The solution of eq. (27) is where φ * is chosen to satisfy proper boundary conditions. Then ( an analog of the formula derived by Starobinsky and Vennin [22]) This solution satisfies f (φ 1 ) = 0 and φ * is chosen so that f (φ 2 ) = 0. Then, according to eq.(26)(setting φ = φ 2 to get f (φ 2 ) = 0 ) we have (an approximate formula for a mean value of e-folds appeared already in [11]) ν is the umber of e-folds between φ in and φ end = φ 1 . We have to determine φ * from the condition f (φ 2 ) = 0.
Another method is considered in [25]. There, the solution of eq. (27) is written in the form Then, the boundary conditions are expressed by u(φ * ) and φ * . Integrating eq.(33) We demand Solving for u(φ * ) gives the formula for ν (36) φ * , φ 1 , φ 2 are arbitrary but a useful choice is φ 1 = φ end , φ 2 = ∞ and φ * = φ in . So, we calculate the first hitting of a boundary of an interval [φ end , ∞] by the process starting from φ in (we know that φ = ∞ cannot be achieved, so there remains φ end ). There may be some problems with integrability in eq.(36) with some potentials in an infinite interval [23] [24] (if there is no thermal noise). Then, Q ≃ −V −1 and the integrability may fail if either V = 0 or V does not grow fast enough .
From the formula (23) we have Taking the square and then the expectation value of eq.(37) we obtain (an analogous formula holds true for f S ). Assume that we find a function F S such that in the Ito case. Then, calculating dF in the same way as we did for df in eqs.(22)-(23) using eqs.(38)- (40) and taking the expectation value we find Let us denote U = ∂ φ F I . Then, in the Ito version we have the equation with Q defined in eq.(28) and The solution follows the one of eq.(27) as expressed either in eq.(30) or in eq.(33). In the next section we discuss perturbative solutions of eqs. (27) and (42).

IV. E-FOLDS, THEIR FLUCTUATIONS AND THE POWER SPECTRUM
The general integral formulae in sec.3 do not allow an explicit calculation of the functions F and f needed for a computation of the e-folds and their fluctuations. We need a perturbative approach. We write eq.(27)as an iterative perturbation expansion in 1 Q starting with Then, the zeroth order approximation in eq.(27) corresponds to setting 1 Q ∂ φ u = 0. Hence, In this approximation we have derived the "classical" formula (9) for e-folds. We have Hence, ∂ φ u (1) = 0 in general. We get ∂ φ u (1) = 0 for the exponential potential. For a power-law potential φ n we have ∂ φ u (1) = 8πG n . u (1) is independent of γ but u (2) (44) depends on γ as Q does. If the thermal noise is absent then the expansion (44) is an expansion in G (i.e., in the inverse of the Planck mass). Next, we need an approximation for the solution of eq. (42). Applying again the expansion (44) in 1 Q ( in the lowest order 1 Q ∂ φ U ≃ 0) we obtain In the next order The power spectrum P ≃ U u −1 at γ = 0 derived from eqs. (45) and (49) [42]. It can be obtained from the general formulae of sec.3 which involve Q. These formulae for e-foldings in the quantum case (cold inflation) have been discussed by Starobinsky and Vennin [22]. If .

In order to calculate the integrals (30)-(36) they perform the Taylor expansion of
Changing variables and expanding the exponential in G 2 we derive the perturbation expansion (44). Next, let us consider the thermal noise using the method of Starobinsky and Vennin [22] [37] (which is equivalent to the expansion (44) in γ 2 G − 1 2 and in G). Then, in eq.(28) (without the quantum noise) and in eq.(29) We have by an integration by parts Let We repeat the approximation (51) used in [22][37] when applied to eq.(31). We expand in eq.(31) the exponential function Then, in the integral (31) we have (neglecting ∂ φ a ≃ G and the second term in eq.(54) being of higher order in G) 57) By means of integral formulae of sec.3 as well as with the perturbation expansion (44) we obtain in the first order the same formula for e-folds as we could get in the calculation without noise (showing that the stochastic method of reaching the boundary has the correct no noise limit; the stochastic formula will still be discussed in Appendix A).The calculation of δν 2 with the thermal noise on the basis of eq.(41) involves calculation of the integral with Q of eq.(52). The Taylor expansion (56) in the integral (58) gives The power spectrum can be defined by fluctuations of the e-folds where (δν) 2 is defined in eq. (38). We have Hence It is difficult to calculate P analytically for general quantum and thermal noise using the formulae of sec.3. We calculate the power spectrum with no quantum noise (solely thermal noise) applying for F ′ the same approximation which we used in eq.(62) ( for ν , i.e. for f ′ ). Then, from eq.(63) From the 1 Q expansion using eqs. (45), (49) and (62) we obtain P = P th + P q (65) (this simple additivity holds true only in the lowest order of the 1 Q expansion as can be seen from eq.(50)). The spectral index n S can be calculated as a derivative (61) over ν of ln P. Then (66) We obtain from eq.(64) (the spectral index for warm inflation is calculated in [43] [44] but under different assumptions) For the quantum stochastic inflation the formula (63) gives  66) and (65) we obtain for the spectral index of the scalar field in thermal and quantum noises For a small γ from eq.(69) and eqs.(63)-(68)

V. SUMMARY
The method of a description of inflation in terms of the fluctuations of e-folds (called δN method) has been suggested long time ago [4][45] [40], developed recently and applied to detailed estimates of inflation parameters [22] [49]. In this paper we have extended this formalism to include a thermal noise. The thermal noise modifies the results on power spectrum. In principle, the method allows to calculate the inflationary parameters non-perturbatively for a larger class of potentials . In the lowest order of a perturbative expansion we have obtained a formula for the power spectrum which is just a sum of the density of thermal (proportional to γ 2 ) and quantum fluctuations. The spectral index is an average of spectral indices of thermal and quantum fluctuations with the corresponding power spectra. The correction to the power spectrum is proportional to γ 2 (which is small for low temperature in the warm inflation models0. The spectral index depends on the inflaton potential. It is measurable in observations [1]. Its value can give some information on the inflaton potential as well as on the friction in inflaton wave equation.
Acknowledgements The author thanks the anonymous referees whose comments contributed to a substantial improvement of the initial version of this paper.

VI. APPENDIX A
It is instructive to compare approximations applied in secs.3-5 with exact solutions (some solutions of stochastic equations with quantum noise are discussed in [15]- [18]).
For the exponential potential (see [50][33]) V = g exp(λφ) in the e-folding time the stochastic equation (6) reads (with a(φ) derived in eq.(16)) where If we express a by ν in eq.(6) (leading to the Fokker-Planck equation (14)) then In the Stratonovitch interpretation these equations can be solved exactly if either the quantum noise or the thermal noise are absent. No exact solution exists if the Stratonovitch differential in eqs.(70)-(71) is replaced by the Ito differential. In such a case in order to approach the solution we would have to use the relation [29](with a certain parameter σ) exp(σφ)dW = exp(σφ) • dW − 1 2 σdφdW exp(σφ). The resulting Stratonovitch equation (which can be treated as an ordinary differential equation) would not be linear. If quantum noise is absent then we set Then ( in the decomposition into classical and stochastic parts) For eq.(71) we setX Then (no quantum noise) We obtain the solution We can calculate the power spectrum from the formula for the energy density fluctuations δρ where For the exponential interaction in the slow-roll approximation Hence, In the case of the quantum noise (in agreement with eqs.(38)-(39) of [21]). ν should be taken at the time ν ≃ − ln k expressed by the wave number k at the Hubble horizon crossing. From eq.(9) Hence, at the lowest order fluctuations of φ are proportional to fluctuations of ν . Now, we can calculate the spectral index as −∂ ν ln (δφ) 2 with the result for thermal noise and for the Starobinsky (quantum) noise in agreement with eqs.(67)-(68). In all cases (73)-(77) we obtain stochastic corrections to the classical formula (9). As an example from eq.(77) Hence, in the approximation exp(f ) ≃ exp( f ) we obtain the classic formula ν = −8πG φ . From eq. (77) we could obtain further relations between correlation functions of φ and ν.

VII. APPENDIX B
Let us repeat the derivation of the fluctuation equations (without the thermal noise) of ref. [20] [21] [22]with some care concerning the rules of the stochastic calculus [29] [52]. We discuss here also the difference between the Ito and Stratonovith versions. The conventional rules of the differential calculus (in particular, the Leibniz rule) are satisfied in the Stratonovitch form of stochastic equations. On the other hand correlation functions are easier to calculate with the Ito integrals (in particular, an expectation value of the Ito integral is zero). One can relate both integrals according to the rule Eq.(92) is different from eq.(38) of [20] and eq.(A.22) of [22] as the terms GH 2 δ and G(H 2 ) ′′ are absent there. We can solve both Stratonovitch (89)-(90) and Ito (91)-(92) equations in a perturbation expansion in m −2 pl = 8πG. We expand the solution of eqs.(91)-(92) around the one of [20] [22] (with δ = 0 and no extra terms) then we obtain that in such an expansion δ ≃ G 2 . Hence, the term GH 2 δ in eq.(92) will be of order G 4 . As δ 2 ≃ G 2 another extra term in eq.(92)G(H 2 ) ′′ δ 2 ≃ G 4 . Hence, in comparison with refs. [20] [22] the extra terms are of higher order in G (at this order, our starting point, the equations for stochastic imflation would also need a modification). The same argument applies to the Stratonovitch eq.(90). It is different from equations of refs. [20] [22] by terms of order G 4 . For this reason till the order G 4 we have the same conclusions concerning the solution of eqs.(90) or (92) (these equations determine the fluctuations and power spectra).
We can repeat the calculations of fluctuations for the thermal noise rederiving the formula (64). Then, at the lowest order in γ 2 we get the additivity of fluctuations (65) and as a consequence the formula (69) for the spectral index.