Abstract
We discuss numerical aspects related to a new class of NonLinear Stochastic Differential Equation (NLSDE) in the sense of McKean, which are supposed to represent non conservative nonlinear Partial Differential Equations (PDEs). We propose an original interacting particle system for which we discuss the propagation of chaos. We consider a time-discretized approximation of this particle system to which we associate a random function which is proved to converge to a solution of a regularized version of a nonlinear PDE.
Similar content being viewed by others
References
Barenblatt, G.I.: On some unsteady motions of a liquid and gas in a porous medium. Akad. Nauk. SSSR Prikl. Mat. Meh. 16, 67–78 (1952)
Belaribi, N., Cuvelier, F., Russo, F.: A probabilistic algorithm approximating solutions of a singular PDE of porous media type. Monte Carlo Methods Appl. 17(4), 317–369 (2011)
Belaribi, N., Cuvelier, F., Russo, F.: Probabilistic and deterministic algorithms for space multidimensional irregular porous media equation. SPDEs Anal. Comput. 1(1), 3–62 (2013)
Ben Alaya, M., Jourdain, B.: Probabilistic approximation of a nonlinear parabolic equation occurring in rheology. J. Appl. Probab. 44(2), 528–546 (2007)
Bertsekas, D.P., Shreve, S.E.: Stochastic optimal control. In: Mathematics in Science and Engineering, vol. 139. Academic Press, Inc. [Harcourt Brace Jovanovich, Publishers], New York-London, (1978) (The discrete time case)
Bossy, M., Jourdain, B.: Rate of convergence of a particle method for the solution of a 1D viscous scalar conservation law in a bounded interval. Ann. Probab. 30(4), 1797–1832 (2002)
Bossy, M., Talay, D.: A stochastic particle method for some one-dimensional nonlinear p.d.e. Math. Comput. Simul., 38(1–3):43–50 (1995) (Probabilités numériques (Paris, 1992))
Bossy, M., Talay, D.: A stochastic particle method for the McKean–Vlasov and the Burgers equation. Math. Comput. 66(217), 157–192 (1997)
Bouchard, B., Touzi, N.: Discrete-time approximation and Monte Carlo simulation of backward stochastic differential equations. Stoch. Process. Appl. 111, 175–206 (2004)
Cheridito, P., Soner, H.M., Touzi, N., Victoir, N.: Second-order backward stochastic differential equations and fully nonlinear parabolic PDEs. Commun. Pure Appl. Math. 60(7), 1081–1110 (2007)
Crauel, H.: Random probability measures on Polish spaces. In: Stochastics Monographs, vol. 11. Taylor & Francis, London (2002)
Del Moral, P.: Feynman-Kac formulae: genealogical and interacting particle systems with applications. In: Probability and Its Applications (New York). Springer-Verlag, New York (2004)
Del Moral, P.: Mean field simulation for Monte Carlo integration. In: Monographs on Statistics and Applied Probability, vol. 126. CRC Press, Boca Raton (2013)
Gobet, E., Lemor, J.-P., Warin, X.: A regression-based Monte Carlo method to solve backward stochastic differential equations. Ann. Appl. Probab. 15(3), 2172–2202 (2005)
Henry-Labordère, P.: Counterparty risk valuation: a marked branching diffusion approach. doi:10.2139/ssrn.1995503 or http://ssrn.com/abstract=1995503 (2012)
Henry-Labordère, P., Tan, X., Touzi, N.: A numerical algorithm for a class of BSDEs via the branching process. Stoch. Process. Appl. 124(2), 1112–1140 (2014)
Jourdain, B., Méléard, S.: Propagation of chaos and fluctuations for a moderate model with smooth initial data. Ann. Inst. H. Poincaré Probab. Statist. 34(6), 727–766 (1998)
Karatzas, I., Shreve, S.E.: Brownian motion and stochastic calculus. In: Graduate Texts in Mathematics, vol. 113, 2nd edn. Springer-Verlag, New York (1991)
Kohatsu-Higa, A., Ogawa, S.: Weak rate of convergence for an Euler scheme of nonlinear SDE’s. Monte Carlo Methods Appl. 3(4), 327–345 (1997)
Le Cavil, A., Oudjane, N., Russo, F.: Probabilistic representation of a class of non conservative nonlinear partial differential equations. https://hal.archives-ouvertes.fr/hal-01241701 (2015)
McKean, H.P., Jr.: Propagation of chaos for a class of non-linear parabolic equations. In: Stochastic Differential Equations (Lecture Series in Differential Equations, Session 7, Catholic Univ., 1967). Air Force Office Sci. Res., Arlington, pp. 41–57 (1967)
Pardoux, E.: Backward stochastic differential equations and viscosity solutions of systems of semilinear parabolic and elliptic PDEs of second order. In: Stochastic Analysis and Related Topics, VI (Geilo, 1996), vol. 42 of Progr. Probab. Birkhäuser Boston, Boston, MA, pp. 79–127 (1998)
Pardoux, É., Peng, S.G.: Adapted solution of a backward stochastic differential equation. Syst. Control Lett. 14(1), 55–61 (1990)
Pardoux, E., Raşcanu, A.: Stochastic Differential Equations, Backward SDEs, Partial Differential Equations, vol. 69. Springer, Berlin (2014)
Rogers, L.C.G., Williams, D.: Diffusions, Markov Processes, and Martingales, vol. 2. Cambridge Mathematical Library. Cambridge University Press, Cambridge, (2000). (Itôcalculus, Reprint of the second (1994) edition)
Silverman, B.W.: Density Estimation forStatistics and Data Analysis. Monographs on Statistics and Applied Probability. Chapman & Hall, London (1986)
Sznitman, A-S.: Topics in propagation of chaos. In: École d’Été de Probabilités de Saint-Flour XIX—1989. Lecture Notes in Mathematics, vol. 1464. Springer, Berlin, pp. 165–251 (1991)
Talay, D.: Probabilistic numerical methods for partial differential equations: elements of analysis. In: Probabilistic Models for Nonlinear Partial Differential Equations (Montecatini Terme, 1995). Lecture Notes in Mathematics, vol. 1627. Springer, Berlin, pp. 148–196 (1996)
Acknowledgments
The authors are very grateful to the anonymous Referee for her/his careful reading of the paper and the suggestions which have largely contributed to improve the first submitted version. The third named author has benefited partially from the support of the “FMJH Program Gaspard Monge in optimization and operation research” (Project 2014-1607H).
Author information
Authors and Affiliations
Corresponding author
Appendix
Appendix
In this appendix, we present the proof of Lemma 4.4. We first proceed with the proof of some intermediary inequalities.
Lemma 5.1
We suppose Assumption 1. Let \(N \in \mathbb N^{\star }\). Let \((\xi ^{i,N})_{i=1, \ldots ,N}\) be (a solution of) the interacting particle system (3.3); let \((\tilde{\xi }^{i,N})_{i=1, \ldots ,N}\) and \(\tilde{u}\) as defined as in the discretized interacting particle system (4.1).
The random variables \(V_t^i := e^{\int _0^t\Lambda \big (s,\tilde{\xi }^{i,N}_{s},u^{S^N(\tilde{\xi })}_{s}(\tilde{\xi }^{i,N}_{s})\big )ds}\) and \( \tilde{V}_t^i := e^{\int _0^t\Lambda \big (r(s),\tilde{\xi }^{i,N}_{r(s)},\tilde{u}_{r(s)}(\tilde{\xi }^{i,N}_{r(s)})\big )ds}\), for all \(t \in [0,T]\), \(i \in \{ 1, \ldots ,N\}\) fulfill the following.
-
1.
For all \(t \in [0,T]\), \(i \in \{1, \ldots ,N\}\)
$$\begin{aligned} \mathbb E\big [\big \vert \tilde{V}_t^i-V_t^i \big \vert ^2\big ]&\le C\delta t + C\mathbb E\left[ \int _0^t \big \vert \tilde{\xi }^{i,N}_{r(s)} - \tilde{\xi }^{i,N}_{s} \big \vert ^2 \ ds \right] \nonumber \\&\quad +\, C \mathbb E\left[ \int _0^t \big \vert \tilde{u}_{r(s)}\big (\tilde{\xi }^{i,N}_{r(s)}\big )-u^{S^N(\tilde{\xi })}_s\big (\tilde{\xi }^{i,N}_s\big )\big \vert ^2 ds \right] , \end{aligned}$$(6.1)where C is a real positive constant depending only on \(M_{\Lambda }\), \(L_{\Lambda }\) and T.
-
2.
For all \((t,y) \in [0,T] \times \mathbb R^d\), \(i \in \{1, \ldots ,N\}\)
$$\begin{aligned} \big \vert \tilde{u}_{t}(y)-u_t^{S^N(\tilde{\xi })}(y)\big \vert ^2 \le \frac{M_K}{N}\sum _{i=1}^N K\big (y-\tilde{\xi }^{i,N}_t\big ) \; \big \vert \tilde{V}_t^i-V_t^i \big \vert ^2 \ . \end{aligned}$$(6.2)
Proof of Lemma 5.1
Let us fix \(t \in [0,T]\), \(i \in \{1, \ldots ,N\}\). To prove (6.1), it is enough to recall that \(\Lambda \) being Lipschitz w.r.t. the space variables and \(\frac{1}{2}\)-Holder continuous w.r.t. the time variable, the inequality (2.6) yields
and taking the expectation in both sides of (6.3) implies (6.1) with \(C := 3e^{2TM_{\Lambda }}L^2_{\Lambda }\).
Let us fix \(y \in \mathbb R^d\). Concerning (6.2), by recalling the third line equation of (4.1) and the equation (1.6) (with \(m = S^N(\tilde{\xi })\)), we have
which concludes the proof of (6.2) and therefore of Lemma 5.1.\(\square \)
Proof of Lemma 4.4
All along this proof, C will denote a positive constant that only depends
\(T,M_K,m_{\Phi },m_g,L_K,L_\Phi ,L_g\) and \(M_{\Lambda },L_{\Lambda }\) and that can change from line to line.
Let us fix \(t \in [0,T]\).
-
Inequality (4.8) of Lemma 4.4 is simply a consequence of the following computation:
$$\begin{aligned} \mathbb E\Big [\Big \vert \tilde{\xi }^{i,N}_{r(t)}-\tilde{\xi }^{i,N}_{t}\Big \vert ^2\Big ]= & {} \mathbb E\left[ \left| \int _{r(t)}^{t}\Phi \Big (r(s),\tilde{\xi }^{i,N}_{r(s)},\tilde{u}_{r(s)}\Big (\tilde{\xi }^{i,N}_{r(s)}\Big )\Big )\,dW_s\right. \right. \\&\left. \left. \; +\int _{r(t)}^{t}g\Big (r(s),\tilde{\xi }^{i,N}_{r(s)},\tilde{u}_{r(s)}\Big (\tilde{\xi }^{i,N}_{r(s)}\Big )\Big )\,ds\right| ^2 \right] \\\le & {} 4\mathbb E\left[ \int _{r(t)}^{t}\Big \vert \Phi \Big (r(s),\tilde{\xi }^{i,N}_{r(s)},\tilde{u}_{r(s)}(\tilde{\xi }^{i,N}_{r(s)}\Big )\Big ) - \Phi (r(s),0,0) \Big \vert ^2\,ds\right] \\&\;+\, 4\mathbb E\left[ \int _{r(t)}^{t} \vert \Phi (r(s),0,0) \vert ^2\,ds\right] \\&\; +\, 4(t-r(t))\mathbb E\left[ \int _{r(t)}^{t}\Big \vert g\Big (r(s),\tilde{\xi }^{i,N}_{r(s)},\tilde{u}_{r(s)}\Big (\tilde{\xi }^{i,N}_{r(s)}\Big )\Big ) \right. \\&\left. \;-\, g(r(s),0,0)\vert ^2\,ds \right] \\&\; +\,4(t-r(t))\mathbb E\left[ \int _{r(t)}^{t} \vert g(r(s),0,0) \vert ^2\,ds\right] \\\le & {} 8\big (L_{\Phi }^2+(t-r(t))L_{g}^2\big )\int _{r(t)}^t \mathbb E\Big [\Big \vert \tilde{\xi }^{i,N}_{r(s)} \Big \vert ^2 \Big ] + \mathbb E\Big [\Big \vert \tilde{u}_{r(s)}\Big (\tilde{\xi }^{i,N}_{r(s)}\Big ) \Big \vert ^2 \Big ] ds \\&+ \; 4(t-r(t)) \Big ( \sup _{s \in [0,T]} \vert \Phi (s,0,0) \vert ^2 + (t-r(t)) \sup _{s \in [0,T]} \vert g(s,0,0) \vert ^2 \Big )\\\le & {} C\delta t \ ,\quad \text {as soon as }\quad \delta t \in \, ]0, 1[ \ , \end{aligned}$$where we have used the fact, under items 1. and 6. of Assumption 2, that the second order moment of \(\tilde{\xi }^{i,N}_s\) is uniformly bounded. \(\Lambda \) being uniformly bounded (item 3. of Assumption 2), the function \(\tilde{u}\) as well. We have finally invoked item 6. of Assumption 2.
-
Now, let us focus on the second inequality (4.9) of Lemma 4.4. Note that for any \(y\in \mathbb R^d\), the following inequality holds:
$$\begin{aligned}&\vert \tilde{u}_{r(t)}(y)-\tilde{u}_t(y)\vert \nonumber \\&\quad \le \frac{1}{N} \sum _{i=1}^N \left[ \left| K\Big (y-\tilde{\xi }^{i,N}_{r(t)}\Big ) -K\Big (y-\tilde{\xi }^{i,N}_t\Big )\right| \, e^{\int _0^{r(t)}\Lambda \big (r(s),\tilde{\xi }^{i,N}_{r(s)},\tilde{u}_{r(s)}(\tilde{\xi }^{i,N}_{r(s)})\big )ds} \right. \nonumber \\&\qquad + \left. K\Big (y-\tilde{\xi }^{i,N}_t\Big ) \,\left| e^{\int _0^{r(t)}\Lambda \big (r(s),\tilde{\xi }^{i,N}_{r(s)},\tilde{u}_{r(s)}(\tilde{\xi }^{i,N}_{r(s)})\big )ds}- e^{\int _0^t\Lambda \big (r(s),\tilde{\xi }^{i,N}_{r(s)},\tilde{u}_{r(s)}(\tilde{\xi }^{i,N}_{r(s)})\big )ds} \right| \right] \ . \nonumber \\ \end{aligned}$$(6.5)Using the fact that K and \(\Lambda \) are bounded, one can apply (2.6) to bound the second term of the sum on the r.h.s. of the above inequality as follows:
$$\begin{aligned}&K\Big (y-\tilde{\xi }^{i,N}_t\Big ) \,\left| e^{\int _0^{r(t)}\Lambda \big (r(s),\tilde{\xi }^{i,N}_{r(s)},\tilde{u}_{r(s)}\big (\tilde{\xi }^{i,N}_{r(s)}\Big )\big )ds}- e^{\int _0^t\Lambda \big (r(s),\tilde{\xi }^{i,N}_{r(s)},\tilde{u}_{r(s)}(\tilde{\xi }^{i,N}_{r(s)})\big )ds}\right| \nonumber \\&\quad \le M_Ke^{tM_{\Lambda }}(t-r(t))M_{\Lambda } \le C\delta t \ . \end{aligned}$$(6.6)The first term of the sum on the r.h.s. of (6.5) is bounded using the Lipschitz property of K and the fact that \(\Lambda \) is bounded.
$$\begin{aligned}&\left| K\Big (y-\tilde{\xi }^{i,N}_{r(t)}\Big ) -K\Big (y-\tilde{\xi }^{i,N}_t\Big )\right| \, e^{\int _0^{r(t)}\Lambda \big (r(s),\tilde{\xi }^{i,N}_{r(s)},\tilde{u}_{r(s)}\big (\tilde{\xi }^{i,N}_{r(s)}\big )\big )ds}\nonumber \\&\quad \le L_Ke^{tM_{\Lambda }} \Big \vert \tilde{\xi }^{i,N}_{r(t)}-\tilde{\xi }^{i,N}_t\vert \ . \end{aligned}$$(6.7)Injecting (6.6) and (6.7) in (6.5), for all \(y \in \mathbb R^d\), we obtain
$$\begin{aligned} \vert \tilde{u}_{r(t)}(y) - \tilde{u}_{t}(y) \vert \le C \delta t + \frac{L_Ke^{tM_{\Lambda }}}{N} \sum _{i=1}^N \Big \vert \tilde{\xi }^{i,N}_{r(t)}-\tilde{\xi }^{i,N}_{t} \Big \vert , \end{aligned}$$which finally implies that
$$\begin{aligned} \Vert \tilde{u}_{r(t)}-\tilde{u}_t \Vert _{\infty }^2\le C\delta t ^2+\frac{C}{N}\sum _{i=1}^N \Big \vert \tilde{\xi }^{i,N}_{r(t)}-\tilde{\xi }^{i,N}_t\Big \vert ^2 \ . \end{aligned}$$We conclude by using inequality (4.8) of Lemma 4.4 after taking the expectation of the r.h.s. of the above inequality.
-
Finally, we deal with inequality (4.10) of Lemma 4.4. Observe that the error on the left-hand side can be decomposed as
$$\begin{aligned} \mathbb E\Big [\Big \Vert \tilde{u}_{r(t)}-u_t^{S^N(\tilde{\xi })}\Big \Vert ^2_{\infty }\Big ]\le & {} 2\mathbb E\big [\big \Vert \tilde{u}_{r(t)}-\tilde{u}_t\big \Vert ^2_{\infty }\big ]+2\mathbb E\Big [\Big \Vert \tilde{u}_{t}-u_t^{S^N(\tilde{\xi })}\Big \Vert ^2_{\infty }\Big ] \nonumber \\\le & {} C\delta t +2\mathbb E\Big [\Big \Vert \tilde{u}_{t}-u_t^{S^N(\tilde{\xi })}\Big \Vert ^2_{\infty }\Big ]\ , \end{aligned}$$(6.8)where we have used inequality (4.9) of Lemma 4.4.
Let us consider the second term on the r.h.s. of the above inequality. To simplify the notations, we introduce the real valued random variables
$$\begin{aligned} V_t^i := e^{\int _0^t\Lambda \big (s,\tilde{\xi }^{i,N}_{s},u^{S^N(\tilde{\xi })}_{s}\big (\tilde{\xi }^{i,N}_{s}\big )\big )ds}\quad \text {and}\quad \tilde{V}_t^i := e^{\int _0^t\Lambda \big (r(s),\tilde{\xi }^{i,N}_{r(s)},\tilde{u}_{r(s)}\big (\tilde{\xi }^{i,N}_{r(s)}\big )\big )ds}\ ,\nonumber \\ \end{aligned}$$(6.9)defined for any \(i=1, \ldots N\) and \(t\in [0,T]\).
Using successively inequalities (6.1) of Lemma 5.1, (4.8) of Lemma 4.4 and (2.9) of Proposition 2.5, we have for all \(i \in \{1, \ldots ,N\}\),
$$\begin{aligned} \mathbb E\big [\big \vert \tilde{V}_t^i-V_t^i \big \vert ^2\big ]\le & {} C\delta t + C \mathbb E\left[ \int _0^t \Big \vert \tilde{u}_{r(s)}\Big (\tilde{\xi }^{i,N}_{r(s)}\Big )-u^{S^N(\tilde{\xi })}_s\Big (\tilde{\xi }^{i,N}_s\Big )\Big \vert ^2 ds \right] \nonumber \\\le & {} C\delta t + C \mathbb E\left[ \int _0^t \Big \vert \tilde{u}_{r(s)}\Big (\tilde{\xi }^{i,N}_{r(s)}\Big )-u^{S^N(\tilde{\xi })}_s\Big (\tilde{\xi }^{i,N}_{r(s)}\Big )\Big \vert ^2 ds \right] \nonumber \\&+ \; C \mathbb E\left[ \int _0^t \Big \vert u_{s}^{S^N(\tilde{\xi })}\Big (\tilde{\xi }^{i,N}_{r(s)}\Big )-u^{S^N(\tilde{\xi })}_s\Big (\tilde{\xi }^{i,N}_{s}\Big )\Big \vert ^2 ds \right] \nonumber \\\le & {} C\delta t +C\int _0^t \left[ \mathbb E\Big [\Big \Vert \tilde{u}_{r(s)}-u^{S^N(\tilde{\xi })}_s\Big \Vert _\infty ^2\Big ] + \mathbb E\Big [\Big \vert \tilde{\xi }^{i,N}_{r(s)}-\tilde{\xi }^{i,N}_s\Big \vert ^2\Big ] \right] \, ds \nonumber \\\le & {} C\delta t +C\int _0^t \mathbb E\Big [\Big \Vert \tilde{u}_{r(s)}-u^{S^N(\tilde{\xi })}_s\Big \Vert _\infty ^2\Big ] \, ds \ . \end{aligned}$$(6.10)On the other hand, inequality (6.2) of Lemma 5.1 implies
$$\begin{aligned} \Big \Vert \tilde{u}_{t}-u_t^{S^N(\tilde{\xi })} \Big \Vert _{\infty }^2 \le \frac{M_K^2}{N}\sum _{i=1}^N \big \vert \tilde{V}_t^i-V_t^i \big \vert ^2 \ . \end{aligned}$$(6.11)Taking the expectation in both sides of (6.11) and using (6.10) give
$$\begin{aligned} \mathbb E\Big [\Big \Vert \tilde{u}_{t}-u_t^{S^N(\tilde{\xi })}\Big \Vert ^2_{\infty }\Big ]\le & {} \frac{M_K^2}{N}\sum _{i=1}^N \mathbb E\left[ \big \vert \tilde{V}_t^i-V_t^i \big \vert ^2 \right] \le C\delta t\nonumber \\&+\,C\int _0^t \mathbb E\Big [\Big \Vert \tilde{u}_{r(s)}-u^{S^N(\tilde{\xi })}_s\Big \Vert _\infty ^2\Big ] \, ds\ . \end{aligned}$$(6.12)We end the proof by injecting this last inequality in (6.8) and by applying Gronwall’s lemma.\(\square \)
Rights and permissions
About this article
Cite this article
Le Cavil, A., Oudjane, N. & Russo, F. Particle system algorithm and chaos propagation related to non-conservative McKean type stochastic differential equations. Stoch PDE: Anal Comp 5, 1–37 (2017). https://doi.org/10.1007/s40072-016-0079-9
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40072-016-0079-9
Keywords
- Chaos propagation
- Nonlinear Partial Differential Equations
- McKean type NonLinear Stochastic Differential Equation
- Particle systems
- Probabilistic representation of PDEs