Abstract
We consider a controlled stochastic delay partial differential equation withNeumann boundary conditions in which the derivative of the unknown is equal to the sum of the control and of a white noise in time. We study the optimal control problem by means of the associated backward stochastic differential equations.
Similar content being viewed by others
References
Aubin JP, Frankowska H. Set-valued analysis. Systems & control: foundations & applications. vol. 2. Boston: Birkhäuser; 1990.
Bátkai A, Piazzera S. Semigroups for delay equations, Res. Notes Math. vol. 10. Boston: A.K. Peters; 2005.
Britton NF. Spatial structures and periodic travelling waves in an integro-differential reaction-diffusion population model. SIAM J Appl Math. 1990;50:1663–1688.
Chang MH, Pang T, Pemy M. Stochastic optimal control problems with a bounded memory. In: Zhang X, Liu D, Wu L, editors. Operations research and its applications. Papers from the sixth international symposium, ISORA’06. Xinjiang: World Publishing Corporation; 2006. pp. 82–94.
Chang MH, Pang T, Pemy M. Optimal control of stochastic functional differential equations with a bounded memory. Stochastics 2008;80:69–96.
Debussche A, Fuhrman M, Tessitore G. Optimal control of a stochastic heat equation with boundary-noise and boundary-control. ESAIM Control Optim Calc Var. 2007;13(1):178–205.
Duncan TE, Maslowski B, Pasik-Duncan B. Ergodic boundary/point control of stochastic semilinear systems. SIAM J Control Optim. 1998;36:1020–1047.
Fleming WH, Soner HM. Controlled Markov processes and viscosity solutions. Applications of mathematics. vol. 25. New York: Springer-Verlag; 1993.
Fuhrman M, Tessitore G. Nonlinear Kolmogorov equations in infinite dimensional spaces: the backward stochastic differential equations approach and applications to optimal control. Ann Probab. 2002;30(3):1397–1465.
Fuhrman M, Masiero F, Tessitore G. Stochastic equations with delay: optimal control via BSDEs and regular solutions of Hamilton-Jacobi-Bellman equations. SIAM J Control Optim. 2010;48(7):4624–4651.
Gozzi F. Regularity of solutions of second order Hamilton-Jacobi equations and application to a control problem. Comm Partial Diff Equ. 1995;20:775–826.
Gozzi F. Global regular solutions of second order Hamilton-Jacobi equations in Hilbert spaces with locally Lipschitz nonlinearities. J Math Anal Appl. 1996;198:399–443.
Gozzi F, Rouy E, Świȩch A. Second order Hamilton-Jacobi equations in Hilbert spaces and stochastic boundary control. SIAM J Control Optim. 2000;38(2):400–430.
Ichikawa A. Stability of parabolic equations with boundary and pointwise noise. In: Stochastic differential systems, Marseille-Luminy, 1984. Lecture notes in control and inform. Sci. vol. 69. Berlin: Springer; 1985. pp. 55–66.
El Karoui N, Mazliak L, (eds). Backward stochastic differential equations. Pitman research notes in mathematics series. vol. 364. Harlo: Longman; 1997.
Lions PL. Viscosity solutions of fully nonlinear second-order equations and optimal stochastic control in infinite dimensions. Part I. The case of bounded stochastic evolutions. Acta Math. 1988;161(3–4):243–278.
Lions P. L.Viscosity solutions of fully nonlinear second order equations and optimal stochastic control in infinite dimensions. Part II. Optimal control of Zakai’s equation. In: Da Prato G, Tubaro L, editors. Stochastic partial differential equations and applications, II., Lecture notes in mathematics. vol. 147–170. Berlin: Springer; 1989. p. 1390.
Lions PL. Viscosity solutions of fully nonlinear second-order equations and optimal stochastic control in infinite dimensions. III. Uniqueness of viscosity solutions for general second-order equations. J Funct Anal. 1989;86(1):1–18.
Manthey R, Mittmann K. On the qualitative behaviour of the solution to a stochastic partial functional-differential equation arising in population dynamics. Stochast Stochast Rep. 1999;66:153–166.
Maslowski B. Stability of semilinear equations with boundary and pointwise noise. Ann Sc Norm Supper Pisa Cl Sci. 1995;22(4):55–93.
Masiero F. Stochastic optimal control and problems parabolic equations in Banach spaces. SIAM J Control Optim. 2008;47(1):251–300.
Masiero F. A stochastic optimal control problem for the heat equation on the halfline with Dirichlet Boundary-Noise and Boundary-Control. Appl Math Optim. 2010;62:253–294.
Pardoux E. BSDEs, weak convergence and homogeneization of semilinear PDEs. In: Clarke FH, Stern RJ editors. Nonlinear analysis, differential equations and control. Dordrecht: Kluwer; 1999. pp. 503–549.
Pardoux E, Peng S. Adaped solution of a backward stochastic differential equation. Syst Control Lett. 1990;14:55–61.
Da Prato G., Zabczyk J. Evolution equations with white-noise boundary condations. Stoch Stochast Rep. 1993;42:167–182.
Świȩch A. Unbounded second order partial differential equations in infinite dimensional Hilbert spaces. Comm Partial Diff Equ. 1994;19(11–12):1999–2036.
Zhou J., Zhang Z. Optimal control problems for stochastic delay evolution equations in Banach spaces. Int J Control 2011;84(8):1295–1309.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhou, J. Optimal Control of a Stochastic Delay Partial Differential Equation with Boundary-Noise and Boundary-Control. J Dyn Control Syst 20, 503–522 (2014). https://doi.org/10.1007/s10883-014-9228-5
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10883-014-9228-5
Keywords
- Stochastic delay partial differential equations
- Boundary noise
- Boundary control
- Optimal control
- Backward stochastic differential equations