Abstract
We discuss the stochastic linear-quadratic (LQ) optimal control problem with Poisson processes under the indefinite case. Based on the wellposedness of the LQ problem, the main idea is expressed by the definition of relax compensator that extends the stochastic Hamiltonian system and stochastic Riccati equation with Poisson processes (SREP) from the positive definite case to the indefinite case. We mainly study the existence and uniqueness of the solution for the stochastic Hamiltonian system and obtain the optimal control with open-loop form. Then, we further investigate the existence and uniqueness of the solution for SREP in some special case and obtain the optimal control in close-loop form.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Boyd S, Ghaoui E L, Feron E, et al. Linear Matrix Inequality in Systems and Control Theory. Philadelphia: SIAM, 1994
Chen S, Li X, Zhou X. Stochastic linear-quadratic regulators with indefinite control weight costs. SIAM J Control Optim, 1998, 36: 1685–1702
Hu Y, Peng S. Solution of forward-backward stochastic differential equations. Probab Theory Related Fields, 1995, 103: 273–283
Huang J, Yu Z. Solvability of indefinite stochastic Riccati equations and linear-quadratic optimal control problems. Systems Control Lett, 2014, 68: 68–75
Li N, Yu Z. Recursive stochastic linear-quadratic optimal control and nonzero-sum differential game problems with random jumps. Adv Difference Equ, 2015, 144: 1–19
Meng Q. General linear-quadratic optimal stochastic control problem driven by a Brownian motion and a Poisson random martingale measure with random coefficients. Stoch Anal Appl, 2004, 32: 88–109
Peng S. New development in stochastic maximum principle and related backward stochastic differential equations. In: Proceedings of the 31st IEEE Conference on Decision and Control, vol. 2. Tucson: IEEE, 1992, 2043–2047
Peng S. Stochastic Hamilton-Jacobi-Bellman equations. Stoch Anal Appl, 1992, 30: 284–304
Peng S, Wu Z. Fully coupled forward-backward stochastic differential equations and applications to optimal control. SIAM J Control Optim, 1999, 37: 825–843
Qian Z, Zhou X. Existence of solutions to a class of indefinite stochastic Riccati equations. SIAM J Control Optim, 2013, 51: 221–229
Rami M, Chen X, Moore J, et al. Solvability and asymptotic behavior of generalized Riccati equations arising in indefinite stochastic LQ controls. IEEE Trans Automat Control, 2001, 46: 428–440
Rami M, Zhou X, Moore J. Well-posedness and attainability of indefinite stochastic linear-quadratic control in infinite time horizon. Systems Control Lett, 2000, 41: 123–133
Tang S. General linear-quadratic optimal stochastic control problems with random coefficients: Linear stochastic Hamilton systems and backward stochastic Riccati equations. SIAM J Control Optim, 2003, 42: 53–75
Tang S, Li X. Necessary conditions for optimal control of stochastic systems with random jumps. SIAM J Control Optim, 1994, 32: 1447–1475
Yu Z. Equivalent cost functionals and stochastic linear-quadratic optimal control problems. ESAIM Control Optim Calc Var, 2013, 19: 78–90
Acknowledgements
This work was supported by National Natural Science Foundation of China (Grant Nos. 61573217, 11471192 and 11626142), the National High-Level Personnel of Special Support Program, the Chang Jiang Scholar Program of Chinese Education Ministry, the Natural Science Foundation of Shandong Province (Grant Nos. JQ201401 and ZR2016AB08), the Colleges and Universities Science and Technology Plan Project of Shandong Province (Grant No. J16LI55) and the Fostering Project of Dominant Discipline and Talent Team of Shandong University of Finance and Economics.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Li, N., Wu, Z. & Yu, Z. Indefinite stochastic linear-quadratic optimal control problems with random jumps and related stochastic Riccati equations. Sci. China Math. 61, 563–576 (2018). https://doi.org/10.1007/s11425-015-0776-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11425-015-0776-6