Abstract
A mixed linear quadratic (MLQ) optimal control problem is considered. The controlled stochastic system consists of two diffusion processes which are in different time horizons. There are two control actions: a standard control action \(u(\cdot )\) enters the drift and diffusion coefficients of both state equations, and a stopping time \(\tau \), a possible later time after the first part of the state starts, at which the second part of the state is initialized with initial condition depending on the first state. A motivation of MLQ problem from a two-stage project management is presented. It turns out that solving an MLQ problem is equivalent to sequentially solve a random-duration linear quadratic (RLQ) problem and an optimal time (OT) problem associated with Riccati equations. In particular, the optimal cost functional can be represented via two coupled stochastic Riccati equations. Some optimality conditions for MLQ problem is therefore obtained using the equivalence among MLQ, RLQ and OT problems. In case of seeking the optimal time in the family of deterministic times (even through somewhat restrictive, such seeking is still reasonable from practical standpoint), we give a more explicit characterization of optimal actions.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Chen, S., Li, X., Zhou, X.Y.: Stochastic linear quadratic regulators with indefinite control weight costs. SIAM J. Control Optim. 36, 1685–1702 (1998)
Chen, S., Yong, J.: Stochastic linear quadratic optimal control problems. Appl. Math. Optim. 43, 21–45 (2001)
Hu, Y., Yong, J.: Maximum principle for stochastic impulse control (in Chinese). Chin. Ann. Math. A 12, 109–114 (1991)
Hu, Y., Zhou, X.Y.: Stochastic linear quadratic optimal control problems. SIAM J. Control Optim. 42, 123–137 (2003)
Krylov, N.: Controlled Diffusion Processes. Springer, Berlin (1980)
Ma, J., Yong, J.: Forward–Backward Stochastic Differential Equations and Their Applications, Lecture Notes in Mathematics, vol. 1702. Springer, New York (1999)
Mou, L., Yong, J.: A variational formula for stochastic controls and some applications. Pure Appl. Math. Q. 3, 539–567 (2007)
Øksendal, B., Sulem, A.: Applied Stochastic Control of Jump Diffusions. Springer, Berlin (2004)
Peng, S.: A general stochastic maximum principle for optimal control problems. SIAM J. Control Optim. 28, 966–979 (1990)
Tang, S.: General linear quadratic optimal stochastic control problems with random coefficients: linear stochastic Hamilton systems and backward stochastic Riccati equations. SIAM J. Control Optim. 42, 53–75 (2003)
Wu, Z.: Fully coupled FBSDE with Brownian motion and Poisson process in stopping time duration. J. Aust. Math. Soc. 74, 249–266 (2003)
Yong, J.: A leader-follower stochastic linear quadratic differential game. SIAM J. Control Optim. 41(1015–1041), 2002 (2002)
Yong, J., Zhou, X.Y.: Stochastic Controls: Hamiltonian Systems and HJB Equations. Springer, New York (1999)
Acknowledgments
The authors would like to thank the anonymous referee for his/her constructive comments on the earlier version of the paper. This work is supported in part by RGC Grants GRF521610 and GRF501010, and NSF Grant DMS-1007514.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Huang, J., Li, X. & Yong, J. A Mixed Linear Quadratic Optimal Control Problem with a Controlled Time Horizon. Appl Math Optim 70, 29–59 (2014). https://doi.org/10.1007/s00245-013-9233-1
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00245-013-9233-1