Optimal Control of a Stochastic Hybrid System with Discounted Cost
- 137 Downloads
We address the optimal control problem of a very general stochastic hybrid system with both autonomous and impulsive jumps. The planning horizon is infinite and we use the discounted-cost criterion for performance evaluation. Under certain assumptions, we show the existence of an optimal control. We then derive the quasivariational inequalities satisfied by the value function and establish well-posedness. Finally, we prove the usual verification theorem of dynamic programming.
Unable to display preview. Download preview PDF.
- 1.Branicky, M. S., Borkar, V. S., and Mitter, S. K., A Unified Framework for Hybrid Control: Model and Optimal Control Theory, IEEE Transactions on Automatic Control, Vol. 43, pp. 31–45, 1998.Google Scholar
- 2.Ghosh, M. K., Arapostathis, A., and Marcus, S. I., Optimal Control of Switching Diffusions with Application to Flexible Manufacturing Systems, SIAM Journal on Control and Optimization, Vol. 31, pp. 1183–1204, 1993.Google Scholar
- 3.Borkar, V. S., Optimal Control of Diffusion Processes, Pitman Research Notes in Mathematics, Longman, Harlow, England, Vol. 203, 1989.Google Scholar
- 4.Benes, V. E., Existence of Optimal Strategies Based on Problems, SIAM Journal on Control, Vol. 8, pp. 178–188, 1970.Google Scholar
- 5.Bensoussan, A., and Lions, J. L., Impulse Control and Quasivariational Inequalities, Gauthier-Villars, Paris, France, 1984.Google Scholar