Optimal Control of a Stochastic Hybrid System with Discounted Cost

  • V. S. Borkar
  • M. K. Ghosh
  • P. Sahay


We address the optimal control problem of a very general stochastic hybrid system with both autonomous and impulsive jumps. The planning horizon is infinite and we use the discounted-cost criterion for performance evaluation. Under certain assumptions, we show the existence of an optimal control. We then derive the quasivariational inequalities satisfied by the value function and establish well-posedness. Finally, we prove the usual verification theorem of dynamic programming.

Hybrid systems switching diffusions autonomous jumps impulsive jumps discounted cost optimal control 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Branicky, M. S., Borkar, V. S., and Mitter, S. K., A Unified Framework for Hybrid Control: Model and Optimal Control Theory, IEEE Transactions on Automatic Control, Vol. 43, pp. 31–45, 1998.Google Scholar
  2. 2.
    Ghosh, M. K., Arapostathis, A., and Marcus, S. I., Optimal Control of Switching Diffusions with Application to Flexible Manufacturing Systems, SIAM Journal on Control and Optimization, Vol. 31, pp. 1183–1204, 1993.Google Scholar
  3. 3.
    Borkar, V. S., Optimal Control of Diffusion Processes, Pitman Research Notes in Mathematics, Longman, Harlow, England, Vol. 203, 1989.Google Scholar
  4. 4.
    Benes, V. E., Existence of Optimal Strategies Based on Problems, SIAM Journal on Control, Vol. 8, pp. 178–188, 1970.Google Scholar
  5. 5.
    Bensoussan, A., and Lions, J. L., Impulse Control and Quasivariational Inequalities, Gauthier-Villars, Paris, France, 1984.Google Scholar

Copyright information

© Plenum Publishing Corporation 1999

Authors and Affiliations

  • V. S. Borkar
    • 1
  • M. K. Ghosh
    • 2
  • P. Sahay
    • 3
  1. 1.Department of Computer Science and AutomationIndian Institute of ScienceBangaloreIndia
  2. 2.Department of MathematicsIndian Institute of ScienceBangaloreIndia
  3. 3.Department of MathematicsIndian Institute of ScienceBangaloreIndia

Personalised recommendations