Modeling Stochastic Hybrid Systems

  • Mrinal K. Ghosh
  • Arunabha Bagchi
Part of the IFIP International Federation for Information Processing book series (IFIPAICT, volume 166)


Stochastic hybrid systems arise in numerous applications of systems with multiple models; e.g., air traffc management, flexible manufacturing systems, fault tolerant control systems etc. In a typical hybrid system, the state space is hybrid in the sense that some components take values in a Euclidean space, while some other components are discrete. In this paper we propose two stochastic hybrid models, both of which permit diffusion and hybrid jump. Such models are essential for studying air traffic management in a stochastic framework.


Stochastic hybrid systems Markov processes Ito-Skorohod type stochastic differential equations hybrid jumps 


  1. [1]
    F. A. van der Duyn Schouten and A. Hordijk. Average optimal policies in markov decision drift processes with applications to a queueing and a replacement model. Adv. Appl. Prob., 15:274–303, 1983.zbMATHCrossRefGoogle Scholar
  2. [2]
    A. Bensoussan and J. L. Menadi. Stochastic hybrid control. J.Math. Anal. Appl., 249:261–268, 2000.zbMATHMathSciNetCrossRefGoogle Scholar
  3. [3]
    H. A. P. Blom. Bayesian estimation for decision-directed stochastic control. PhD thesis, Delft Univ. of Technology, 1990.Google Scholar
  4. [4]
    R. W. Brockett and G. L. Blankenship. A representation theorem for linear differential equations with markovian switching. Proc. Allerton Conf. Circ. Syst. Th., pages 671–679, 1977.Google Scholar
  5. [5]
    M. H. A. Davis. Markov Moldels and Optimisation. Chapman and Hall, 1999.Google Scholar
  6. [6]
    N. Ikeda and S. Watanabe. Stochastic Differential Equations and Diffusion Processes, Second Edition. North-Holland, Kodansha, 1989.Google Scholar
  7. [7]
    J. Jacod and A. N. Shiryayev. Limit Theorems for Stochastic Processes. Springer-Verlag, 1980.Google Scholar
  8. [8]
    A. Arapostathis, M. K. Ghosh and S. I. Marcus. Optimal control of switching diffusions with application to flexible manufacturing systems. SIAM J. Control Optim., 31:1183–1204, 1993.zbMATHMathSciNetCrossRefGoogle Scholar
  9. [9]
    A. Arapostathis, M. K. Ghosh and S. I. Marcus. Ergodic control of switching diffusions. SIAM J. Control Optim., 35:1952–1988, 1997.zbMATHMathSciNetCrossRefGoogle Scholar
  10. [10]
    S. I. Marcus. Average optimal policies in markov decision drift processes with applications to a queueing and a replacement model. Adv. Appl. Prob., 15:274–303, 1983.CrossRefGoogle Scholar
  11. [11]
    M. Mariton. Jump Linear Systems in Automatic Control. Marcel Dekker, 1990.Google Scholar
  12. [12]
    A. V. Skorohod. Asymptotic Methods in the Theory of Stochastic Differential Equations. AMS, 1989.Google Scholar
  13. [13]
    D. L. Snyder. Random Point Processes. Wiley, 1975.Google Scholar
  14. [14]
    M. K. Ghosh, V. S. Borkar and P. Sahay. Optimal control of a stochastic hybrid system with discounted cost. J. Optim. Theory Appl., 101:557–580, 1991.MathSciNetGoogle Scholar
  15. [15]
    D. Vermes. Optimal control of piecewise deterministic processes. Stochastics, 14:165–207, 1985.zbMATHMathSciNetGoogle Scholar
  16. [16]
    W. M. Wonham. Random differential equations in control theory. Probability Analysis in Applied Mathematics, vol. 2, A. T. Bharucha-Reid (Editor). Academic Press, 1970.Google Scholar

Copyright information

© International Federation for Information Processing 2005

Authors and Affiliations

  • Mrinal K. Ghosh
    • 1
  • Arunabha Bagchi
    • 2
  1. 1.Department of MathematicsIndian Institute of ScienceBangaloreIndia
  2. 2.Department of Applied MathematicsUniversity of TwenteEnschedeThe Netherlands

Personalised recommendations