Abstract
This paper focuses on hybrid systems whose discrete state transitions depend on both deterministic and stochastic events. For such systems, after introducing a suitable hybrid model called Discrete Hybrid Stochastic Automaton (DHSA), different finite-time optimal control approaches are examined: (1) Stochastic Hybrid Optimal Control (SHOC), that “optimistically” determines the trajectory providing the best trade off between the tracking performance and the probability that stochastic events realize as expected, under specified chance constraints; (2) Robust Hybrid Optimal Control (RHOC) that, in addition, less optimistically, ensures that the system remains within a specified safety region for all possible realizations of stochastic events. Sufficient conditions for the asymptotic convergence of the state vector are given for receding-horizon implementations of the above schemes. The proposed approaches are exemplified on a simple benchmark problem in production system management.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Antsaklis, P.: A brief introduction to the theory and applications of hybrid systems. Proc. IEEE, Special Issue on Hybrid Systems: Theory and Applications 88, 879–886 (2000)
Pola, G., Bujorianu, M., Lygeros, J., Di Benedetto, M.: Stochastic hybrid models: an overview with application to air traffic management. In: IFAC–ADHS 2003, IFAC conference on analysis and design of hybrid systems (2003)
Hu, J., Lygeros, J., Sastry, S.: Towards a theory of stochastic hybrid systems. In: Lynch, N.A., Krogh, B.H. (eds.) HSCC 2000. LNCS, vol. 1790, pp. 160–173. Springer, Heidelberg (2000)
Bujorianu, M., Lygeros, J.: Reachability questions in piecewise deterministic markov processes. In: Maler, O., Pnueli, A. (eds.) HSCC 2003. LNCS, vol. 2623, pp. 126–140. Springer, Heidelberg (2003)
Liberzon, D., Chatterjee, D.: On stability of stochastic switched systems. In: Proc. 43th IEEE Conf. on Decision and Control, Paradise Island, Bahamas (2004)
Strubbe, S., Julius, A., van der Schaft, A.: Communicating piecewise deterministic markov processes. In: Proc. IFAC Conf. Analysis and Design of Hybrid Systems, pp. 349–354 (2003)
Prandini, M., Hu, J., Lygeros, J., Sastry, S.: A probabilistic approach to aircraft conflict detection. IEEE Transactions on Intelligent Transportation Systems 1, 199–220 (2000)
Cassandras, C., Mookherje, R.: Receding horizon optimal control for some stochastic hybrid systems. In: Proc. 41th IEEE Conf. on Decision and Control, pp. 2162–2167 (2003)
Hespanha, J.: Stochastic hybrid systems: application to communication networks. In: Alur, R., Pappas, G.J. (eds.) HSCC 2004. LNCS, vol. 2993, pp. 387–401. Springer, Heidelberg (2004)
Torrisi, F., Bemporad, A.: HYSDEL — A tool for generating computational hybrid models. IEEE Trans. Contr. Systems Technology 12, 235–249 (2004)
Bemporad, A., Di Cairano, S.: Modelling and optimal control of hybrid systems with event uncertainty. Technical report, University of Siena (02/04, 2004), Available at: www.dii.unisi.it/~dicairano/papers/tr0204.pdf
Bemporad, A., Morari, M.: Control of systems integrating logic, dynamics, and constraints. Automatica 35, 407–427 (1999)
Davis, M.: Markov models and optimization. Chapman and Hall, Boca Raton (1993)
Cassandras, C.: Discrete event systems. Aksen associates (1993)
Birge, J., Louveaux, F.: Introduction to Stochastic Programming. Springer, New York (1997)
Bemporad, A.: Hybrid Toolbox – User’s Guide (2003), http://www.dii.unisi.it/hybrid/toolbox
ILOG, Inc.: CPLEX 8.1 User Manual, Gentilly Cedex, France (2003)
Lazar, M., Heemels, W., Weiland, S., Bemporad, A.: Stability of hybrid model predictive control. In: Proc. 43th IEEE Conf. on Decision and Control, Paradise Island, Bahamas (2004)
Papoulis, A.: Probability, random variables and stochastic processes. McGraw-Hill, New York (1991)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bemporad, A., Di Cairano, S. (2005). Optimal Control of Discrete Hybrid Stochastic Automata. In: Morari, M., Thiele, L. (eds) Hybrid Systems: Computation and Control. HSCC 2005. Lecture Notes in Computer Science, vol 3414. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-31954-2_10
Download citation
DOI: https://doi.org/10.1007/978-3-540-31954-2_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-25108-8
Online ISBN: 978-3-540-31954-2
eBook Packages: Computer ScienceComputer Science (R0)