Abstract
Hybrid discrete-continuous models, such as Jump Markov Linear Systems, are convenient tools for representing many real-world systems; in the case of fault detection, discrete jumps in the continuous dynamics are used to model system failures. Stochastic uncertainty in hybrid systems arises in both the continuous dynamics, in the form of uncertain state estimation, disturbances or uncertain modeling, and in the discrete dynamics, which are themselves stochastic.
In this paper we present a novel method for optimal predictive control of Jump Markov Linear Systems that is robust to both continuous and discrete uncertainty. The approach extends our previous ‘particle control’ approach, which approximates the predicted distribution of the system state using a finite number of particles. Here, we present a weighted particle control approach, which uses importance weighting to ensure that low probability events such as failures are considered. We demonstrate the method with a car braking scenario.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Hofbaur, M.W., Williams, B.C.: Hybrid estimation of complex systems. In: IEEE Trans. on Systems, Man, and Cybernetics - Part B: Cybernetics (2004)
Oh, S.M., et al.: Learning and inference in parametric switching linear dynamic systems. In: Proc. IEEE Int. Conf. Comp. Vision, IEEE Computer Society Press, Los Alamitos (2005)
Blackmore, L., Rajamanoharan, S., Williams, B.C.: Active estimation for switching linear dynamic systems. In: Proc. of the CDC (2006)
Pham, H.: On some recent aspects of stochastic control and their applications. Probability Surveys 2, 506–549 (2005)
Costa, O.L.V., Fragoso, M.D., Marques, R.P.: Discrete-Time Markovian Jump Linear Systems. Springer, Heidelberg (2005)
Schwarm, A., Nikolaou, M.: Chance-constrained model predictive control. AlChE Journal 45, 1743–1752 (1999)
Li, P., Wendt, M., Wozny, G.: A probabilistically constrained model predictive controller. Automatica 38, 1171–1176 (2002)
Batina, I.: Model Predictive Control for Stochastic Systems by Randomized Algorithms. PhD thesis, TU Eindhoven, The Netherlands (2004)
Hessem, D.H.V.: Stochastic Inequality Constrained Closed-loop Model Predictive Control. PhD thesis, Technische Universiteit Delft, Delft, The Netherlands (2004)
Blackmore, L., Li, H.X., Williams, B.C.: A probabilistic approach to optimal robust path planning with obstacles. In: Proceedings of the ACC (2006)
Vargas, A.N., Furloni, W., do Val, J.B.R.: Constrained MPC of jump linear systems with noise and non-observed markov state. In: Proc. ACC (2006)
Blackmore, L.: A probabilistic particle control approach to optimal, robust predictive control. In: Proc. of the AIAA GNC Conference (2006)
Metropolis, N., Ulam, S.: The Monte Carlo method. American Statistical Association 44, 335–341 (1949)
Morales-Menendez, R., de Freitas, N., Poole, D.: Real-time monitoring of complex industrial processes with particle filters. In: Proceedings of NIPS (2002)
Doucet, A., et al.: Rao-Blackwellised particle filtering for dynamic Bayesian networks. In: Proceedings of UAI (2000)
Gordon, N.J., Salmond, D.J., Smith, A.F.M.: Novel approach to nonlinear/non-Gaussian Bayesian state estimation. IEE Proceedings - F 140(2), 107–113 (1993)
Bemporad, A., Cairano, S.D.: Optimal control of discrete hybrid stochastic automata. In: Morari, M., Thiele, L. (eds.) HSCC 2005. LNCS, vol. 3414, pp. 151–167. Springer, Heidelberg (2005)
Schouwenaars, T., et al.: Mixed integer programming for multi-vehicle path planning. In: Proc. European Control Conference (2001)
Doucet, A., de Freitas, N., Gordon, N.J.: Sequential Monte Carlo Methods in Practice. Springer, Heidelberg (2001)
de Freitas, N.: Rao-Blackwellised particle filtering for fault diagnosis. In: IEEE Aero, IEEE Computer Society Press, Los Alamitos (2002)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer Berlin Heidelberg
About this paper
Cite this paper
Blackmore, L., Bektassov, A., Ono, M., Williams, B.C. (2007). Robust, Optimal Predictive Control of Jump Markov Linear Systems Using Particles. In: Bemporad, A., Bicchi, A., Buttazzo, G. (eds) Hybrid Systems: Computation and Control. HSCC 2007. Lecture Notes in Computer Science, vol 4416. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-71493-4_11
Download citation
DOI: https://doi.org/10.1007/978-3-540-71493-4_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-71492-7
Online ISBN: 978-3-540-71493-4
eBook Packages: Computer ScienceComputer Science (R0)