Skip to main content
Log in

Disturbance Rejection for Markov Jump Systems with Partly Unknown Transition Probabilities and Saturation

  • Published:
Circuits, Systems, and Signal Processing Aims and scope Submit manuscript

Abstract

This paper mainly investigates the disturbance rejection problem of Markov jump systems with bounded disturbance and saturation, in the case that only part of the transition probabilities are known in the discrete-time domain. The mode-dependent state feedback controller is designed to ensure that the resulting closed-loop system is stochastically stable and satisfies the optimal disturbance rejective index, meanwhile, the state of the system is to remain in an expected small region including origin in terms of disturbances. Specifically, the stochastically stable conditions are formulated by parameter-dependent Lyaponuv methodology and further established as linear matrix inequalities (LMIs). Sweeping the auxiliary parameters in the domain of definition, the global optimal disturbance rejective index is obtained. Finally, tolerance capability is further analyzed to evaluate the disturbance rejection level. Two numerical examples, a common linear system and a Markov jump system with completely known and partly unknown transition probabilities, are presented to illustrate the potential of the results, respectively.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2

Similar content being viewed by others

References

  1. Q. Ahmed, A. Iqbal, I. Taj, K. Ahmed, Gasoline engine intake manifold leakage diagnosis/prognosis using hidden Markov model. Int. J. Innov. Comput. Inf. Control 8(7), 4661–4674 (2012)

    Google Scholar 

  2. Y. Cao, Z. Lin, Y. Shamash, Set invariance analysis and gain-scheduling control for LPV systems subject to actuator saturation. Syst. Control Lett. 46(2), 137–151 (2002)

    Article  MathSciNet  MATH  Google Scholar 

  3. H. Dong, Z. Wang, D. Ho, H. Gao, Robust H-infinity filtering for Markovian jump systems with randomly occurring nonlinearities and sensor saturation: the finite-horizon case. IEEE Trans. Signal Process. 59(7), 3048–3057 (2011)

    Article  MathSciNet  Google Scholar 

  4. T. Hu, Z. Lin, B. Chen, An analysis and design method for linear systems subject to actuator saturation and disturbance. Automatica 38(2), 351–359 (2002)

    Article  MATH  Google Scholar 

  5. T. Hu, Z. Lin, B. Chen, An analysis and design for discrete-time linear systems subject to actuator saturation and disturbance. Syst. Control Lett. 45(2), 97–112 (2002)

    Article  MathSciNet  MATH  Google Scholar 

  6. F. Kojima, J.S. Knopp, Inverse problem for electromagnetic propagation in a dielectric medium using Markov chain Monte Carlo method. Int. J. Innov. Comput. Inf. Control 8(3), 2339–2346 (2012)

    Google Scholar 

  7. N.M. Krasovskii, E.A. Lidskii, Analytical design of controllers in systems with random attributes. Autom. Remote Control 22(1), 1021–1025 (1961). Also 22(2), 1141–1146, 22(3), 1289–1294

    MathSciNet  Google Scholar 

  8. H. Liu, E.K. Boukas, F. Sun, W.C. Daniel, Controller design for Markov jumping systems subject to actuator saturation. Automatica 42(3), 459–465 (2006)

    Article  MathSciNet  MATH  Google Scholar 

  9. H. Liu, F. Sun, E.K. Boukas, Robust control of uncertain discrete-time Markovian jump systems with actuator saturation. Int. J. Control 79(7), 805–812 (2006)

    Article  MathSciNet  MATH  Google Scholar 

  10. M. Liu, P. Shi, L. Zhang, X. Zhao, Fault tolerant control for nonlinear Markovian jump systems via proportional and derivative sliding mode observer. IEEE Trans. Circuits Syst. I, Regul. Pap. 58(11), 2755–2764 (2011)

    Article  MathSciNet  Google Scholar 

  11. J. Peng, J. Aston, C. Liou, Modeling time series and sequences using Markov chain embedded finite automata. Int. J. Innov. Comput. Inf. Control 7(1), 407–432 (2011)

    Google Scholar 

  12. P. Shi, E.K. Boukas, R. Agarwal, Control of Markovian jump discrete-time systems with norm bounded uncertainty and unknown delay. IEEE Trans. Autom. Control 44(11), 2139–2144 (1999)

    Article  MathSciNet  MATH  Google Scholar 

  13. P. Shi, E.K. Boukas, R. Agarwal, Kalman filtering for continuous-time uncertain systems with Markovian jumping parameters. IEEE Trans. Autom. Control 44(8), 1592–1597 (1999)

    Article  MathSciNet  MATH  Google Scholar 

  14. P. Shi, Y. Xia, G. Liu, D. Rees, On designing of sliding mode control for stochastic jump systems. IEEE Trans. Autom. Control 51(1), 97–103 (2006)

    Article  MathSciNet  Google Scholar 

  15. L. Wu, P. Shi, H. Gao, C. Wang, Robust H-infinity filtering for 2-D Markovian jump systems. Automatica 44(7), 1849–1858 (2008)

    Article  MathSciNet  MATH  Google Scholar 

  16. L. Wu, P. Shi, H. Gao, State estimation and sliding-mode control of Markovian jump singular systems. IEEE Trans. Autom. Control 55(5), 1213–1219 (2010)

    Article  MathSciNet  Google Scholar 

  17. L. Wu, X. Su, P. Shi, Sliding mode control with bounded L 2 gain performance of Markovian jump singular time-delay systems. Automatica 48(8), 1929–1933 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  18. J. Xiong, J. Lam, H. Gao, D.W.C. Ho, On robust stabilization of Markovian jump systems with uncertain switching probabilities. Automatica 41(5), 897–903 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  19. Y. Yin, P. Shi, F. Liu, Gain-scheduled robust fault detection on time-delay stochastic nonlinear systems. IEEE Trans. Ind. Electron. 58(10), 4908–4916 (2011)

    Article  Google Scholar 

  20. Y. Yin, P. Shi, F. Liu, J.S. Pan, Gain-scheduled fault detection on stochastic nonlinear systems with partially known transition jump rates. Nonlinear Anal. Ser. B, Real World Appl. 13(1), 359–369 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  21. L. Zhang, E.K. Boukas, Mode-dependent H filtering for discrete-time Markovian jump linear systems with partly unknown transition probabilities. Automatica 45(6), 1462–1467 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  22. L. Zhang, E.K. Boukas, H control for discrete-time Markovian jump linear systems with partly unknown transition probabilities. Int. J. Robust Nonlinear Control 19(8), 868–883 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  23. L. Zhang, P. Shi, Stability, l 2-Gain and asynchronous H-infinity control of discrete-time switched systems with average dwell time. IEEE Trans. Autom. Control 54(9), 2193–2200 (2009)

    Google Scholar 

  24. L. Zhang, Y. Shi, T. Chen, B. Huang, A new method for stabilization of networked control systems with random delays. IEEE Trans. Autom. Control 50(8), 1177–1181 (2005)

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgements

This work was partially supported by National Natural Science Foundation of China (61273087, 61134007), Program for Excellent Innovative Team of Jiangsu Higher Education Institutions, Jiangsu Higher Education Institutions Innovation Funds (CXZZ120743), the Fundamental Research Funds for the Central Universities (JUDCF12029).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Fei Liu.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Liu, Y., Liu, F. Disturbance Rejection for Markov Jump Systems with Partly Unknown Transition Probabilities and Saturation. Circuits Syst Signal Process 32, 2783–2797 (2013). https://doi.org/10.1007/s00034-013-9593-4

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00034-013-9593-4

Keywords

Navigation