Skip to main content
SpringerLink
Log in

Numerical Solution for Linear-Quadratic Control Problems of Markov Jump Linear Systems and Weak Detectability Concept

  • Published:
Journal of Optimization Theory and Applications Aims and scope Submit manuscript

Abstract

A method for solving the linear-quadratic problem of Markov jump linear systems is developed in this paper, relying on the assumption of weak detectability. The concept of weak detectability generalizes previous concepts relevant to this class of systems, and most importantly, it allows us to revisit the quadratic control problem. In the main result of the paper, we show that, for weakly detectable systems, the solution obtained with the new method converges to the solution of the coupled algebraic Riccati equation that arises in the control problem if and only if the system is mean-square stabilizable. The paper shows how the concepts and the method involved are applied by means of numerical examples and comparisons.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. ABOU-KANDIL, H., FREILING, G., and JANK, G., Solution and Asymptotic Behavior of Coupled Riccati Equations in Jump Linear Systems, IEEE Transactions on Automatic Control, Vol. 39, pp. 1631–1636, 1994.

    Google Scholar 

  2. DO VAL, J. B. R., GEROMEL, J. C., and COSTA, O. L. V., Solutions for the Linear-Quadratic Control Problem of Markov Jump Linear Systems, Journal of Optimization Theory and Applications, Vol. 103, pp. 283–311, 1999.

    Google Scholar 

  3. GAJIC, Z., and BORNO, I., Lyapunov Iterations for Optimal Control of Jump Linear Systems at Steady State, IEEE Transactions on Automatic Control, Vol. 40, pp. 1971–1975, 1995.

    Google Scholar 

  4. GAJIC, Z., and LOSADA, R., Monotonicity of Algebraic Lyapunov Iterations for Optimal Control of Jump Parameter Linear Systems, Systems and Control Letters, Vol. 41, pp. 175–181, 2000.

    Google Scholar 

  5. RAMI, M. A., and GHAOUI, L. E., LMI Optimization for Nonstandard Riccati Equations Arising in Stochastic Control, IEEE Transactions on Automatic Control, Vol. 41, pp. 1666–1671, 1996.

    Google Scholar 

  6. JI, Y., and CHIZECK, H. J., Controllability, Stabilizability, and Continuous Time Markovian Jump Linear-Quadratic Control, IEEE Transactions on Automatic Control, Vol. 35, pp. 777–788, 1990.

    Google Scholar 

  7. COSTA, E. F., and DO VAL, J. B. R., On the Detectability and Observability of Continuous-Time Markov Jump Linear Systems, Proceedings of the 2001 European Control Conference, 2001.

  8. COSTA, O. L. V., and FRAGOSO, M. D., Discrete-Time LQ-Optimal Control Problems for Infinite Markov Jump Parameter Systems, IEEE Transactions on Automatic Control, Vol. 40, pp. 2076–2088, 1995.

    Google Scholar 

  9. JI, Y., and CHIZECK, H. J., Jump Linear-Quadratic Gaussian Control: Steady-State Solution and Testable Conditions, Control Theory and Advanced Technology, Vol. 6, pp. 289–319, 1990.

    Google Scholar 

  10. COSTA, E. F., and DO VAL, J. B. R., On the Detectability and Observability of Continuous-Time Markov Jump Linear Systems, SIAM Journal on Control and Optimization (submitted).

  11. COSTA, O. L. V., DO VAL, J. B. R., and GEROMEL, J. C., Continuous-Time State-Feedback H 2-Control of Markovian Jump Linear Systems via Convex Analysis, Automatica, Vol. 35, pp. 259–268, 1999.

    Google Scholar 

  12. DE JAGER, B., Linear and Nonlinear ℋ ∞ Control: An Example, Proceedings of the 1997 Automatic Control Conference, Albuquerque, New Mexico, pp. 396–397, 1997.

Download references

Author information

Authors and Affiliations

  1. Department of Telematics, Faculty of Electrical Engineering and Computation, University of Campinas, Campinas, SP, Brazil

    J.B.R. Do Val (Adjoint Professor)

  2. Department of Telematics, Faculty of Electrical Engeneering and Computation, University of Campinas, Campinas, SP, Brazil

    E.F. Costa (PhD Student)

Authors
  1. J.B.R. Do Val
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. E.F. Costa
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Do Val, J., Costa, E. Numerical Solution for Linear-Quadratic Control Problems of Markov Jump Linear Systems and Weak Detectability Concept. Journal of Optimization Theory and Applications 114, 69–96 (2002). https://doi.org/10.1023/A:1015412121001

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1015412121001

Search

Navigation