Advertisement

Optimal Tracking Control of Nonlinear Systems with Time Delays

  • Huaguang Zhang
  • Derong Liu
  • Yanhong Luo
  • Ding Wang
Part of the Communications and Control Engineering book series (CCE)

Abstract

In this chapter, the optimal tracking control problems of nonlinear systems with time delays are studied using HDP algorithm. First, the HJB equation for discrete time-delay systems is derived based on state error and control error. Then, a novel iterative HDP algorithm containing the iterations of state, control law, and cost functional is developed. We also give the convergence proof for the present iterative HDP algorithm. Finally, two neural networks, i.e., the critic neural network and the action neural network, are used to approximate the value function and the corresponding control law, respectively. It is the first time that the optimal tracking control problem of nonlinear systems with time delays is solved using the HDP algorithm. Two examples are used to demonstrate the effectiveness of the present control scheme.

References

  1. 1.
    Al-Tamimi A, Lewis FL (2007) Discrete-time nonlinear HJB solution using approximate dynamic programming: convergence proof. In: Proceedings of IEEE international symposium on approximate dynamic programming and reinforcement learning, Honolulu, HI, pp 38–43 CrossRefGoogle Scholar
  2. 2.
    Al-Tamimi A, Abu-Khalaf M, Lewis FL (2007) Adaptive critic designs for discrete-time zero-sum games with application to H∞ control. IEEE Trans Syst Man Cybern, Part B, Cybern 37:240–247 CrossRefGoogle Scholar
  3. 3.
    Al-Tamimi A, Lewis FL, Abu-Khalaf M (2008) Discrete-time nonlinear HJB solution using approximate dynamic programming: convergence proof. IEEE Trans Syst Man Cybern, Part B, Cybern 38:943–949 CrossRefGoogle Scholar
  4. 4.
    Ben-Israel A, Greville TNE (2002) Generalized inverse: theory and applications. Springer, New York Google Scholar
  5. 5.
    Chyung DH (1967) Discrete systems with time delay. Presented at the 5th annals Allerton conference on circuit and system theory, Urbana Google Scholar
  6. 6.
    Chyung DH (1968) Discrete optimal systems with time delay. IEEE Trans Autom Control 13:117 CrossRefGoogle Scholar
  7. 7.
    Chyung DH, Lee EB (1966) Linear optimal systems with time delays. SIAM J Control 4(3):548–575 MathSciNetzbMATHCrossRefGoogle Scholar
  8. 8.
    Isidori A (2005) Nonlinear control systems II. Springer, Berlin Google Scholar
  9. 9.
    Liao X, Wang L, Yu P (2007) Stability of dynamical systems. Elsevier, Amsterdam zbMATHGoogle Scholar
  10. 10.
    Manu MZ, Mohammad J (1987) Time-delay systems analysis, optimization and applications. North-Holland, New York zbMATHGoogle Scholar
  11. 11.
    Wei QL, Zhang HG, Liu DR, Zhao Y (2010) An optimal control scheme for a class of discrete-time nonlinear systems with time delays using adaptive dynamic programming. Acta Autom Sin 36:121–129 MathSciNetzbMATHCrossRefGoogle Scholar
  12. 12.
    Zhang HG, Song RZ (2011) Optimal tracking control for a class of nonlinear discrete-time systems with time delays based on heuristic dynamic programming. IEEE Trans Neural Netw 22(12):1851–1862 CrossRefGoogle Scholar
  13. 13.
    Zhang HG, Wei QL, Luo YH (2008) A novel infinite-time optimal tracking control scheme for a class of discrete-time nonlinear systems via the greedy HDP iteration algorithm. IEEE Trans Syst Man Cybern, Part B, Cybern 38:937–942 CrossRefGoogle Scholar

Copyright information

© Springer-Verlag London 2013

Authors and Affiliations

  • Huaguang Zhang
    • 1
  • Derong Liu
    • 2
  • Yanhong Luo
    • 1
  • Ding Wang
    • 2
  1. 1.College of Information Science Engin.Northeastern UniversityShenyangPeople’s Republic of China
  2. 2.Institute of Automation, Laboratory of Complex SystemsChinese Academy of SciencesBeijingPeople’s Republic of China

Personalised recommendations