Abstract
In this chapter, the optimal tracking control problems of nonlinear systems with time delays are studied using HDP algorithm. First, the HJB equation for discrete time-delay systems is derived based on state error and control error. Then, a novel iterative HDP algorithm containing the iterations of state, control law, and cost functional is developed. We also give the convergence proof for the present iterative HDP algorithm. Finally, two neural networks, i.e., the critic neural network and the action neural network, are used to approximate the value function and the corresponding control law, respectively. It is the first time that the optimal tracking control problem of nonlinear systems with time delays is solved using the HDP algorithm. Two examples are used to demonstrate the effectiveness of the present control scheme.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Al-Tamimi A, Lewis FL (2007) Discrete-time nonlinear HJB solution using approximate dynamic programming: convergence proof. In: Proceedings of IEEE international symposium on approximate dynamic programming and reinforcement learning, Honolulu, HI, pp 38–43
Al-Tamimi A, Abu-Khalaf M, Lewis FL (2007) Adaptive critic designs for discrete-time zero-sum games with application to H∞ control. IEEE Trans Syst Man Cybern, Part B, Cybern 37:240–247
Al-Tamimi A, Lewis FL, Abu-Khalaf M (2008) Discrete-time nonlinear HJB solution using approximate dynamic programming: convergence proof. IEEE Trans Syst Man Cybern, Part B, Cybern 38:943–949
Ben-Israel A, Greville TNE (2002) Generalized inverse: theory and applications. Springer, New York
Chyung DH (1967) Discrete systems with time delay. Presented at the 5th annals Allerton conference on circuit and system theory, Urbana
Chyung DH (1968) Discrete optimal systems with time delay. IEEE Trans Autom Control 13:117
Chyung DH, Lee EB (1966) Linear optimal systems with time delays. SIAM J Control 4(3):548–575
Isidori A (2005) Nonlinear control systems II. Springer, Berlin
Liao X, Wang L, Yu P (2007) Stability of dynamical systems. Elsevier, Amsterdam
Manu MZ, Mohammad J (1987) Time-delay systems analysis, optimization and applications. North-Holland, New York
Wei QL, Zhang HG, Liu DR, Zhao Y (2010) An optimal control scheme for a class of discrete-time nonlinear systems with time delays using adaptive dynamic programming. Acta Autom Sin 36:121–129
Zhang HG, Song RZ (2011) Optimal tracking control for a class of nonlinear discrete-time systems with time delays based on heuristic dynamic programming. IEEE Trans Neural Netw 22(12):1851–1862
Zhang HG, Wei QL, Luo YH (2008) A novel infinite-time optimal tracking control scheme for a class of discrete-time nonlinear systems via the greedy HDP iteration algorithm. IEEE Trans Syst Man Cybern, Part B, Cybern 38:937–942
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag London
About this chapter
Cite this chapter
Zhang, H., Liu, D., Luo, Y., Wang, D. (2013). Optimal Tracking Control of Nonlinear Systems with Time Delays. In: Adaptive Dynamic Programming for Control. Communications and Control Engineering. Springer, London. https://doi.org/10.1007/978-1-4471-4757-2_5
Download citation
DOI: https://doi.org/10.1007/978-1-4471-4757-2_5
Publisher Name: Springer, London
Print ISBN: 978-1-4471-4756-5
Online ISBN: 978-1-4471-4757-2
eBook Packages: EngineeringEngineering (R0)