Optimal Tracking Control of Nonlinear Systems with Time Delays
In this chapter, the optimal tracking control problems of nonlinear systems with time delays are studied using HDP algorithm. First, the HJB equation for discrete time-delay systems is derived based on state error and control error. Then, a novel iterative HDP algorithm containing the iterations of state, control law, and cost functional is developed. We also give the convergence proof for the present iterative HDP algorithm. Finally, two neural networks, i.e., the critic neural network and the action neural network, are used to approximate the value function and the corresponding control law, respectively. It is the first time that the optimal tracking control problem of nonlinear systems with time delays is solved using the HDP algorithm. Two examples are used to demonstrate the effectiveness of the present control scheme.
- 4.Ben-Israel A, Greville TNE (2002) Generalized inverse: theory and applications. Springer, New York Google Scholar
- 5.Chyung DH (1967) Discrete systems with time delay. Presented at the 5th annals Allerton conference on circuit and system theory, Urbana Google Scholar
- 8.Isidori A (2005) Nonlinear control systems II. Springer, Berlin Google Scholar