Abstract
In this chapter, several special optimal feedback control schemes will be investigated. In the first part, the optimal feedback control problem of affine nonlinear switched systems is studied. To seek optimal solutions, a novel two-stage adaptive dynamic programming (TSADP) method is developed. The algorithm can be divided into two stages: first, for each possible mode, calculate the associated value function, and then select the optimal mode for each state. In the second and third parts, the near-optimal controllers for nonlinear descriptor systems and singularly perturbed systems are solved by iterative DHP and HDP algorithms, respectively. In the fourth part, the near-optimal state-feedback control problem of nonlinear constrained discrete-time systems is solved via a single network ADP algorithm. At each step of the iterative algorithm, a neural network is utilized to approximate the costate function, and then the optimal control policy of the system can be computed directly according to the costate function, which removes the action network appearing in the ordinary ADP method.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Al-Tamimi A, Lewis F, Abu-Khalaf M (2008) Discrete-time nonlinear HJB solution using approximate dynamic programming: convergence proof. IEEE Trans Syst Man Cybern, Part B, Cybern 38:943–949
Beard R (1995) Improving the closed-loop performance of nonlinear systems. PhD dissertation, Rensselaer Polytechnic Institute, Troy, NY
Cao N, Zhang HG, Luo YH, Feng DZ, Liu Y (2011) Suboptimal control of a class of nonlinear singularly perturbed systems. Control Theory Appl 28(5):688–692
Cao N, Zhang HG, Luo YH, Feng DZ (2012) Infinite horizon optimal control of affine nonlinear discrete switched systems using two-stage approximate dynamic programming. Int J Syst Sci 43(9):1673–1682
Lincoln B, Rantzer A (2006) Relaxing dynamic programming. IEEE Trans Autom Control 51:1249–1260
Luo YH, Zhang HG, Cao N, Chen B (2009) Near-optimal stabilization for a class of nonlinear systems with control constraint based on single network greedy iterative DHP algorithm. Acta Autom Sin 35(11):1436–1445
Luo YH, Liu Z, Yang D (2010) Greedy iterative DHP algorithm-based near-optimal control for a class of nonlinear descriptor systems with actuator saturating. In: Proceedings of the 9th IEEE international conference on cognitive informatics, pp 788–793
Lyshevski SE (1998) Nonlinear discrete-time systems: constrained optimization and application of nonquadratic costs. In: Proceedings of the American control conference, Philadelphia, USA, pp 3699–3703
Padhi R, Unnikrishnan N, Wang X, Balakrishnan SN (2006) A single network adaptive critic (SNAC) architecture for optimal control synthesis for a class of nonlinear systems. Neural Netw 19(10):1648–1660
Rantzer A (2005) On approximate dynamic programming in switching systems. In: Proceeding of the IEEE conference on decision and control and the European control conference, Seville, Spain, pp 1391–1396
Seatzu C, Corona D, Giua A, Bempoard A (2006) Optimal control of continuous time switched affine systems. IEEE Trans Autom Control 51:726–741
Xu XP, Antsaklis PJ (2000) Optimal control of switched systems: new results and open problems. In: Proceeding of the American control conference, Chicago, Illinois, pp 2683–2687
Xu XP, Antsaklis PJ (2003) Results and perspectives on computational methods for optimal control of switched systems. Hybrid systems: computation and control (HSCC). Springer, Berlin, pp 540–555
Yang H, Jiang B, Cocquempot V, Zhang HG (2011) Stabilization of switched nonlinear systems with all unstable modes: application to multi-agent systems. IEEE Trans Autom Control 56(9):2230–2235
Zhang W, Hu J, Abate A (2009) On the value functions of the discrete-time switched LQR problem. IEEE Trans Autom Control 54:2669–2674
Zhang HG, Liu Z, Huang GB (2010) Novel delay-dependent robust stability analysis for switched neutral-type neural network with time-varying delays via SC technique. IEEE Trans Syst Man Cybern, Part B, Cybern 40(6):1480–1491
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag London
About this chapter
Cite this chapter
Zhang, H., Liu, D., Luo, Y., Wang, D. (2013). Several Special Optimal Feedback Control Designs Based on ADP. In: Adaptive Dynamic Programming for Control. Communications and Control Engineering. Springer, London. https://doi.org/10.1007/978-1-4471-4757-2_7
Download citation
DOI: https://doi.org/10.1007/978-1-4471-4757-2_7
Publisher Name: Springer, London
Print ISBN: 978-1-4471-4756-5
Online ISBN: 978-1-4471-4757-2
eBook Packages: EngineeringEngineering (R0)