Developing nonlinear adaptive optimal regulators through an improved neural learning mechanism

This is a preview of subscription content, access via your institution.


  1. 1

    Werbos P J. Approximate dynamic programming for real-time control and neural modeling. In: Handbook of Intelligent Control: Neural, Fuzzy, and Adaptive Approaches. New York: Van Nostrand Reinhold, 1992. 15: 493–525

    Google Scholar 

  2. 2

    Vamvoudakis K G, Lewis F L. Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem. Automatica, 2010, 46: 878–888

    MathSciNet  Article  MATH  Google Scholar 

  3. 3

    Lewis F L, Vrabie D, Vamvoudakis K G. Reinforcement learning and feedback control: using natural decision methods to design optimal adaptive controllers. IEEE Control Syst Mag, 2012, 32: 76–105

    MathSciNet  Article  Google Scholar 

  4. 4

    Zhang H, Cui L, Luo Y. Near-optimal control for nonzero-sum differential games of continuous-time nonlinear systems using single-network ADP. IEEE Trans Cyber, 2013, 43: 206–216

    Article  Google Scholar 

  5. 5

    Mu C, Sun C, Song A, et al. Iterative GDHPbased approximate optimal tracking control for a class of discrete-time nonlinear systems. Neurocomputing, 2016, 214: 775–784

    Article  Google Scholar 

  6. 6

    Wang D, Liu D, Zhang Q, et al. Data-based adaptive critic designs for nonlinear robust optimal control with uncertain dynamics. IEEE Trans Syst Man Cyber Syst, 2016, 46: 1544–1555

    Article  Google Scholar 

  7. 7

    Gao W, Jiang Y, Jiang Z P, et al. Output-feedback adaptive optimal control of interconnected systems based on robust adaptive dynamic programming. Automatica, 2016, 72: 37–45

    MathSciNet  Article  MATH  Google Scholar 

  8. 8

    Sahoo A, Xu H, Jagannathan S. Approximate optimal control of affine nonlinear continuous-time systems using event-sampled neurodynamic programming. IEEE Trans Neural Netw Learn Syst, 2017, 28: 639–652

    Article  Google Scholar 

  9. 9

    Narayanan V, Jagannathan S. Distributed adaptive optimal regulation of uncertain large-scale interconnected systems using hybrid Q-learning approach. IET Control Theory Appl, 2016, 10: 1448–1457

    MathSciNet  Article  Google Scholar 

  10. 10

    Fu Q, Gu P P, Wu J R. Iterative learning control for one-dimensional fourth order distributed parameter systems. Sci China Inf Sci, 2017, 60: 012204

    Article  Google Scholar 

Download references


This work was supported by National Natural Science Foundation of China (Grant Nos. 61233001, 61273140, 61304018, 61304086, 61533017, U1501251), Beijing Natural Science Foundation (Grant No. 4162065), Tianjin Natural Science Foundation (Grant No. 14JCQNJC05400), Early Career Development Award of SKLMCCS, and Research Fund of Tianjin Key Laboratory of Process Measurement and Control (Grant No. TKLPMC-201612).

Author information



Corresponding author

Correspondence to Chaoxu Mu.

Additional information

The authors declare that they have no conflict of interest.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Wang, D., Mu, C. Developing nonlinear adaptive optimal regulators through an improved neural learning mechanism. Sci. China Inf. Sci. 60, 058201 (2017).

Download citation