Advertisement

Adaptive Dynamic Programming with Applications in Optimal Control

  • Derong Liu
  • Qinglai Wei
  • Ding Wang
  • Xiong Yang
  • Hongliang Li

Part of the Advances in Industrial Control book series (AIC)

Table of contents

  1. Front Matter
    Pages i-xxx
  2. Derong Liu, Qinglai Wei, Ding Wang, Xiong Yang, Hongliang Li
    Pages 1-33
  3. Discrete-Time Systems

    1. Front Matter
      Pages 35-35
    2. Derong Liu, Qinglai Wei, Ding Wang, Xiong Yang, Hongliang Li
      Pages 37-90
    3. Derong Liu, Qinglai Wei, Ding Wang, Xiong Yang, Hongliang Li
      Pages 91-149
    4. Derong Liu, Qinglai Wei, Ding Wang, Xiong Yang, Hongliang Li
      Pages 151-175
    5. Derong Liu, Qinglai Wei, Ding Wang, Xiong Yang, Hongliang Li
      Pages 177-221
    6. Derong Liu, Qinglai Wei, Ding Wang, Xiong Yang, Hongliang Li
      Pages 223-264
  4. Continuous-Time Systems

    1. Front Matter
      Pages 265-265
    2. Derong Liu, Qinglai Wei, Ding Wang, Xiong Yang, Hongliang Li
      Pages 267-307
    3. Derong Liu, Qinglai Wei, Ding Wang, Xiong Yang, Hongliang Li
      Pages 309-344
    4. Derong Liu, Qinglai Wei, Ding Wang, Xiong Yang, Hongliang Li
      Pages 345-386
    5. Derong Liu, Qinglai Wei, Ding Wang, Xiong Yang, Hongliang Li
      Pages 387-415
    6. Derong Liu, Qinglai Wei, Ding Wang, Xiong Yang, Hongliang Li
      Pages 417-480
  5. Applications

    1. Front Matter
      Pages 481-481
    2. Derong Liu, Qinglai Wei, Ding Wang, Xiong Yang, Hongliang Li
      Pages 483-535
    3. Derong Liu, Qinglai Wei, Ding Wang, Xiong Yang, Hongliang Li
      Pages 537-569
    4. Derong Liu, Qinglai Wei, Ding Wang, Xiong Yang, Hongliang Li
      Pages 571-590
  6. Back Matter
    Pages 591-594

About this book

Introduction

This book covers the most recent developments in adaptive dynamic programming (ADP). The text begins with a thorough background review of ADP making sure that readers are sufficiently familiar with the fundamentals. In the core of the book, the authors address first discrete- and then continuous-time systems. Coverage of discrete-time systems starts with a more general form of value iteration to demonstrate its convergence, optimality, and stability with complete and thorough theoretical analysis. A more realistic form of value iteration is studied where value function approximations are assumed to have finite errors. Adaptive Dynamic Programming also details another avenue of the ADP approach: policy iteration. Both basic and generalized forms of policy-iteration-based ADP are studied with complete and thorough theoretical analysis in terms of convergence, optimality, stability, and error bounds. Among continuous-time systems, the control of affine and nonaffine nonlinear systems is studied using the ADP approach which is then extended to other branches of control theory including decentralized control, robust and guaranteed cost control, and game theory. In the last part of the book the real-world significance of ADP theory is presented, focusing on three application examples developed from the authors’ work:

• renewable energy scheduling for smart power grids;
• coal gasification processes; and
• water–gas shift reactions.

Researchers studying intelligent control methods and practitioners looking to apply them in the chemical-process and power-supply industries will find much to interest them in this thorough treatment of an advanced approach to control.

Advances in Industrial Control aims to report and encourage the transfer of technology in control engineering. The rapid development of control technology has an impact on all areas of the control discipline. The series offers an opportunity for researchers to present an extended exposition of new work in all aspects of industrial control.

Keywords

ADP Approach Approximate Dynamic Programming Deterministic Systems Intelligent Control Learning Control Neural Networks Neuro-dynamic Programming Optimal Control Policy Iteration Reinforcement Learning Sub-optimal Control

Authors and affiliations

  • Derong Liu
    • 1
  • Qinglai Wei
    • 2
  • Ding Wang
    • 3
  • Xiong Yang
    • 4
  • Hongliang Li
    • 5
  1. 1.University of Science and Technology BeijingBeijingChina
  2. 2.Chinese Academy of SciencesInstitute of AutomationBeijingChina
  3. 3.Chinese Academy of Sciences Institute of AutomatioBeijingChina
  4. 4.Tianjin University TianjinChina
  5. 5.IBM Research - ChinaBeijingChina

Bibliographic information

  • DOI https://doi.org/10.1007/978-3-319-50815-3
  • Copyright Information Springer International Publishing AG 2017
  • Publisher Name Springer, Cham
  • eBook Packages Engineering
  • Print ISBN 978-3-319-50813-9
  • Online ISBN 978-3-319-50815-3
  • Series Print ISSN 1430-9491
  • Series Online ISSN 2193-1577
  • Buy this book on publisher's site