Skip to main content

Potential Self-Tuning Analysis of Stochastic Adaptive Control

  • Conference paper

Part of the book series: The IMA Volumes in Mathematics and its Applications ((IMA,volume 74))

Abstract

In this paper we present the first stage of a unified two-stage approach to analyzing stochastic adaptive control. In the first stage, we study the issue of potential self-tuning where we ask the question whether a certainty-equivalence adaptive control scheme achieves the same control objective as the ideal control design at the potential convergence points of the estimation algorithm. We exploit the fact that this important property can be analyzed independent of the estimation method that is used, without restoring to complicated convergence analysis. For linear time-invariant systems, this reduces to simply studying two identifiability equations; the Identifiability Equation for Internal Excitation (IEIE) and the Identifiability Equation for External Excitation (IE3) whose solutions determine the potential convergence points of the parameter estimates. Sufficient conditions and necessary conditions are then derived for potential self-tuning and identifiability of general control schemes. Applications of these general results to specific adaptive control policies then show that regardless of the external excitation, the certainty-equivalence adaptive control based on generalized Minimum-Variance, generalized predictive, and pole-placement control are potentially self-tuning. On the other hand, the LQG feedforward and feedback control designs are shown to require sufficient external excitation. In the next stage, we will show how to proceed from potential self-tuning to asymptotic self-tuning.

This research has been supported by the NSF grant FD92-11025-REN.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. K.J. Astrom AND B. Wittenmark, On self-tuning regulators, Automatica 9 (1973), pp. 185–199.

    Article  Google Scholar 

  2. K.J. Astrom, AND B. Wittenmark, Adaptive Control, Addison-Wesley, 1989.

    Google Scholar 

  3. R.R. Bitmead, M. Gevers AND V. Wertz, Adaptive Control, the Thinking Man’s GPC, Prentice-Hall, 1990.

    Google Scholar 

  4. H.F. Chen AND L. Guo, Identification and Stochastic Adaptive Control, Birkhäuser, 1991.

    Google Scholar 

  5. D.W. Clarke, C. Mohtadi, AND P.S. Tuffs, Generalized predictive control— Parts I & II: the basic algorithm & extensions and interpretations, Automatica, 23(2) (1987), pp. 137–160.

    Article  MATH  Google Scholar 

  6. N.M. Kogan AND Y.I. Neimark, Study of identifiabiiity in adaptive control systems by averaging method, Automation and Remote Control, 50(3) (1989), pp. 374–380.

    MathSciNet  MATH  Google Scholar 

  7. N.M. Kogan AND Y.I. Neimark, Adaptive control of a stochastic system with un-observable state under conditions of unidentifiability, Automation and Remote Control, 53(6) (1992), pp. 884–891.

    MathSciNet  Google Scholar 

  8. T.L. Lai AND Z.L. Ying, Parallel recursive algorithms in asymptotically efficient adaptive control of linear stochastic systems, SIAM J. Control & Optimization, 29(5) (1991), pp. 1091–1127.

    Article  MathSciNet  MATH  Google Scholar 

  9. W. Lin, P.R. Kumar AND T.I. Seidman, Will the self-tuning approach work for general criteria?, Systems & Control Letters, 6 (1985), pp. 77–85.

    Article  MathSciNet  MATH  Google Scholar 

  10. L. Ljung AND T. Soderstrom, Theory and Practice of Recursive Identification, MIT Press, 1983.

    Google Scholar 

  11. A.S. Morse, Towards a unified theory of parameter adaptive control: tunability, IEEE Trans. Aut. Control, AC-35(9) (1990), pp. 1002–1012.

    Article  MathSciNet  Google Scholar 

  12. A.S. Morse, Towards a unified theory of parameter adaptive control—part II: certainty equivalence and implicit tuning, IEEE Trans. Aut. Control, AC-37(1) (1992), pp. 15–29.

    Article  MathSciNet  Google Scholar 

  13. K. Nassiri-Toussi AND W. Ren, On asymptotic properties of the LQG feedforward self-tuner, Int. J. Control (to appear). Also in Proceedings of the 1993 American Control Conference, (1993), pp. 1354–1358.

    Google Scholar 

  14. K. Nassiri-Toussi AND W. Ren, Indirect adaptive pole-placement control of MIMO stochastic systems: self-tuning results (To be presented at the 33rd IEEE Conference on Decision and Control, (1994)).

    Google Scholar 

  15. R. Ortega AND G. Sanchez-Galindo, Globally convergent multistep receding horizon adaptive controller, Int. J. Control, 49(5) (1989), pp. 1655–1664.

    Google Scholar 

  16. J.W. Polderman, A note on the structure of two subsets of the parameter space in adaptive control problems, Tech. Report OS-R8509, Center for Mathematics and Computer Science, The Netherlands (1986).

    Google Scholar 

  17. J.W. Polderman, Adaptive Control and Identification: Conflict or Conflux?, Centrum voor Wiskunde en Informatica, CWI Tract, 67, 1987.

    Google Scholar 

  18. J.W. Polderman AND C. Praagman, The closed-loop identification problem in indirect adaptive control, Proc. of the 1989 IEEE Conference on Decision and Control, Tampa, FL (1989), pp. 2120–2124.

    Google Scholar 

  19. W. Ren AND P.R. Kumar, Stochastic adaptive system theory: recent advances and a reappraisal, Foundations of Adaptive Control (P.V. Kokotovic, ED.,) Springer-Verlag, 1991, pp. 269–307.

    Google Scholar 

  20. S. Sastry AND M. Bodson, Adaptive Control: Stability, Convergence, and Robustness, Prentice-Hall, 1989.

    Google Scholar 

  21. J.H. Van Schuppen, Tuning of gaussian stochastic control systems, Technical Report BS-R9223, Centrum voor Wiskunde en Informatica (1992).

    Google Scholar 

  22. B.G. Vorchik, Limit properties of adaptive control systems with identification (Using the identifiabiiity equations), I. One-input one-output plants, Automation and Remote Control, 49(6) (1988), pp. 765–777.

    MathSciNet  MATH  Google Scholar 

  23. B.G. Vorchik AND O.A. Gaisin, Limit properties of adaptive control systems with identification (using the identifiabiiity equations) II: Multivariable plants, Automation and Remote Control, 51(4) (1990), pp. 495–506.

    MathSciNet  MATH  Google Scholar 

  24. W. Wang AND R. Henriksen, Direct adaptive generalized predictive control, Modeling Identification and Control, 14(4) (1993), pp. 181–191.

    Article  MathSciNet  Google Scholar 

  25. P.E. Wellstead AND M.B. Zarrop, Self-Tuning Systems: Control and Signal Processing, John Wiley, 1991.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1995 Springer Science+Business Media New York

About this paper

Cite this paper

Nassiri-Toussi, K., Ren, W. (1995). Potential Self-Tuning Analysis of Stochastic Adaptive Control. In: Åström, K.J., Goodwin, G.C., Kumar, P.R. (eds) Adaptive Control, Filtering, and Signal Processing. The IMA Volumes in Mathematics and its Applications, vol 74. Springer, New York, NY. https://doi.org/10.1007/978-1-4419-8568-2_12

Download citation

  • DOI: https://doi.org/10.1007/978-1-4419-8568-2_12

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4612-6439-2

  • Online ISBN: 978-1-4419-8568-2

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics