Abstract
In this paper we present the first stage of a unified two-stage approach to analyzing stochastic adaptive control. In the first stage, we study the issue of potential self-tuning where we ask the question whether a certainty-equivalence adaptive control scheme achieves the same control objective as the ideal control design at the potential convergence points of the estimation algorithm. We exploit the fact that this important property can be analyzed independent of the estimation method that is used, without restoring to complicated convergence analysis. For linear time-invariant systems, this reduces to simply studying two identifiability equations; the Identifiability Equation for Internal Excitation (IEIE) and the Identifiability Equation for External Excitation (IE3) whose solutions determine the potential convergence points of the parameter estimates. Sufficient conditions and necessary conditions are then derived for potential self-tuning and identifiability of general control schemes. Applications of these general results to specific adaptive control policies then show that regardless of the external excitation, the certainty-equivalence adaptive control based on generalized Minimum-Variance, generalized predictive, and pole-placement control are potentially self-tuning. On the other hand, the LQG feedforward and feedback control designs are shown to require sufficient external excitation. In the next stage, we will show how to proceed from potential self-tuning to asymptotic self-tuning.
This research has been supported by the NSF grant FD92-11025-REN.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
K.J. Astrom AND B. Wittenmark, On self-tuning regulators, Automatica 9 (1973), pp. 185–199.
K.J. Astrom, AND B. Wittenmark, Adaptive Control, Addison-Wesley, 1989.
R.R. Bitmead, M. Gevers AND V. Wertz, Adaptive Control, the Thinking Man’s GPC, Prentice-Hall, 1990.
H.F. Chen AND L. Guo, Identification and Stochastic Adaptive Control, Birkhäuser, 1991.
D.W. Clarke, C. Mohtadi, AND P.S. Tuffs, Generalized predictive control— Parts I & II: the basic algorithm & extensions and interpretations, Automatica, 23(2) (1987), pp. 137–160.
N.M. Kogan AND Y.I. Neimark, Study of identifiabiiity in adaptive control systems by averaging method, Automation and Remote Control, 50(3) (1989), pp. 374–380.
N.M. Kogan AND Y.I. Neimark, Adaptive control of a stochastic system with un-observable state under conditions of unidentifiability, Automation and Remote Control, 53(6) (1992), pp. 884–891.
T.L. Lai AND Z.L. Ying, Parallel recursive algorithms in asymptotically efficient adaptive control of linear stochastic systems, SIAM J. Control & Optimization, 29(5) (1991), pp. 1091–1127.
W. Lin, P.R. Kumar AND T.I. Seidman, Will the self-tuning approach work for general criteria?, Systems & Control Letters, 6 (1985), pp. 77–85.
L. Ljung AND T. Soderstrom, Theory and Practice of Recursive Identification, MIT Press, 1983.
A.S. Morse, Towards a unified theory of parameter adaptive control: tunability, IEEE Trans. Aut. Control, AC-35(9) (1990), pp. 1002–1012.
A.S. Morse, Towards a unified theory of parameter adaptive control—part II: certainty equivalence and implicit tuning, IEEE Trans. Aut. Control, AC-37(1) (1992), pp. 15–29.
K. Nassiri-Toussi AND W. Ren, On asymptotic properties of the LQG feedforward self-tuner, Int. J. Control (to appear). Also in Proceedings of the 1993 American Control Conference, (1993), pp. 1354–1358.
K. Nassiri-Toussi AND W. Ren, Indirect adaptive pole-placement control of MIMO stochastic systems: self-tuning results (To be presented at the 33rd IEEE Conference on Decision and Control, (1994)).
R. Ortega AND G. Sanchez-Galindo, Globally convergent multistep receding horizon adaptive controller, Int. J. Control, 49(5) (1989), pp. 1655–1664.
J.W. Polderman, A note on the structure of two subsets of the parameter space in adaptive control problems, Tech. Report OS-R8509, Center for Mathematics and Computer Science, The Netherlands (1986).
J.W. Polderman, Adaptive Control and Identification: Conflict or Conflux?, Centrum voor Wiskunde en Informatica, CWI Tract, 67, 1987.
J.W. Polderman AND C. Praagman, The closed-loop identification problem in indirect adaptive control, Proc. of the 1989 IEEE Conference on Decision and Control, Tampa, FL (1989), pp. 2120–2124.
W. Ren AND P.R. Kumar, Stochastic adaptive system theory: recent advances and a reappraisal, Foundations of Adaptive Control (P.V. Kokotovic, ED.,) Springer-Verlag, 1991, pp. 269–307.
S. Sastry AND M. Bodson, Adaptive Control: Stability, Convergence, and Robustness, Prentice-Hall, 1989.
J.H. Van Schuppen, Tuning of gaussian stochastic control systems, Technical Report BS-R9223, Centrum voor Wiskunde en Informatica (1992).
B.G. Vorchik, Limit properties of adaptive control systems with identification (Using the identifiabiiity equations), I. One-input one-output plants, Automation and Remote Control, 49(6) (1988), pp. 765–777.
B.G. Vorchik AND O.A. Gaisin, Limit properties of adaptive control systems with identification (using the identifiabiiity equations) II: Multivariable plants, Automation and Remote Control, 51(4) (1990), pp. 495–506.
W. Wang AND R. Henriksen, Direct adaptive generalized predictive control, Modeling Identification and Control, 14(4) (1993), pp. 181–191.
P.E. Wellstead AND M.B. Zarrop, Self-Tuning Systems: Control and Signal Processing, John Wiley, 1991.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1995 Springer Science+Business Media New York
About this paper
Cite this paper
Nassiri-Toussi, K., Ren, W. (1995). Potential Self-Tuning Analysis of Stochastic Adaptive Control. In: Åström, K.J., Goodwin, G.C., Kumar, P.R. (eds) Adaptive Control, Filtering, and Signal Processing. The IMA Volumes in Mathematics and its Applications, vol 74. Springer, New York, NY. https://doi.org/10.1007/978-1-4419-8568-2_12
Download citation
DOI: https://doi.org/10.1007/978-1-4419-8568-2_12
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4612-6439-2
Online ISBN: 978-1-4419-8568-2
eBook Packages: Springer Book Archive