Minimum-variance and self-tuning control

  • M. H. A. Davis
  • R. B. Vinter
Part of the Monographs on Statistics and Applied Probability book series (MSAP)


In Chapter 6 we have studied LQG control system design for state-space models. Since ARMAX models can be realized in state-space form, the results apply equally to ARMAX models. In either case, it is supposed that the parameters of the model are precisely known. On the other hand, we have presented in Chapter 4 techniques for identifying unknown systems from input/output data. Is it possible to combine these techniques and design controllers for ‘unknown’ systems involving some kind of on-line combination of identification and control? The general area to control system design for imperfectly known (and possible time-varying) systems is known as adaptive control and has been the subject of extensive study over many years. In this chapter we do not attempt any overall coverage of this area (which would require at least a whole book in itself) but restrict ourselves to discussing two key ideas — minimum-variance control and self-tuning regulators — which are closely related to the material of the preceding chapters. Both of these ideas are in their present form due to K.J. Åström and co-workers (1970,1973) and have since burgeoned into a minor industry (quite literally, in that computer controllers incorporating these concepts are now commercially available). We also discuss the related ideas of pole-shifting regulators, which retain more links to classical control system design, and were introduced by Wellstead and co-workers (1979).


Adaptive Control Minimum Variance Control System Design Algebraic Riccati Equation Model Reference Adaptive Control 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Åström, K. J. (1970) Stochastic Control Theory, Academic Press, New York.Google Scholar
  2. Åström, K. J. (1983) Theory and applications of adaptive control — a survey. Automatica, 19, 471 – 486.CrossRefGoogle Scholar
  3. Åström, K. J. and Wittenmark, B. (1973) On self-tuning regulators. Automatica, 9, 185 – 199.CrossRefGoogle Scholar
  4. Åström, K. J., Borisson, U., Ljung, L. and Wittenmark, B. W. (1977) Theory and applications of self-tuning regulators. Automatica, 13, 457 – 476.CrossRefGoogle Scholar
  5. Box, G. E. P. and Jenkins, G. M. (1962) Some statistical aspects of adaptive optimization and control. JRSS, B24, 297 – 343.Google Scholar
  6. Burt, E. G. C. and Rigby, L. (1982) Constrained minimum-variance control for minimum and non-minimum phase processes. Preprint, Department of Electrical Engineering, Imperial College, London.Google Scholar
  7. Caines, P. E. (1972) Relationships between Box-Jenkins- Åström control and Kalman linear regulators. Proc. IEE, 119, 615 – 620.Google Scholar
  8. Chen, H. F. and Caines, P. E. (1983) On the adaptive control of a class of systems with random parameters and disturbances, Preprint, McGill University, Montreal.Google Scholar
  9. Clarke, D. W. and Gawthrop, P. J. (1979) Self-tuning control. Proc. IEE, 126, 633 – 640.Google Scholar
  10. Goodwin, G. C., Ramadge, P. J. and Caines, P. E. (1981) Discrete-time stochastic adaptive control. SI AM J. Control and Optimization, 19, 829 – 853.CrossRefGoogle Scholar
  11. Goodwin, G. C. and Sin, K. S. (1984) Adaptive Filtering, Prediction and Control, Prentice Hall, Englewood Cliffs, NJ.Google Scholar
  12. Harris, C. J. and Billings, S. A. (eds) (1981) Self-tuning and Adaptive Control, Peter Peregrinus, Stevenage.Google Scholar
  13. Kushner, H. J. and Clarke, D. S. (1978) Stochastic Approximation Methods for Constrained and Unconstrained Systems, Springer-Verlag, New York.Google Scholar
  14. Landau, Y. D. (1981) Deterministic and stochastic model reference adaptive control. In Stochastic Systems(ed. M. Hazewinkel and J. C. Willems) D. Reidel, Dordrecht.Google Scholar
  15. Ljung, L. (1977) On positive real transfer functions and the convergence of some recursive schemes. IEEE Trans. Automatic Control, AC-22, 539 – 551.Google Scholar
  16. Neveu, J. (1975) Discrete Parameter Martingales, North Holland, Amsterdam.Google Scholar
  17. Sin, K. S. and Goodwin, G. C. (1982) Stochastic adaptive control using a modified least squares algorithm. Automatica, 18, 315 – 321.CrossRefGoogle Scholar
  18. Wellstead, P. E., Prager, D. and Zanker, P. (1979a) Pole assignment self- tuning regulator. Proc. IEE, 126, 781 – 787.Google Scholar
  19. Wellstead, P. E., Edmunds, J. M., Prager, D. and Zanker, P. (1979b) Self- tuning pole/zero assignment regulators. Int. J. Control, 30, 1 – 26.CrossRefGoogle Scholar
  20. Whittle, P. (1963) Prediction and Regulation, English Universities Press (reprinted (1984) Basil Blackwell, Oxford).Google Scholar
  21. Wittenmark, B. and Åström, K. J. (1984) Practical issues in the implementation of self-tuning control. Automatica, 20, 595 – 605.CrossRefGoogle Scholar
  22. Youla, D. C., Bongiorno, J. J. and Jabr, H. A. (1976) Modern Wiener-Hopf design of optimal controllers. IEEE Trans. Automatic Control, AC-21, 3 – 13.Google Scholar

Copyright information

© M. H. A. Davis and R. B. Vinter 1985

Authors and Affiliations

  • M. H. A. Davis
    • 1
  • R. B. Vinter
    • 1
  1. 1.Department of Electrical EngineeringImperial CollegeLondonUK

Personalised recommendations