Skip to main content

Part of the book series: Advances in Industrial Control ((AIC))

Abstract

The motivation of extremum seeking control is first presented, followed by a brief history of extremum seeking control and a literature overview of the last decades. The overview is separated in two parts: theory and applications. This distinction helps highlight the many problems of practical significance where extremum seeking control is a relevant design methodology; and at the same time, it provides the reader with a deeper understanding of the several available “flavors” of extremum seeking.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Some results in the ESC literature do make the assumption that J is known (see [14], for instance). Our approach here is to avoid having to make this assumption, since otherwise the practical value of the method is somewhat limited, in our view.

  2. 2.

    Philosophically, it may be useful to compare this difference to solving the regulation (or tracking) problem using state feedback versus output feedback. Both try to achieve the same ultimate objective, but the assumptions made about the available information profoundly alter the way one goes about achieving it.

References

  1. Drakunov, S.V., Özgüner, Ü, Dix, P., Ashrafi, B.: ABS control using optimum search via sliding modes. IEEE Transactions on Control Systems Technology (3), 79–85 (1995)

    Google Scholar 

  2. Tunay, İ.: Antiskid control for aircraft via extremum-seeking. In: Proceedings of the American Control Conference, vol. 2, pp. 665–670 (2001)

    Google Scholar 

  3. Ariyur, K.B., Krstić, M.: Real-time Optimization by Extremum-seeking Control. Wiley-Interscience, Hoboken (2003)

    Book  MATH  Google Scholar 

  4. Aström, K.J., Wittenmark, B.: Adaptive Control. Wiley, Boston (1994)

    Google Scholar 

  5. Wang, H.-H., Krstić, M., Bastin, G.: Optimizing bioreactors by extremum seeking. Int. J. Adapt. Control Signal Process. 13(8), 651–669 (1999)

    Article  MATH  Google Scholar 

  6. Zhang, T., Guay, M., Dochain, D.: Adaptive extremum seeking control of continuous stirred-tank bioreactors. AIChE J. 49(1), 113–123 (2003)

    Article  Google Scholar 

  7. Binetti, P., Ariyur, K.B., Krstić, M.: Control of formation flight via extremum seeking. In: Proceedings of the American Control Conference, vol. 4, pp. 2848–2853 (2002)

    Google Scholar 

  8. Killingsworth, N., Krstić, M.: PID tuning using extremum seeking. IEEE Control Syst. Mag. 26, 70–79 (2006)

    Article  MathSciNet  Google Scholar 

  9. Athans, M., Falb, P.: Optimal Control: an Introduction to the Theory and Its Applications. McGraw-Hill, New York (1966)

    Google Scholar 

  10. Kwakernaak, H., Sivan, R.: Linear Optimal Control Systems. Wiley, Boston (1972)

    MATH  Google Scholar 

  11. Lewis, F., Syrmos, V.: Optimal Control. Wiley, Boston (1995)

    Google Scholar 

  12. Allgöwer, F., Zheng, A.: Nonlinear Model Predictive Control. Birkhäuser, Basel (2000)

    Book  MATH  Google Scholar 

  13. Camacho, E., Bordons, C.: Model Predictive Control. Springer, London (2004)

    MATH  Google Scholar 

  14. Guay, M., Zhang, T.: Adaptive extremum seeking control of nonlinear dynamic systems with parametric uncertainties. Automatica 39(7), 1283–1293 (2003)

    Article  MathSciNet  MATH  Google Scholar 

  15. Lavretsky, E., Hovakimyan, N., Calise, A.: Adaptive extremum seeking control design. In: Proceedings of the American Control Conference, vol. 1, pp. 567–572 (2003)

    Google Scholar 

  16. Zhou, K., Doyle, J., Glover, K.: Robust and Optimal Control. Prentice Hall, Upper Saddle River (1996)

    MATH  Google Scholar 

  17. Nusawardhana, Żak, S.H.: Simultaneous perturbation extremum seeking method for dynamic optimization problems. In: Proceedings of the American Control Conference, pp. 2085–2810 (2004)

    Google Scholar 

  18. Rotea, M.A.: Analysis of multivariable extremum seeking algorithms. In: Proceedings of the American Control Conference, vol. 1, pp. 433–437 (2000)

    Google Scholar 

  19. Banavar, R.N., Chichka, D.F., Speyer, J.L.: Convergence and synthesis issues in extremum seeking control. In: Proceedings of the American Control Conference, vol. 1, pp. 438–443 (2000)

    Google Scholar 

  20. Hamza, M.H.: Extremum control of continuous systems. IEEE Trans. Autom. Control 11(2), 182–189 (1966)

    Article  MathSciNet  Google Scholar 

  21. Leblanc, M.: Sur l’electrification des chemins de fer au moyen de courants alternatifs de frequence elevee. Rev. Gen. Electr. (1922)

    Google Scholar 

  22. Sternby, J.: Extremum control systems: An area for adaptive control? In: Preprints of the Joint American Control Conference, 1980

    Google Scholar 

  23. Krstić, M., Wang, H.-H.: Design and stability analysis of extremum seeking feedback for general nonlinear systems. Automatica 36(2), 595–601 (2000)

    Article  MATH  Google Scholar 

  24. Krstić, M.: Performance improvement and limitations in extremum seeking control. Syst. Control Lett. 39(5), 313–326 (2000)

    Article  MATH  Google Scholar 

  25. Tan, Y., Moase, W.H., Manzie, C., Nesic, D., Mareels, I.M.Y.: Extremum seeking from 1922 to 2010. In: 29th Chinese Control Conference (CCC, 2010), pp. 14–26 (2010)

    Google Scholar 

  26. Pan, Y., Özgüner, Ü., Acarman, T.: Stability and performance improvement of extremum seeking control with sliding mode. Int. J. Control 76(9/10), 968–985 (2003)

    Article  MATH  Google Scholar 

  27. Nusawardhana, Żak, S.H.: Extremum seeking using analog nonderivative optimizers. In: Proceedings of the American Control Conference, vol. 4, pp. 3242–3247 (2003)

    Google Scholar 

  28. Meerkov, S.M.: Asymptotic methods for investigating quasistationary states in continuous systems of automatic optimization. Autom. Remote Control 11, 1726–1743 (1967)

    MathSciNet  Google Scholar 

  29. Meerkov, S.M.: Asymptotic methods for investigating a class of forced states in extremal systems. Autom. Remote Control 12, 1916–1920 (1967)

    MathSciNet  Google Scholar 

  30. Meerkov, S.M.: Asymptotic methods for investigating stability of continuous systems of automatic optimization subject to disturbance action. Avtom. Telemeh. 12, 14–24 (1967) (in Russian)

    Google Scholar 

  31. Choi, J.-Y., Krstić, M., Ariyur, K.B., Lee, J.S.: Extremum seeking control for discrete-time systems. IEEE Trans. Autom. Control 47(2), 318–323 (2002)

    Article  Google Scholar 

  32. Takata, H., Hachino, T., Tamura, R., Komatsu, K.: Design of extremum seeking control with accelerator. IEICE Trans. Fundam. Electron. Commun. Comput. Sci. E88-A(10), 2535–2540 (2005)

    Article  Google Scholar 

  33. Walsh, G.C.: On the application of multi-parameter extremum seeking control. In: Proceedings of the American Control Conference, vol. 1, pp. 411–415 (2000)

    Google Scholar 

  34. Ariyur, K.B., Krstić, M.: Analysis and design of multivariable extremum seeking. In: Proceedings of the American Control Conference, vol. 4, pp. 2903–2908 (2002)

    Google Scholar 

  35. Ariyur, K.B., Krstić, M.: Sloping seeking: a generalization of extremum seeking. Int. J. Adapt. Control Signal Process. 18(2), 1–22 (2002)

    Google Scholar 

  36. Tan, Y., Nešić, D., Mareels, I.: On non-local stability properties of extremum seeking control. Automatica 42(6), 889–903 (2006)

    Article  MathSciNet  MATH  Google Scholar 

  37. Tan, Y., Mareels, I., Nešić, D., Xu, J.-X.: Point-wise extremum seeking control under repeatable control environment. In: Proceedings of the 22nd IEEE International Symposium on Intelligent Control, pp. 237–242 (2007)

    Google Scholar 

  38. Tan, Y., Nešić, D., Mareels, I.: On the choice of dither in extremum seeking systems: A case study. Automatica 44(5), 1446–1450 (2008)

    Article  MathSciNet  Google Scholar 

  39. Tan, Y., Nešić, D., Mareels, I., Astolfi, A.: On global extremum seeking in the presence of local extrema. Automatica 45(1), 245–251 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  40. Zhang, C., Siranosian, A., Krstić, M.: Extremum seeking for moderately unstable systems and for autonomous target tracking without position measurements. In: Proceedings of the American Control Conference, pp. 4939–4944 (2006)

    Google Scholar 

  41. Manzie, C., Krstić, M.: Extremum seeking with stochastic perturbations. IEEE Trans. Autom. Control 54(3), 580–585 (2009)

    Article  Google Scholar 

  42. Liu, S.-J., Krstić, M.: Stochastic averaging in continuous time and its applications to extremum seeking. IEEE Trans. Autom. Control 55(10), 2235–2250 (2010)

    Article  Google Scholar 

  43. Mesquita, A.R., Hespanha, J.P., Aström, K.: Optimotaxis: a stochastic multiagent optimization procedure with point measurements. In: Egerstedt, M., Mishra, B. (eds.) Hybrid Systems: Computation and Control. Lecture Notes in Computer Science, vol. 4981, pp. 358–371 (2008)

    Chapter  Google Scholar 

  44. Moase, W.H., Manzie, C., Brear, M.J.: Newton-like extremum-seeking for the control of thermoacoustic instability. IEEE Trans. Autom. Control 55(9), 2094–2105 (2010)

    Article  MathSciNet  Google Scholar 

  45. Korovin, S.K., Utkin, V.I.: Use of the sliding mode in problems of static optimization. Autom. Remote Control 33, 570–579 (1972)

    Google Scholar 

  46. Korovin, S.K., Utkin, V.I.: Using sliding modes in static optimization and nonlinear programming. Automatica 10, 525–532 (1974)

    Article  MathSciNet  MATH  Google Scholar 

  47. Drakunov, S.V., Özgüner, Ü.: Optimization of nonlinear system output via sliding mode approach. In: Proceedings of the IEEE International Workshop on Variable Structure and Lyapunov Control of Uncertain Dynamical Systems, Sheffield, UK, pp. 61–62 (1992)

    Google Scholar 

  48. Winkelman, J., Haskara, I., Özgüner, Ü.: Tuning for dynamic spark advance control. In: Proceedings of the American Control Conference, pp. 163–164 (1999)

    Google Scholar 

  49. Haskara, I., Özgüner, Ü., Winkelman, J.: Extremum control for optimal operating point determination and set point optimizing via sliding modes. J. Dyn. Syst. Meas. Control 122(4), 719–724 (2000)

    Article  Google Scholar 

  50. Haskara, I., Hatipoglu, C., Özgüner, Ü.: Sliding mode compensation, estimation and optimization methods in automotive control. In: Yu, X., Xu, J.-X. (eds.) Variable Structure Systems: Towards the 21st Century. Lecture Notes in Control and Information Sciences, vol. 274, 155–174 (2002)

    Chapter  Google Scholar 

  51. Pan, Y., Acarman, T., Özgüner, Ü.: Nash solution by extremum seeking control approach. In: Proceedings of the Conference on Decision and Control, vol. 1, pp. 329–334 (2002)

    Google Scholar 

  52. Yu, H., Özgüner, Ü.: Extremum-seeking control via sliding mode with periodic search signals. In: Proceedings of the Conference on Decision and Control, vol. 1, pp. 323–328 (2002)

    Google Scholar 

  53. Yu, H., Özgüner, Ü.: Smooth extremum-seeking control via second order sliding mode. In: Proceedings of the American Control Conference, vol. 4, pp. 3248–3253 (2003)

    Google Scholar 

  54. Pan, Y., Özgüner, Ü.: Sliding mode extremum seeking control for linear quadratic dynamic game. In: Proceedings of the American Control Conference, pp. 614–619 (2004)

    Google Scholar 

  55. Fu, L., Özgüner, Ü.: Variable structure extremum seeking control based on sliding mode gradient estimation for a class of nonlinear systems. In: Proceedings of the American Control Conference, pp. 8–13 (2009)

    Google Scholar 

  56. Tan, H.S., Tomizuka, M.: An adaptive sliding mode vehicle traction controller design. In: Proceedings of the American Control Conference, pp. 1035–1058 (1989)

    Google Scholar 

  57. Yamanka, S., Ohmori, H.: Nonlinear adaptive extremum seeking control for time delayed index in the presence of deterministic disturbance. In: Proceedings of the PhysCon 2005, pp. 121–125 (2005)

    Google Scholar 

  58. Peixoto, A.J., Oliveira, T.R., Hsu, L.: Periodic switching function based sliding mode control applied to output-feedback extremum-seeking problem. In: 11th International Workshop on Variable Structure Systems (VSS, 2010), pp. 124–129 (2010)

    Chapter  Google Scholar 

  59. Chin, Y.K. et al.: Sliding mode ABS wheel slip control. In: Proceedings of the American Control Conference, pp. 1–6 (1992)

    Google Scholar 

  60. Haskara, I., Özgüner, Ü., Winkelman, J.: Wheel slip control for antispin acceleration via dynamic spark advance. Control Eng. Pract. 8(10), 1135–1148 (2000)

    Article  Google Scholar 

  61. Yu, H., Özgüner, Ü.: Extremum-seeking control strategy for ABS system with time delay. In: Proceedings of the American Control Conference, vol. 5, pp. 3753–3758 (2002)

    Google Scholar 

  62. Gros, S., Srinivasan, B., Bonvin, D.: Optimizing control based on output feedback. Comput. Chem. Eng. 33, 191–198 (2009)

    Article  Google Scholar 

  63. Speyer, J.L., Banavar, R.N., Chichka, D.F., Rhee, I.: Extremum seeking loops with assumed functions. In: Proceedings of the 39th Conference on Decision and Control, vol. 1, pp. 142–147 (2000)

    Google Scholar 

  64. Banavar, R.N., Chichka, D.F., Speyer, J.L.: Functional feedback in an extremum seeking loop. In: Proceedings of the 40th Conference on Decision and Control, vol. 2, pp. 1316–1321 (2001)

    Google Scholar 

  65. Banavar, R.N.: Extremum seeking loops with assumed functions: estimation and control. In: Proceedings of the American Control Conference, vol. 4, pp. 3159–3164 (2002)

    Google Scholar 

  66. Banavar, R.N., Chichka, D.F., Speyer, J.L.: Convergence and synthesis issues in extremum seeking control. Int. J. Adapt. Control Signal Process. 17, 751–762 (2003)

    Article  MATH  Google Scholar 

  67. Ryan, J.J., Speyer, J.L.: Peak-seeking control using gradient and hessian estimates. In: Proceedings of the American Control Conference, pp. 611–616 (2010)

    Google Scholar 

  68. Spooner, J.T., Maggiore, M., Ordóñez, R., Passino, K.M.: Stable Adaptive Control and Estimation for Nonlinear Systems, Neural and Fuzzy Approximator Techniques. Wiley, New York (2002)

    Book  Google Scholar 

  69. Li, P.Y., Horowitz, R.: Self-optimizing control. In: Proceedings of the Conference on Decision and Control, pp. 1228–1233 (1997)

    Google Scholar 

  70. Li, P.Y., Horowitz, R.: Control of smart exercise machine—part ii: Self-optimizing control. IEEE/ASME Trans. Mechatron. 2(4), 248–258 (1997)

    Article  Google Scholar 

  71. Shields, J., Horowitz, R.: Controller design and experimental verification of a self-optimizing motion controller for smart exercise machines. In: Proceedings of the American Control Conference, pp. 2736–2742 (1997)

    Google Scholar 

  72. Adetola, V., Dehaan, D., Guay, M.: Adaptive extremum seeking receding horizon control of nonlinear system. In: Proceedings of the American Control Conference, pp. 2937–2942 (2004)

    Google Scholar 

  73. Adetola, V., Guay, M.: Adaptive output feedback extremum seeking receding horizon control of linear systems. J. Process Control 16, 521–533 (2006)

    Article  Google Scholar 

  74. Dochain, D., Guay, M.: Extremum seeking control of state-constrained nonlinear systems. Automatica 41, 1567–1574 (2005)

    Article  Google Scholar 

  75. Guay, M., Peters, N.: Real-time dynamical optimization of nonlinear systems: A flatness-based approach. Comput. Chem. Eng. 30, 709–721 (2006)

    Article  Google Scholar 

  76. Adetola, V., Guay, M.: Parameter convergence in adaptive extremum-seeking control. Automatica 43(1), 105–110 (2007)

    Article  MathSciNet  Google Scholar 

  77. Teixeira, M.C.M., Żak, S.H.: Analog neural nonderivative optimizers. IEEE Trans. Neural Netw. 9(4), 629–638 (1998)

    Article  Google Scholar 

  78. Nesic, D., Mohammadi, A., Manzie, C.: A systematic approach to extremum seeking based on parameter estimation. In: Proceedings of the Conference on Decision and Control, pp. 3902–3907 (2010)

    Google Scholar 

  79. Nesic, D., Tan, Y., Moase, W.H., Manzie, C.: A unifying approach to extremum seeking: Adaptive schemes based on estimation of derivatives. In: Proceedings of the Conference on Decision and Control, pp. 4625–4630 (2010)

    Google Scholar 

  80. Zhang, Y.: Stability and performance tradeoff with discrete time triangular search minimum seeking. In: Proceedings of the American Control Conference, vol. 1, pp. 423–427 (2000)

    Google Scholar 

  81. Teel, A.R., Popović, D.: Solving smooth and nonsmooth multivariable extremum seeking problems by the methods of nonlinear programming. In: Proceedings of the American Control Conference, vol. 3, pp. 2394–2399 (2001)

    Google Scholar 

  82. Zhang, C., Ordóñez, R.: Numerical optimization-based extremum seeking control of LTI systems. In: Proceedings of the Conference on Decision and Control, pp. 4428–4433 (2005)

    Chapter  Google Scholar 

  83. Zhang, C., Ordóñez, R.: Non-gradient extremum seeking control of feedback linearizable systems with application to ABS design. In: Proceedings of the Conference Decision and Control, pp. 6666–6671 (2006)

    Chapter  Google Scholar 

  84. Zhang, C., Ordóñez, R.: Numerical optimization-based extremum seeking control with application to ABS design. IEEE Trans. Autom. Control 52(3), 454–467 (2007)

    Article  Google Scholar 

  85. Zhang, C., Ordóñez, R.: Robust and adaptive design of numerical optimization-based extremum seeking control. Automatica 45, 634–646 (2009)

    Article  MATH  Google Scholar 

  86. Yu, S.-J., Chen, H., Kong, L.: Particle swarm optimization-based extremum seeking control. In: Advanced Intelligent Computing Theories and Applications. Lecture Notes in Computer Science, vol. 6215, pp. 185–196 (2008)

    Chapter  Google Scholar 

  87. Liu, H., Chen, H., Kong, L.: Bacteria foraging optimization-based extremum seeking control. In: IEEE International Conference on Intelligent Computing and Intelligent Systems (ICIS, 2010), vol. 3, pp. 110–115 (2010)

    Chapter  Google Scholar 

  88. Li, Y., Shen, J.: Extremum seeking predictive control of LTI systems based on numerical optimization. In: 8th IEEE International Conference on Control and Automation (ICCA, 2010), pp. 1321–1325 (2010)

    Google Scholar 

  89. Kapadia, A., Nath, N., Burg, T.C., Dawson, D.M.: Lyapunov-based continuous-stirred tank bioreactor control to maximize biomass production using the Haldane and Monod specific growth models. In: Proceedings of the American Control Conference, pp. 6734–6739 (2010)

    Google Scholar 

  90. Ivakhnenko, A.G.: On constructing an extremum controller without hunting oscillations. IEEE Trans. Autom. Control 12(2), 144–153 (1967)

    Article  Google Scholar 

  91. Wellstead, P.E., Scotson, P.G.: Self-tuning extremum control. IEE Proc. Part D. Control Theory Appl. 137(3), 165–175 (1990)

    Article  MathSciNet  Google Scholar 

  92. Wellstead, P.E., Scotson, P.G.: Self-tuning optimization of spark ignition automotive engines. IEEE Control Syst. Mag. 10(3), 94–101 (1990)

    Article  MathSciNet  Google Scholar 

  93. Floretin, J.J.: An approximately optimal extremal regulator. J. Electron. Control 17(2), 211–310 (1964)

    Article  Google Scholar 

  94. Nascimento, C.L., Zarrop, M.B., Muir, A.: A neural network extremum controller. In: Proceedings of the European Control Conference, Groningen, The Netherlands (1993)

    Google Scholar 

  95. Zarrop, M.B., Rommens, M.J.J.J.: Convergence of a multi-input adaptive extremum controller. In: IEE Proceedings-D, vol. 140 (1993)

    Google Scholar 

  96. Bamberger, W., Isermann, R.: Adaptive on-line steady-state optimization of slow dynamic processes. Automatica 14, 223–232 (1978)

    Article  MATH  Google Scholar 

  97. Navarro, L.B., Zarrop, M.B.: Dynamic extremum control. In: Proceedings of the IEE Colloquium on Adaptive Control, London (1996)

    Google Scholar 

  98. Navarro, L.B., Zarrop, M.B.: Adaptive implicit control using extremum control methods. In: Proceedings of the UKACC International Conference on Control (1996)

    Google Scholar 

  99. Wittenmark, B., Evans, R.J.: Extremal control of wiener model processes. In: Proceedings of the Conference on Decision and Control, pp. 4637–4642 (2002)

    Google Scholar 

  100. Velut, S., Hagander, P.: Analysis of probing control strategy. In: Proceedings of the American Control Conference, vol. 4, pp. 609–614 (2003)

    Google Scholar 

  101. Velut, S., Hagander, P.: A probing control strategy: stability and performance. In: Proceedings of the Conference on Decision and Control, pp. 4607–4612 (2004)

    Google Scholar 

  102. Pan, Y., Özgüner, Ü.: Discrete-time extremum seeking algorithms. In: Proceedings of the American Control Conference, vol. 4, pp. 3147–3152 (2002)

    Google Scholar 

  103. Egardt, B., Larsson, S.: On a parameter adaptive extremum controller. In: Proceedings of the Conference on Decision and Control, pp. 4809–4814 (2005)

    Chapter  Google Scholar 

  104. Banaszuk, A., Ariyur, K.B., Krstić, M., Jacobson, C.A.: An adaptive algorithm for control of combustion instability and application to compressor instability control. Automatica 40(11), 1965–1972 (2004)

    Article  MathSciNet  MATH  Google Scholar 

  105. Li, Y., Rotea, M.A., Chiu, G.T.-C., Mongeau, L.G., Paek, I.-S.: Extremum seeking control of a tunable thermoacoustic cooler. IEEE Trans. Control Syst. Technol. 13, 527–536 (2005)

    Article  Google Scholar 

  106. Centioli, C., Iannone, F., Panella, M., Pangione, L., Podda, S., Tuccillo, A., Zaccarian, L.: Advances in the experimentation of extremum seeking techniques to maximize the RF power absorption in FTU. In: Symposium on Fusion Engineering (SOFE) (2005)

    Google Scholar 

  107. Popović, D., Janković, M., Magner, S., Teel, A.: Extremum seeking methods for optimization of variable cam timing engine operation. IEEE Trans. Control Syst. Technol. 14(3), 398–407 (2006)

    Article  Google Scholar 

  108. Centioli, C., Iannone, F., Mazza, G., Panella, M., Pangione, L., Podda, S., Tuccillo, A.: Maximization of the lower hybrid power coupling in the Frascati Tokamak upgrade via extremum seeking. Control Eng. Pract. 16, 1468–1478 (2008)

    Article  Google Scholar 

  109. Nakadoi, H., Sobey, D., Yamakita, M., Mukai, T.: Liquid environment-adaptive IPMC fish-like robot using extremum seeking feedback. In: Proceedings of 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 3089–3094 (2008)

    Chapter  Google Scholar 

  110. Killingsworth, N., Aceves, S., Flowers, D., Espinosa-Loza, F., Krstić, M.: HCCI engine combustion-timing control: Optimizing gains and fuel consumption via extremum seeking. IEEE Transcations on Control Systems Technology 17(6) (2009)

    Google Scholar 

  111. Aldrich, J., Sherrit, S., Bao, X., Bar-Cohen, Y., Badescu, M., Chang, Z.: Extremum-seeking control for an ultrasonic/sonic driller/corer (USDC) driven at high power. In: Proceedings of SPIE Smart Structures and Materials 2006: Modeling, Signal Processing, and Control, vol. 6166, pp. 616–618 (2006)

    Google Scholar 

  112. Zhang, X.T., Dawson, D.M., Dixon, W.E., Xian, B.: Extremum-seeking nonlinear controllers for a human exercise machine. IEEE/ASME Trans. Mechatron. 11(2), 233–240 (2006)

    Article  Google Scholar 

  113. Brunton, S.L., Rowley, C.W., Kulkarni, S.R., Clarkson, C.: Maximum power point tracking for photovoltaic optimization using ripple-based extremum seeking control. IEEE Trans. Power Electron. 25(10), 2531–2540 (2010)

    Article  Google Scholar 

  114. Sato, T., Araki, N., Konishi, Y., Ishigaki, H.: Discrete-time weigh feeder control using extremum-seeking method. In: IEEE International Conference on Control Applications (CCA, 2010), pp. 53–58 (Sept. 2010)

    Chapter  Google Scholar 

  115. van der Meulen, S., de Jager, B., Veldpaus, F., Steinbuch, M.: Combining extremum seeking control and tracking control for high-performance CVT operation. In: Proceedings of the Conference on Decision and Control, pp. 3668–3673 (2010)

    Google Scholar 

  116. Zhang, C., Siranosian, A., Krstić, M.: Extremum seeking for moderately unstable systems and for autonomous target tracking without position measurements. Automatica 43, 1832–1839 (2007)

    Article  MATH  Google Scholar 

  117. Zhang, C., Arnold, D., Ghods, N., Siranosian, A., Krstić, M.: Source seeking with nonholonomic unicycle without position measurement and with tuning of forward velocity. Syst. Control Lett. 56, 245–252 (2007)

    Article  MATH  Google Scholar 

  118. Cochran, J., Krstić, M.: Nonholonomic source seeking with tuning of angular velocity. IEEE Trans. Autom. Control 54(4), 713–731 (2009)

    Article  Google Scholar 

  119. Ghods, N., Krstić, M.: Speed regulation in steering-based source seeking. Automatica 46, 452–459 (2010)

    Article  MATH  Google Scholar 

  120. Ghods, N., Krstić, M.: Source seeking with very slow or drifting sensors. ASME J. Dyn. Syst. Meas. Control 133 (2011)

    Google Scholar 

  121. Stankovic, M.S., Stipanovic, D.M.: Stochastic extremum seeking with applications to mobile sensor networks. In: Proceedings of the American Control Conference, pp. 5622–5627 (2009)

    Google Scholar 

  122. Stankovic, M.S., Stipanovic, D.M.: Discrete time extremum seeking by autonomous vehicles in a stochastic environment. In: Proceedings of the Conference on Decision and Control, pp. 4541–4546 (2009)

    Google Scholar 

  123. Liu, S.-J., Krstić, M.: Stochastic source seeking for nonholonomic unicycle. IEEE Trans. Autom. Control 46, 1443–1453 (2010)

    MATH  Google Scholar 

  124. Cochran, J., Krstić, M.: 3-d source seeking for underactuated vehicles without position measurement. IEEE Trans. Robot. 25(1), 117–129 (2009)

    Article  Google Scholar 

  125. Cochran, J., Kanso, E., Krstic, M.: Source seeking for a three-link model of fish locomotion. In: Proceedings of the American Control Conference, pp. 1808–1813 (2009)

    Google Scholar 

  126. Cochran, J., Kanso, E., Kelly, S.D., Xiong, H., Krstić, M.: Source seeking for two nonholonomic models of fish locomotion. IEEE Trans. Robot. 25(5), 1166–1176 (2009)

    Article  Google Scholar 

  127. Krstić, M., Cochran, J.: Extremum seeking for motion optimization: from bacteria to nonholonomic vehicles. In: Proceedings of the Chinese Control and Decision Conference, pp. 18–27 (2008)

    Google Scholar 

  128. Fu, L., Özgüner, Ü.: Sliding mode in constrained source tracking with non-holonomic vehicles. In: International Workshop on Variable Structure Systems (VSS’08), pp. 30–34 (2008)

    Chapter  Google Scholar 

  129. Fu, L., Özgüner, Ü.: Extremum-seeking control in constrained source tracing with nonholonomic vehicles. IEEE Trans. Ind. Electron. 56(9), 3602–3608 (2009)

    Article  Google Scholar 

  130. Mayhew, C.G., Sanfelice, R.G., Teel, A.R.: Robust source-seeking hybrid controller for autonomous vehicles. In: Proceedings of the American Control Conference, pp. 1185–1190 (2007)

    Google Scholar 

  131. Biyik, E., Arcak, M.: Gradient climbing in formation via extremum seeking and passivity-based coordination rules. In: Proceedings of the Conference on Decision and Control, pp. 3133–3138 (2007)

    Google Scholar 

  132. Ghods, N., Frihauf, P., Krstic, M.: Multi-agent deployment in the plane using stochastic extremum seeking. In: Proceedings of the Conference on Decision and Control (2010)

    Google Scholar 

  133. Ghods, N., Krstic, M.: Multiagent deployment over a source. IEEE Trans. Control Syst. Technol., pp. 1–10 (2011)

    Google Scholar 

  134. Dixon, C., Frew, E.W.: Controlling the mobility of network nodes using decentralized extremum seeking. In: Proceedings of the Conference on Decision and Control, pp. 1291–1296 (2006)

    Chapter  Google Scholar 

  135. Chichka, D.F., Speyer, J.L., Park, C.G.: Peaking-seeking control with application to formation flight. In: Proceedings of the 38th Conference on Decision and Control, vol. 5, pp. 2463–2470 (1999)

    Google Scholar 

  136. Xie, F., Zhang, X., Fierro, R., Motter, M.: Autopilot-based nonlinear UAV formation controller with extremum-seeking. In: Proceedings of the Conference on Decision and Control, pp. 4933–4938 (2005)

    Google Scholar 

  137. Popović, D., Janković, M., Magner, S., Teel, A.: Extremum seeking methods for optimization of variable cam timing engine operation. In: Proceedings of the American Control Conference, vol. 4, pp. 3136–3141 (2003)

    Google Scholar 

  138. Sugihira, S., Ichikawa, K., Ohmori, H.: Starting speed control of SI engine based on online extremum control. In: SICE Annual Conference 2007, pp. 2569–2573 (2007)

    Chapter  Google Scholar 

  139. Haskara, Í., Zhu, G.G., Winkelman, J.: Multivariable EGR/spark timing control for IC engines via extremum seeking. In: Proceedings of the American Control Conference, pp. 163–164 (1999)

    Google Scholar 

  140. Gafvert, M., Arzen, K.-E., Pederson, L.M.: Simple linear feedback and extremum control of GDI engines. In: Seoul 2000 FISITA World Automotive Congress (2000)

    Google Scholar 

  141. Janković, M., Magner, S.: Optimization and scheduling for automotive powertrains. In: Proceedings of the American Control Conference, pp. 4054–4059 (2004)

    Google Scholar 

  142. Tanelli, M., Astolfi, A., Savaresi, S.M.: Non-local extremum seeing control for active braking control systems. In: Proceedings of the American Control Conference, pp. 891–896 (2006)

    Google Scholar 

  143. Wang, H.-H., Yeung, S., Krstić, M.: Experimental application of extremum seeking on an axial-flow compressor. IEEE Trans. Control Syst. Technol. 8(2), 300–309 (2000)

    Article  Google Scholar 

  144. Schneider, G., Ariyur, K.B., Krstić, M.: Tuning of a combustion controller by extremum seeking: a simulation study. In: Proceedings of the 39th Conference on Decision and Control, vol. 5, pp. 5219–5223 (2000)

    Google Scholar 

  145. Banaszuk, A., Zhang, Y., Jacobson, C.A.: Adaptive control of combustion instability using extremum-seeking. In: Proceedings of the American Control Conference, vol. 1, pp. 416–422 (2000)

    Google Scholar 

  146. Schuster, E., Romero, C., Yao, Z., Si, F.: Integrated real-time optimization of boiler and post-combustion system in coal-based power plants via extremum seeking. In: IEEE International Conference on Control Applications (CCA, 2010), pp. 2184–2189 (2010)

    Chapter  Google Scholar 

  147. Marcos, N.I., Guay, M., Dochain, D.: Output feedback adaptive extremum seeking control of a continuous stirred tank bioreactor with Monod’s kinetics. J. Process Control 14(11), 807–818 (2004)

    Article  Google Scholar 

  148. Marcos, N.I., Guay, M., Dochain, D., Zhang, T.: Adaptive extremum-seeking control of a continuous stirred tank bioreactor with Haldane’s kinetics. J. Process Control 14(3), 317–328 (2004)

    Article  Google Scholar 

  149. Titica, M., Dochain, D., Guay, M.: Adaptive extremum-seeking control of fed-batch bioreactors. Eur. J. Control 9(6), 614–627 (2003)

    Article  Google Scholar 

  150. Peters, N., Guay, M., DeHaan, D.: Real-time dynamic optimization of batch systems. J. Process Control 17(3), 261–271 (2007)

    Article  Google Scholar 

  151. Guay, M., Dochain, D., Perrier, M.: Adaptive extremum seeking control of continuous stirred tank bioreactors with unknown growth kinetics. Automatica 40(5), 881–888 (2004)

    Article  MathSciNet  MATH  Google Scholar 

  152. Guay, M., Dochain, D., Perrier, M.: Adaptive extremum-seeking control of nonisothermal continuous stirred tank reactors. Chem. Eng. Sci. 60(13), 3671–3681 (2005)

    Article  Google Scholar 

  153. Hudon, N., Perrier, M., Guay, M., Dochain, D.: Adaptive extremum seeking control of a non-isothermal tubular reactor with unknown kinetics. Comput. Chem. Eng. 29, 839–849 (2005)

    Article  Google Scholar 

  154. Cougnon, P., Dochain, D., Guay, M., Perrier, M.: Real-time optimization of a tubular reactor with distributed feed. AIChE J. 52(6), 2120–2128 (2006)

    Article  Google Scholar 

  155. Hudon, N., Guay, M., Perrier, M., Dochain, D.: Adaptive extremum seeking control of tubular reactor with limited actuation. In: Proceedings of the American Control Conference, pp. 4563–4568 (2005)

    Google Scholar 

  156. Hudon, N., Guay, M., Perrier, M., Dochain, D.: Adaptive extremum-seeking control of convection-reaction distributed reactor with limited actuation. Comput. Chem. Eng. (Jan. 2008)

    Google Scholar 

  157. Bastin, G., Nešić, D., Tan, Y., Mareels, I.: On extremum seeking in bioprocesses with multivalued cost functions. Biotechnol. Prog. 25(3), 683–689 (2009)

    Article  Google Scholar 

  158. Nguang, S.K., Cheng, X.D.: Extremum seeking scheme for continuous fermentation processes described by an unstructured fermentation model. Bioprocess Biosyst. Eng. 23(5), 417–420 (2000)

    Article  Google Scholar 

  159. Beaudoin, J.F., Cadot, O., Aider, J.L., Wesfreid, J.E.: Bluff-body drag reduction by extremum-seeking control. J. Fluids Struct. 22(6–7), 973–978 (2006)

    Article  Google Scholar 

  160. Creaby, J., Li, Y., Seem, J.E.: Maximizing wind turbine energy capture using multivariable extremum seeking control. Wind Eng. 33(4), 361–387 (2009)

    Article  Google Scholar 

  161. Kim, K., Kasnakoglu, C., Serrani, A., Samimy, M.: Extremum-seeking control of subsonic cavity flow. AIAA J. 47(1), 195–205 (2009)

    Article  Google Scholar 

  162. Sinha, A., Kim, K., Kim, J.-H., Serrani, A., Samimy, M.: Extremizing feedback control of a high-speed and high Reynolds number jet. AIAA J. 48(2), 387–399 (2010)

    Article  Google Scholar 

  163. Zhang, T., Wen, J.T., Julius, A., Peles, Y., Jensen, M.K.: Extremum seeking micro-thermal-fluid control for active two-phase microelectronics cooling. In: Proceedings of the Conference on Decision and Control, pp. 1899–1904 (2010)

    Google Scholar 

  164. Luo, L., Schuster, E.: Boundary feedback control for heat exchange enhancement in 2d magnetohydrodynamic channel flow by extremum seeking. In: Proceedings of the Conference on Decision and Control, pp. 8272–8277 (2009)

    Google Scholar 

  165. Luo, L., Schuster, E.: Heat exchange enhancement by extremum seeking boundary feedback control in 3d magnetohydrodynamic channel flow. In: Proceedings of the Conference on Decision and Control, pp. 2972–2978 (2010)

    Google Scholar 

  166. Banaszuk, A., Narayanan, S., Zhang, Y.: Adaptive control of flow separation in a planar diffuser. In: 41st Aerospace Sciences Meeting & Exhibit (2003)

    Google Scholar 

  167. Peterson, K.S., Stefanopoulou, A.G.: Extremum seeking control for soft landing of an electromechanical valve actuator. Automatica 40(6), 1063–1069 (2004)

    Article  MathSciNet  MATH  Google Scholar 

  168. Centioli, C., Iannone, F., Mazza, G., Panella, M., Pangione, L., Podda, S., Tuccillo, A., Vitale, V., Zaccarian, L.: Extremum seeking applied to the plasma control system of the Frascati tokamak upgrade. In: Proceedings of the Conference on Decision and Control, pp. 8227–8232 (2005)

    Chapter  Google Scholar 

  169. Carnevale, D., Zaccarian, L., Astolfi, A., Podda, S.: Extremum seeking without external dithering and its application to plasma RF heating on FTU. In: Proceedings of the Conference on Decision and Control, pp. 3151–3156 (2008)

    Google Scholar 

  170. Ou, Y., Xu, C., Schuster, E., Luce, T., Ferron, J.R., Walker, M.: Extremum-seeking finite-time optimal control of plasma current profile at the diii-d tokamak. In: Proceedings of the American Control Conference, pp. 4015–4020 (2007)

    Google Scholar 

  171. Cardenas, R., Pena, R.: Sensorless vector control of induction machines for variable-speed wind energy applications. IEEE Trans. Energy Convers. 19(1), 196–205 (2004)

    Article  Google Scholar 

  172. Liu, Q., He, Y., Zhao, R.: The maximal wind-energy tracking control of a variable-speed constant-frequency wind-power generation system. Autom. Electr. Power Syst. 27(20), 62–67 (2003)

    Google Scholar 

  173. Geng, H., Yang, G.: A novel control strategy of MPPT taking dynamics of wind turbine into account. In: Proceedings of the 37th IEEE Power Electronic Specialists Conference, pp. 1–6 (2006)

    Google Scholar 

  174. Leyva, R., Alonso, C., Queinnec, I., Cid-Pastor, A., Lagrange, D., Martínez-Salamero, L.: MPPT of photovoltaic systems using extremum-seeking control. IEEE Trans. Aerosp. Electron. Syst. 42(1), 249–258 (2006)

    Article  Google Scholar 

  175. Pan, T., Ji, Z., Jiang, Z.: Maximum power point tracking of wind energy conversion systems based on sliding mode extremum seeking control. In: Proceedings of the IEEE Energy Conference, pp. 1–5 (2008)

    Google Scholar 

  176. Zheng, X., Li, L., Xu, D., Platts, J.: Sliding mode MPPT control of variable speed wind power system. In: Asia-Pacific Power and Energy Engineering Conference (APPEEC 2009), pp. 1–4 (2009)

    Google Scholar 

  177. Bizon, N.: On tracking robustness in adaptive extremum seeking control of the fuel cell power plants. Appl. Energy 87(10), 3115–3130 (2010)

    Article  Google Scholar 

  178. Moura, S.J., Chang, Y.A.: Asymptotic convergence through Lyapunov-based switching in extremum seeking with application to photovoltaic systems. In: Proceedings of the American Control Conference, pp. 3542–3548 (2010)

    Google Scholar 

  179. Fu, D., Xing, Y., Ma, Y.: MPPT of VSCF wind energy conversion system using extremum control strategy. In: World Non-Grid-Connected Wind Power and Energy Conference (WNWEC, 2010), pp. 1–6 (2010)

    Chapter  Google Scholar 

  180. Lu, J., Zahedi, A.: Maximum efficiency point tracking control for fuel cell power systems. In: International Conference on Power System Technology (POWERCON, 2010), pp. 1–6 (2010)

    Google Scholar 

  181. Lei, P., Li, Y., Seem, J.: Sequential ESC based global MPPT control for photovoltaic array with variable shading. IEEE Trans. Sustain. Energy (2011)

    Google Scholar 

  182. Bratcu, A.I., Munteanu, I., Bacha, S., Picault, D., Raison, B.: Cascaded dc-dc converter photovoltaic systems: Power optimization issues. IEEE Trans. Ind. Electron. 58(2), 403–411 (2011)

    Article  Google Scholar 

  183. Chang, Y.A., Moura, S.J.: Air flow control in fuel cell systems: An extremum seeking approach. In: Proceedings of the American Control Conference, pp. 1052–1059 (2009)

    Google Scholar 

  184. Komatsu, H.O.M., Miyamoto, H., Sano, A.: Output maximization control of wind turbine based on extremum control strategy. In: Proceedings of the American Control Conference, pp. 1739–1740 (2001)

    Google Scholar 

  185. Li, Y., Rotea, M.A., Chiu, G.T.-C., Mongeau, L.G., Paek, I.-S.: Extremum seeking control of tunable thermoacoustic cooler. In: Proceedings of the American Control Conference, pp. 2033–2038 (2004)

    Google Scholar 

  186. Dower, P., Farrell, P., Nešić, D.: Extremum seeking control of cascaded Raman optical amplifiers. IEEE Trans. Control Syst. Technol. 16(3), 396–407 (2008)

    Article  Google Scholar 

  187. Schuster, E., Morinaga, E., Allen, C.K., Krstić, M.: Optimal beam matching in particle accelerators via extremum seeking. In: Proceedings of the American Control Conference, pp. 1962–1967 (2006)

    Google Scholar 

  188. Schuster, E., Xu, C., Torres, N.: Extremum seeking adaptive control of beam envelope in particle accelerators. In: Proceedings of the IEEE Conference on Control Applications (2006)

    Google Scholar 

  189. Schuster, E., Xu, C., Torres, N., Morinaga, E., Allen, C., Krstić, M.: Beam matching adaptive control via extremum seeking. Nucl. Instrum. Methods Phys. Res., Sect. A, Accel. Spectrom. Detect. Assoc. Equip. 581, 799–815 (2007)

    Article  Google Scholar 

  190. Cistelecan, M.R.: Power control in mobile wireless network using sliding mode extremum seeking control implementing bifurcations. In: Proceedings of 17th IEEE International Conference on Control Applications, pp. 67–72 (2008)

    Google Scholar 

  191. Pan, Y., Furuta, K.: Variable structure control with sliding sector based on hybrid switching law. Int. J. Adapt. Control Signal Process. 21(8–9), 764–778 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  192. Schuster, E., Sondak, D., Arastoo, R., Walker, M.L., Humphreys, D.A.: Optimal tuning of tokamak plasma equilibrium controllers in the presence of time delays. In: IEEE International Conference on Control Applications (CCA), Intelligent Control (ISIC, 2009), pp. 1188–1194 (2009)

    Chapter  Google Scholar 

  193. Zuo, B., Hu, Y.-A., Li, J.: Pid controller tuning by using extremum seeking algorithm based on annealing recurrent neural network. In: 3rd International Symposium on Knowledge Acquisition and Modeling (KAM, 2010), pp. 132–135 (2010)

    Google Scholar 

  194. Dong, W., Hu, Y.-A., Zuo, B., Dong, W.: Backstepping control optimized by the multi-parameter ESA. In: International Conference on Artificial Intelligence and Education (ICAIE, 2010), pp. 155–158 (Oct. 2010)

    Chapter  Google Scholar 

  195. Frihauf, P., Krstic, M., Basar, T.: Nash equilibrium seeking for games with non-quadratic payoffs. In: Proceedings of the Conference on Decision and Control, pp. 881–886 (2010)

    Google Scholar 

  196. Krstic, M., Frihauf, P., Krieger, J., Basar, T.: Nash equilibrium seeking with finitely- and infinitely-many players. In: Proceedings of the 8th IFAC Symposium on Nonlinear Control Systems (2010)

    Google Scholar 

  197. Stankovic, M.S., Johansson, K.H., Stipanovic, D.M.: Distributed seeking of Nash equilibria in mobile sensor networks. In: Proceedings of the Conference on Decision and Control, pp. 5598–5603 (2010)

    Google Scholar 

  198. Wang, H.-H., Krstić, M.: Extremum seeking for limit cycle minimization. IEEE Trans. Autom. Control 45(12), 2432–2436 (2000)

    Article  MATH  Google Scholar 

  199. Johansen, T.A., Sbárbaro, D.: Lyapunov-based optimizing control of nonlinear blending processes. IEEE Trans. Control Syst. Technol. 13(4), 631–638 (2005)

    Article  Google Scholar 

  200. Antonello, R., Oboe, R.: Stability analysis of an extremum seeking controller for mode-matching in vibrating microgyros. In: The 8th IEEE International Workshop on Advanced Motion Control, pp. 116–121 (2008)

    Google Scholar 

  201. Antonello, R., Oboe, R., Prandi, L., Biganzoli, F.: Automatic mode matching in MEMS vibrating gyroscopes using extremum-seeking control. IEEE Trans. Ind. Electron. 56(10), 3880–3891 (2009)

    Article  Google Scholar 

  202. Danielson, C., Lacy, S., Hindman, B., Collier, P., Hunt, J., Moser, R.: Extremum seeking control for simultaneous beam steering and wavefront correction. In: Proceedings of the American Control Conference, pp. 4483–4488 (2006)

    Google Scholar 

  203. Sane, H.S., Haugstetter, C., Bortoff, S.A.: Building HVAC control systems—role of controls and optimization. In: Proceedings of the American Control Conference, pp. 1121–1126 (2006)

    Google Scholar 

  204. Li, P., Li, Y., Seem, J.E.: Extremum seeking control for efficient and reliable operation of air-side economizers. In: Proceedings of the American Control Conference, pp. 20–25 (2009)

    Google Scholar 

  205. Tyagi, V., Sane, H.S., Darbha, S.: An extremum seeking algorithm for determining the set point temperature for condensed water in a cooling tower. In: Proceedings of the American Control Conference, pp. 1127–1131 (2006)

    Google Scholar 

  206. Zhang, X.T., Dawson, D.M., Dixon, W.E., Xian, B.: Extremum seeking nonlinear controllers for a human exercise machine. In: Proceedings of the 43th Conference on Decision and Control, pp. 3950–3955 (2004)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Chunlei Zhang .

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag London Limited

About this chapter

Cite this chapter

Zhang, C., Ordóñez, R. (2012). Introduction. In: Extremum-Seeking Control and Applications. Advances in Industrial Control. Springer, London. https://doi.org/10.1007/978-1-4471-2224-1_1

Download citation

  • DOI: https://doi.org/10.1007/978-1-4471-2224-1_1

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-4471-2223-4

  • Online ISBN: 978-1-4471-2224-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics