Abstract
The motivation of extremum seeking control is first presented, followed by a brief history of extremum seeking control and a literature overview of the last decades. The overview is separated in two parts: theory and applications. This distinction helps highlight the many problems of practical significance where extremum seeking control is a relevant design methodology; and at the same time, it provides the reader with a deeper understanding of the several available “flavors” of extremum seeking.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Some results in the ESC literature do make the assumption that J is known (see [14], for instance). Our approach here is to avoid having to make this assumption, since otherwise the practical value of the method is somewhat limited, in our view.
- 2.
Philosophically, it may be useful to compare this difference to solving the regulation (or tracking) problem using state feedback versus output feedback. Both try to achieve the same ultimate objective, but the assumptions made about the available information profoundly alter the way one goes about achieving it.
References
Drakunov, S.V., Özgüner, Ü, Dix, P., Ashrafi, B.: ABS control using optimum search via sliding modes. IEEE Transactions on Control Systems Technology (3), 79–85 (1995)
Tunay, İ.: Antiskid control for aircraft via extremum-seeking. In: Proceedings of the American Control Conference, vol. 2, pp. 665–670 (2001)
Ariyur, K.B., Krstić, M.: Real-time Optimization by Extremum-seeking Control. Wiley-Interscience, Hoboken (2003)
Aström, K.J., Wittenmark, B.: Adaptive Control. Wiley, Boston (1994)
Wang, H.-H., Krstić, M., Bastin, G.: Optimizing bioreactors by extremum seeking. Int. J. Adapt. Control Signal Process. 13(8), 651–669 (1999)
Zhang, T., Guay, M., Dochain, D.: Adaptive extremum seeking control of continuous stirred-tank bioreactors. AIChE J. 49(1), 113–123 (2003)
Binetti, P., Ariyur, K.B., Krstić, M.: Control of formation flight via extremum seeking. In: Proceedings of the American Control Conference, vol. 4, pp. 2848–2853 (2002)
Killingsworth, N., Krstić, M.: PID tuning using extremum seeking. IEEE Control Syst. Mag. 26, 70–79 (2006)
Athans, M., Falb, P.: Optimal Control: an Introduction to the Theory and Its Applications. McGraw-Hill, New York (1966)
Kwakernaak, H., Sivan, R.: Linear Optimal Control Systems. Wiley, Boston (1972)
Lewis, F., Syrmos, V.: Optimal Control. Wiley, Boston (1995)
Allgöwer, F., Zheng, A.: Nonlinear Model Predictive Control. Birkhäuser, Basel (2000)
Camacho, E., Bordons, C.: Model Predictive Control. Springer, London (2004)
Guay, M., Zhang, T.: Adaptive extremum seeking control of nonlinear dynamic systems with parametric uncertainties. Automatica 39(7), 1283–1293 (2003)
Lavretsky, E., Hovakimyan, N., Calise, A.: Adaptive extremum seeking control design. In: Proceedings of the American Control Conference, vol. 1, pp. 567–572 (2003)
Zhou, K., Doyle, J., Glover, K.: Robust and Optimal Control. Prentice Hall, Upper Saddle River (1996)
Nusawardhana, Żak, S.H.: Simultaneous perturbation extremum seeking method for dynamic optimization problems. In: Proceedings of the American Control Conference, pp. 2085–2810 (2004)
Rotea, M.A.: Analysis of multivariable extremum seeking algorithms. In: Proceedings of the American Control Conference, vol. 1, pp. 433–437 (2000)
Banavar, R.N., Chichka, D.F., Speyer, J.L.: Convergence and synthesis issues in extremum seeking control. In: Proceedings of the American Control Conference, vol. 1, pp. 438–443 (2000)
Hamza, M.H.: Extremum control of continuous systems. IEEE Trans. Autom. Control 11(2), 182–189 (1966)
Leblanc, M.: Sur l’electrification des chemins de fer au moyen de courants alternatifs de frequence elevee. Rev. Gen. Electr. (1922)
Sternby, J.: Extremum control systems: An area for adaptive control? In: Preprints of the Joint American Control Conference, 1980
Krstić, M., Wang, H.-H.: Design and stability analysis of extremum seeking feedback for general nonlinear systems. Automatica 36(2), 595–601 (2000)
Krstić, M.: Performance improvement and limitations in extremum seeking control. Syst. Control Lett. 39(5), 313–326 (2000)
Tan, Y., Moase, W.H., Manzie, C., Nesic, D., Mareels, I.M.Y.: Extremum seeking from 1922 to 2010. In: 29th Chinese Control Conference (CCC, 2010), pp. 14–26 (2010)
Pan, Y., Özgüner, Ü., Acarman, T.: Stability and performance improvement of extremum seeking control with sliding mode. Int. J. Control 76(9/10), 968–985 (2003)
Nusawardhana, Żak, S.H.: Extremum seeking using analog nonderivative optimizers. In: Proceedings of the American Control Conference, vol. 4, pp. 3242–3247 (2003)
Meerkov, S.M.: Asymptotic methods for investigating quasistationary states in continuous systems of automatic optimization. Autom. Remote Control 11, 1726–1743 (1967)
Meerkov, S.M.: Asymptotic methods for investigating a class of forced states in extremal systems. Autom. Remote Control 12, 1916–1920 (1967)
Meerkov, S.M.: Asymptotic methods for investigating stability of continuous systems of automatic optimization subject to disturbance action. Avtom. Telemeh. 12, 14–24 (1967) (in Russian)
Choi, J.-Y., Krstić, M., Ariyur, K.B., Lee, J.S.: Extremum seeking control for discrete-time systems. IEEE Trans. Autom. Control 47(2), 318–323 (2002)
Takata, H., Hachino, T., Tamura, R., Komatsu, K.: Design of extremum seeking control with accelerator. IEICE Trans. Fundam. Electron. Commun. Comput. Sci. E88-A(10), 2535–2540 (2005)
Walsh, G.C.: On the application of multi-parameter extremum seeking control. In: Proceedings of the American Control Conference, vol. 1, pp. 411–415 (2000)
Ariyur, K.B., Krstić, M.: Analysis and design of multivariable extremum seeking. In: Proceedings of the American Control Conference, vol. 4, pp. 2903–2908 (2002)
Ariyur, K.B., Krstić, M.: Sloping seeking: a generalization of extremum seeking. Int. J. Adapt. Control Signal Process. 18(2), 1–22 (2002)
Tan, Y., Nešić, D., Mareels, I.: On non-local stability properties of extremum seeking control. Automatica 42(6), 889–903 (2006)
Tan, Y., Mareels, I., Nešić, D., Xu, J.-X.: Point-wise extremum seeking control under repeatable control environment. In: Proceedings of the 22nd IEEE International Symposium on Intelligent Control, pp. 237–242 (2007)
Tan, Y., Nešić, D., Mareels, I.: On the choice of dither in extremum seeking systems: A case study. Automatica 44(5), 1446–1450 (2008)
Tan, Y., Nešić, D., Mareels, I., Astolfi, A.: On global extremum seeking in the presence of local extrema. Automatica 45(1), 245–251 (2009)
Zhang, C., Siranosian, A., Krstić, M.: Extremum seeking for moderately unstable systems and for autonomous target tracking without position measurements. In: Proceedings of the American Control Conference, pp. 4939–4944 (2006)
Manzie, C., Krstić, M.: Extremum seeking with stochastic perturbations. IEEE Trans. Autom. Control 54(3), 580–585 (2009)
Liu, S.-J., Krstić, M.: Stochastic averaging in continuous time and its applications to extremum seeking. IEEE Trans. Autom. Control 55(10), 2235–2250 (2010)
Mesquita, A.R., Hespanha, J.P., Aström, K.: Optimotaxis: a stochastic multiagent optimization procedure with point measurements. In: Egerstedt, M., Mishra, B. (eds.) Hybrid Systems: Computation and Control. Lecture Notes in Computer Science, vol. 4981, pp. 358–371 (2008)
Moase, W.H., Manzie, C., Brear, M.J.: Newton-like extremum-seeking for the control of thermoacoustic instability. IEEE Trans. Autom. Control 55(9), 2094–2105 (2010)
Korovin, S.K., Utkin, V.I.: Use of the sliding mode in problems of static optimization. Autom. Remote Control 33, 570–579 (1972)
Korovin, S.K., Utkin, V.I.: Using sliding modes in static optimization and nonlinear programming. Automatica 10, 525–532 (1974)
Drakunov, S.V., Özgüner, Ü.: Optimization of nonlinear system output via sliding mode approach. In: Proceedings of the IEEE International Workshop on Variable Structure and Lyapunov Control of Uncertain Dynamical Systems, Sheffield, UK, pp. 61–62 (1992)
Winkelman, J., Haskara, I., Özgüner, Ü.: Tuning for dynamic spark advance control. In: Proceedings of the American Control Conference, pp. 163–164 (1999)
Haskara, I., Özgüner, Ü., Winkelman, J.: Extremum control for optimal operating point determination and set point optimizing via sliding modes. J. Dyn. Syst. Meas. Control 122(4), 719–724 (2000)
Haskara, I., Hatipoglu, C., Özgüner, Ü.: Sliding mode compensation, estimation and optimization methods in automotive control. In: Yu, X., Xu, J.-X. (eds.) Variable Structure Systems: Towards the 21st Century. Lecture Notes in Control and Information Sciences, vol. 274, 155–174 (2002)
Pan, Y., Acarman, T., Özgüner, Ü.: Nash solution by extremum seeking control approach. In: Proceedings of the Conference on Decision and Control, vol. 1, pp. 329–334 (2002)
Yu, H., Özgüner, Ü.: Extremum-seeking control via sliding mode with periodic search signals. In: Proceedings of the Conference on Decision and Control, vol. 1, pp. 323–328 (2002)
Yu, H., Özgüner, Ü.: Smooth extremum-seeking control via second order sliding mode. In: Proceedings of the American Control Conference, vol. 4, pp. 3248–3253 (2003)
Pan, Y., Özgüner, Ü.: Sliding mode extremum seeking control for linear quadratic dynamic game. In: Proceedings of the American Control Conference, pp. 614–619 (2004)
Fu, L., Özgüner, Ü.: Variable structure extremum seeking control based on sliding mode gradient estimation for a class of nonlinear systems. In: Proceedings of the American Control Conference, pp. 8–13 (2009)
Tan, H.S., Tomizuka, M.: An adaptive sliding mode vehicle traction controller design. In: Proceedings of the American Control Conference, pp. 1035–1058 (1989)
Yamanka, S., Ohmori, H.: Nonlinear adaptive extremum seeking control for time delayed index in the presence of deterministic disturbance. In: Proceedings of the PhysCon 2005, pp. 121–125 (2005)
Peixoto, A.J., Oliveira, T.R., Hsu, L.: Periodic switching function based sliding mode control applied to output-feedback extremum-seeking problem. In: 11th International Workshop on Variable Structure Systems (VSS, 2010), pp. 124–129 (2010)
Chin, Y.K. et al.: Sliding mode ABS wheel slip control. In: Proceedings of the American Control Conference, pp. 1–6 (1992)
Haskara, I., Özgüner, Ü., Winkelman, J.: Wheel slip control for antispin acceleration via dynamic spark advance. Control Eng. Pract. 8(10), 1135–1148 (2000)
Yu, H., Özgüner, Ü.: Extremum-seeking control strategy for ABS system with time delay. In: Proceedings of the American Control Conference, vol. 5, pp. 3753–3758 (2002)
Gros, S., Srinivasan, B., Bonvin, D.: Optimizing control based on output feedback. Comput. Chem. Eng. 33, 191–198 (2009)
Speyer, J.L., Banavar, R.N., Chichka, D.F., Rhee, I.: Extremum seeking loops with assumed functions. In: Proceedings of the 39th Conference on Decision and Control, vol. 1, pp. 142–147 (2000)
Banavar, R.N., Chichka, D.F., Speyer, J.L.: Functional feedback in an extremum seeking loop. In: Proceedings of the 40th Conference on Decision and Control, vol. 2, pp. 1316–1321 (2001)
Banavar, R.N.: Extremum seeking loops with assumed functions: estimation and control. In: Proceedings of the American Control Conference, vol. 4, pp. 3159–3164 (2002)
Banavar, R.N., Chichka, D.F., Speyer, J.L.: Convergence and synthesis issues in extremum seeking control. Int. J. Adapt. Control Signal Process. 17, 751–762 (2003)
Ryan, J.J., Speyer, J.L.: Peak-seeking control using gradient and hessian estimates. In: Proceedings of the American Control Conference, pp. 611–616 (2010)
Spooner, J.T., Maggiore, M., Ordóñez, R., Passino, K.M.: Stable Adaptive Control and Estimation for Nonlinear Systems, Neural and Fuzzy Approximator Techniques. Wiley, New York (2002)
Li, P.Y., Horowitz, R.: Self-optimizing control. In: Proceedings of the Conference on Decision and Control, pp. 1228–1233 (1997)
Li, P.Y., Horowitz, R.: Control of smart exercise machine—part ii: Self-optimizing control. IEEE/ASME Trans. Mechatron. 2(4), 248–258 (1997)
Shields, J., Horowitz, R.: Controller design and experimental verification of a self-optimizing motion controller for smart exercise machines. In: Proceedings of the American Control Conference, pp. 2736–2742 (1997)
Adetola, V., Dehaan, D., Guay, M.: Adaptive extremum seeking receding horizon control of nonlinear system. In: Proceedings of the American Control Conference, pp. 2937–2942 (2004)
Adetola, V., Guay, M.: Adaptive output feedback extremum seeking receding horizon control of linear systems. J. Process Control 16, 521–533 (2006)
Dochain, D., Guay, M.: Extremum seeking control of state-constrained nonlinear systems. Automatica 41, 1567–1574 (2005)
Guay, M., Peters, N.: Real-time dynamical optimization of nonlinear systems: A flatness-based approach. Comput. Chem. Eng. 30, 709–721 (2006)
Adetola, V., Guay, M.: Parameter convergence in adaptive extremum-seeking control. Automatica 43(1), 105–110 (2007)
Teixeira, M.C.M., Żak, S.H.: Analog neural nonderivative optimizers. IEEE Trans. Neural Netw. 9(4), 629–638 (1998)
Nesic, D., Mohammadi, A., Manzie, C.: A systematic approach to extremum seeking based on parameter estimation. In: Proceedings of the Conference on Decision and Control, pp. 3902–3907 (2010)
Nesic, D., Tan, Y., Moase, W.H., Manzie, C.: A unifying approach to extremum seeking: Adaptive schemes based on estimation of derivatives. In: Proceedings of the Conference on Decision and Control, pp. 4625–4630 (2010)
Zhang, Y.: Stability and performance tradeoff with discrete time triangular search minimum seeking. In: Proceedings of the American Control Conference, vol. 1, pp. 423–427 (2000)
Teel, A.R., Popović, D.: Solving smooth and nonsmooth multivariable extremum seeking problems by the methods of nonlinear programming. In: Proceedings of the American Control Conference, vol. 3, pp. 2394–2399 (2001)
Zhang, C., Ordóñez, R.: Numerical optimization-based extremum seeking control of LTI systems. In: Proceedings of the Conference on Decision and Control, pp. 4428–4433 (2005)
Zhang, C., Ordóñez, R.: Non-gradient extremum seeking control of feedback linearizable systems with application to ABS design. In: Proceedings of the Conference Decision and Control, pp. 6666–6671 (2006)
Zhang, C., Ordóñez, R.: Numerical optimization-based extremum seeking control with application to ABS design. IEEE Trans. Autom. Control 52(3), 454–467 (2007)
Zhang, C., Ordóñez, R.: Robust and adaptive design of numerical optimization-based extremum seeking control. Automatica 45, 634–646 (2009)
Yu, S.-J., Chen, H., Kong, L.: Particle swarm optimization-based extremum seeking control. In: Advanced Intelligent Computing Theories and Applications. Lecture Notes in Computer Science, vol. 6215, pp. 185–196 (2008)
Liu, H., Chen, H., Kong, L.: Bacteria foraging optimization-based extremum seeking control. In: IEEE International Conference on Intelligent Computing and Intelligent Systems (ICIS, 2010), vol. 3, pp. 110–115 (2010)
Li, Y., Shen, J.: Extremum seeking predictive control of LTI systems based on numerical optimization. In: 8th IEEE International Conference on Control and Automation (ICCA, 2010), pp. 1321–1325 (2010)
Kapadia, A., Nath, N., Burg, T.C., Dawson, D.M.: Lyapunov-based continuous-stirred tank bioreactor control to maximize biomass production using the Haldane and Monod specific growth models. In: Proceedings of the American Control Conference, pp. 6734–6739 (2010)
Ivakhnenko, A.G.: On constructing an extremum controller without hunting oscillations. IEEE Trans. Autom. Control 12(2), 144–153 (1967)
Wellstead, P.E., Scotson, P.G.: Self-tuning extremum control. IEE Proc. Part D. Control Theory Appl. 137(3), 165–175 (1990)
Wellstead, P.E., Scotson, P.G.: Self-tuning optimization of spark ignition automotive engines. IEEE Control Syst. Mag. 10(3), 94–101 (1990)
Floretin, J.J.: An approximately optimal extremal regulator. J. Electron. Control 17(2), 211–310 (1964)
Nascimento, C.L., Zarrop, M.B., Muir, A.: A neural network extremum controller. In: Proceedings of the European Control Conference, Groningen, The Netherlands (1993)
Zarrop, M.B., Rommens, M.J.J.J.: Convergence of a multi-input adaptive extremum controller. In: IEE Proceedings-D, vol. 140 (1993)
Bamberger, W., Isermann, R.: Adaptive on-line steady-state optimization of slow dynamic processes. Automatica 14, 223–232 (1978)
Navarro, L.B., Zarrop, M.B.: Dynamic extremum control. In: Proceedings of the IEE Colloquium on Adaptive Control, London (1996)
Navarro, L.B., Zarrop, M.B.: Adaptive implicit control using extremum control methods. In: Proceedings of the UKACC International Conference on Control (1996)
Wittenmark, B., Evans, R.J.: Extremal control of wiener model processes. In: Proceedings of the Conference on Decision and Control, pp. 4637–4642 (2002)
Velut, S., Hagander, P.: Analysis of probing control strategy. In: Proceedings of the American Control Conference, vol. 4, pp. 609–614 (2003)
Velut, S., Hagander, P.: A probing control strategy: stability and performance. In: Proceedings of the Conference on Decision and Control, pp. 4607–4612 (2004)
Pan, Y., Özgüner, Ü.: Discrete-time extremum seeking algorithms. In: Proceedings of the American Control Conference, vol. 4, pp. 3147–3152 (2002)
Egardt, B., Larsson, S.: On a parameter adaptive extremum controller. In: Proceedings of the Conference on Decision and Control, pp. 4809–4814 (2005)
Banaszuk, A., Ariyur, K.B., Krstić, M., Jacobson, C.A.: An adaptive algorithm for control of combustion instability and application to compressor instability control. Automatica 40(11), 1965–1972 (2004)
Li, Y., Rotea, M.A., Chiu, G.T.-C., Mongeau, L.G., Paek, I.-S.: Extremum seeking control of a tunable thermoacoustic cooler. IEEE Trans. Control Syst. Technol. 13, 527–536 (2005)
Centioli, C., Iannone, F., Panella, M., Pangione, L., Podda, S., Tuccillo, A., Zaccarian, L.: Advances in the experimentation of extremum seeking techniques to maximize the RF power absorption in FTU. In: Symposium on Fusion Engineering (SOFE) (2005)
Popović, D., Janković, M., Magner, S., Teel, A.: Extremum seeking methods for optimization of variable cam timing engine operation. IEEE Trans. Control Syst. Technol. 14(3), 398–407 (2006)
Centioli, C., Iannone, F., Mazza, G., Panella, M., Pangione, L., Podda, S., Tuccillo, A.: Maximization of the lower hybrid power coupling in the Frascati Tokamak upgrade via extremum seeking. Control Eng. Pract. 16, 1468–1478 (2008)
Nakadoi, H., Sobey, D., Yamakita, M., Mukai, T.: Liquid environment-adaptive IPMC fish-like robot using extremum seeking feedback. In: Proceedings of 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 3089–3094 (2008)
Killingsworth, N., Aceves, S., Flowers, D., Espinosa-Loza, F., Krstić, M.: HCCI engine combustion-timing control: Optimizing gains and fuel consumption via extremum seeking. IEEE Transcations on Control Systems Technology 17(6) (2009)
Aldrich, J., Sherrit, S., Bao, X., Bar-Cohen, Y., Badescu, M., Chang, Z.: Extremum-seeking control for an ultrasonic/sonic driller/corer (USDC) driven at high power. In: Proceedings of SPIE Smart Structures and Materials 2006: Modeling, Signal Processing, and Control, vol. 6166, pp. 616–618 (2006)
Zhang, X.T., Dawson, D.M., Dixon, W.E., Xian, B.: Extremum-seeking nonlinear controllers for a human exercise machine. IEEE/ASME Trans. Mechatron. 11(2), 233–240 (2006)
Brunton, S.L., Rowley, C.W., Kulkarni, S.R., Clarkson, C.: Maximum power point tracking for photovoltaic optimization using ripple-based extremum seeking control. IEEE Trans. Power Electron. 25(10), 2531–2540 (2010)
Sato, T., Araki, N., Konishi, Y., Ishigaki, H.: Discrete-time weigh feeder control using extremum-seeking method. In: IEEE International Conference on Control Applications (CCA, 2010), pp. 53–58 (Sept. 2010)
van der Meulen, S., de Jager, B., Veldpaus, F., Steinbuch, M.: Combining extremum seeking control and tracking control for high-performance CVT operation. In: Proceedings of the Conference on Decision and Control, pp. 3668–3673 (2010)
Zhang, C., Siranosian, A., Krstić, M.: Extremum seeking for moderately unstable systems and for autonomous target tracking without position measurements. Automatica 43, 1832–1839 (2007)
Zhang, C., Arnold, D., Ghods, N., Siranosian, A., Krstić, M.: Source seeking with nonholonomic unicycle without position measurement and with tuning of forward velocity. Syst. Control Lett. 56, 245–252 (2007)
Cochran, J., Krstić, M.: Nonholonomic source seeking with tuning of angular velocity. IEEE Trans. Autom. Control 54(4), 713–731 (2009)
Ghods, N., Krstić, M.: Speed regulation in steering-based source seeking. Automatica 46, 452–459 (2010)
Ghods, N., Krstić, M.: Source seeking with very slow or drifting sensors. ASME J. Dyn. Syst. Meas. Control 133 (2011)
Stankovic, M.S., Stipanovic, D.M.: Stochastic extremum seeking with applications to mobile sensor networks. In: Proceedings of the American Control Conference, pp. 5622–5627 (2009)
Stankovic, M.S., Stipanovic, D.M.: Discrete time extremum seeking by autonomous vehicles in a stochastic environment. In: Proceedings of the Conference on Decision and Control, pp. 4541–4546 (2009)
Liu, S.-J., Krstić, M.: Stochastic source seeking for nonholonomic unicycle. IEEE Trans. Autom. Control 46, 1443–1453 (2010)
Cochran, J., Krstić, M.: 3-d source seeking for underactuated vehicles without position measurement. IEEE Trans. Robot. 25(1), 117–129 (2009)
Cochran, J., Kanso, E., Krstic, M.: Source seeking for a three-link model of fish locomotion. In: Proceedings of the American Control Conference, pp. 1808–1813 (2009)
Cochran, J., Kanso, E., Kelly, S.D., Xiong, H., Krstić, M.: Source seeking for two nonholonomic models of fish locomotion. IEEE Trans. Robot. 25(5), 1166–1176 (2009)
Krstić, M., Cochran, J.: Extremum seeking for motion optimization: from bacteria to nonholonomic vehicles. In: Proceedings of the Chinese Control and Decision Conference, pp. 18–27 (2008)
Fu, L., Özgüner, Ü.: Sliding mode in constrained source tracking with non-holonomic vehicles. In: International Workshop on Variable Structure Systems (VSS’08), pp. 30–34 (2008)
Fu, L., Özgüner, Ü.: Extremum-seeking control in constrained source tracing with nonholonomic vehicles. IEEE Trans. Ind. Electron. 56(9), 3602–3608 (2009)
Mayhew, C.G., Sanfelice, R.G., Teel, A.R.: Robust source-seeking hybrid controller for autonomous vehicles. In: Proceedings of the American Control Conference, pp. 1185–1190 (2007)
Biyik, E., Arcak, M.: Gradient climbing in formation via extremum seeking and passivity-based coordination rules. In: Proceedings of the Conference on Decision and Control, pp. 3133–3138 (2007)
Ghods, N., Frihauf, P., Krstic, M.: Multi-agent deployment in the plane using stochastic extremum seeking. In: Proceedings of the Conference on Decision and Control (2010)
Ghods, N., Krstic, M.: Multiagent deployment over a source. IEEE Trans. Control Syst. Technol., pp. 1–10 (2011)
Dixon, C., Frew, E.W.: Controlling the mobility of network nodes using decentralized extremum seeking. In: Proceedings of the Conference on Decision and Control, pp. 1291–1296 (2006)
Chichka, D.F., Speyer, J.L., Park, C.G.: Peaking-seeking control with application to formation flight. In: Proceedings of the 38th Conference on Decision and Control, vol. 5, pp. 2463–2470 (1999)
Xie, F., Zhang, X., Fierro, R., Motter, M.: Autopilot-based nonlinear UAV formation controller with extremum-seeking. In: Proceedings of the Conference on Decision and Control, pp. 4933–4938 (2005)
Popović, D., Janković, M., Magner, S., Teel, A.: Extremum seeking methods for optimization of variable cam timing engine operation. In: Proceedings of the American Control Conference, vol. 4, pp. 3136–3141 (2003)
Sugihira, S., Ichikawa, K., Ohmori, H.: Starting speed control of SI engine based on online extremum control. In: SICE Annual Conference 2007, pp. 2569–2573 (2007)
Haskara, Í., Zhu, G.G., Winkelman, J.: Multivariable EGR/spark timing control for IC engines via extremum seeking. In: Proceedings of the American Control Conference, pp. 163–164 (1999)
Gafvert, M., Arzen, K.-E., Pederson, L.M.: Simple linear feedback and extremum control of GDI engines. In: Seoul 2000 FISITA World Automotive Congress (2000)
Janković, M., Magner, S.: Optimization and scheduling for automotive powertrains. In: Proceedings of the American Control Conference, pp. 4054–4059 (2004)
Tanelli, M., Astolfi, A., Savaresi, S.M.: Non-local extremum seeing control for active braking control systems. In: Proceedings of the American Control Conference, pp. 891–896 (2006)
Wang, H.-H., Yeung, S., Krstić, M.: Experimental application of extremum seeking on an axial-flow compressor. IEEE Trans. Control Syst. Technol. 8(2), 300–309 (2000)
Schneider, G., Ariyur, K.B., Krstić, M.: Tuning of a combustion controller by extremum seeking: a simulation study. In: Proceedings of the 39th Conference on Decision and Control, vol. 5, pp. 5219–5223 (2000)
Banaszuk, A., Zhang, Y., Jacobson, C.A.: Adaptive control of combustion instability using extremum-seeking. In: Proceedings of the American Control Conference, vol. 1, pp. 416–422 (2000)
Schuster, E., Romero, C., Yao, Z., Si, F.: Integrated real-time optimization of boiler and post-combustion system in coal-based power plants via extremum seeking. In: IEEE International Conference on Control Applications (CCA, 2010), pp. 2184–2189 (2010)
Marcos, N.I., Guay, M., Dochain, D.: Output feedback adaptive extremum seeking control of a continuous stirred tank bioreactor with Monod’s kinetics. J. Process Control 14(11), 807–818 (2004)
Marcos, N.I., Guay, M., Dochain, D., Zhang, T.: Adaptive extremum-seeking control of a continuous stirred tank bioreactor with Haldane’s kinetics. J. Process Control 14(3), 317–328 (2004)
Titica, M., Dochain, D., Guay, M.: Adaptive extremum-seeking control of fed-batch bioreactors. Eur. J. Control 9(6), 614–627 (2003)
Peters, N., Guay, M., DeHaan, D.: Real-time dynamic optimization of batch systems. J. Process Control 17(3), 261–271 (2007)
Guay, M., Dochain, D., Perrier, M.: Adaptive extremum seeking control of continuous stirred tank bioreactors with unknown growth kinetics. Automatica 40(5), 881–888 (2004)
Guay, M., Dochain, D., Perrier, M.: Adaptive extremum-seeking control of nonisothermal continuous stirred tank reactors. Chem. Eng. Sci. 60(13), 3671–3681 (2005)
Hudon, N., Perrier, M., Guay, M., Dochain, D.: Adaptive extremum seeking control of a non-isothermal tubular reactor with unknown kinetics. Comput. Chem. Eng. 29, 839–849 (2005)
Cougnon, P., Dochain, D., Guay, M., Perrier, M.: Real-time optimization of a tubular reactor with distributed feed. AIChE J. 52(6), 2120–2128 (2006)
Hudon, N., Guay, M., Perrier, M., Dochain, D.: Adaptive extremum seeking control of tubular reactor with limited actuation. In: Proceedings of the American Control Conference, pp. 4563–4568 (2005)
Hudon, N., Guay, M., Perrier, M., Dochain, D.: Adaptive extremum-seeking control of convection-reaction distributed reactor with limited actuation. Comput. Chem. Eng. (Jan. 2008)
Bastin, G., Nešić, D., Tan, Y., Mareels, I.: On extremum seeking in bioprocesses with multivalued cost functions. Biotechnol. Prog. 25(3), 683–689 (2009)
Nguang, S.K., Cheng, X.D.: Extremum seeking scheme for continuous fermentation processes described by an unstructured fermentation model. Bioprocess Biosyst. Eng. 23(5), 417–420 (2000)
Beaudoin, J.F., Cadot, O., Aider, J.L., Wesfreid, J.E.: Bluff-body drag reduction by extremum-seeking control. J. Fluids Struct. 22(6–7), 973–978 (2006)
Creaby, J., Li, Y., Seem, J.E.: Maximizing wind turbine energy capture using multivariable extremum seeking control. Wind Eng. 33(4), 361–387 (2009)
Kim, K., Kasnakoglu, C., Serrani, A., Samimy, M.: Extremum-seeking control of subsonic cavity flow. AIAA J. 47(1), 195–205 (2009)
Sinha, A., Kim, K., Kim, J.-H., Serrani, A., Samimy, M.: Extremizing feedback control of a high-speed and high Reynolds number jet. AIAA J. 48(2), 387–399 (2010)
Zhang, T., Wen, J.T., Julius, A., Peles, Y., Jensen, M.K.: Extremum seeking micro-thermal-fluid control for active two-phase microelectronics cooling. In: Proceedings of the Conference on Decision and Control, pp. 1899–1904 (2010)
Luo, L., Schuster, E.: Boundary feedback control for heat exchange enhancement in 2d magnetohydrodynamic channel flow by extremum seeking. In: Proceedings of the Conference on Decision and Control, pp. 8272–8277 (2009)
Luo, L., Schuster, E.: Heat exchange enhancement by extremum seeking boundary feedback control in 3d magnetohydrodynamic channel flow. In: Proceedings of the Conference on Decision and Control, pp. 2972–2978 (2010)
Banaszuk, A., Narayanan, S., Zhang, Y.: Adaptive control of flow separation in a planar diffuser. In: 41st Aerospace Sciences Meeting & Exhibit (2003)
Peterson, K.S., Stefanopoulou, A.G.: Extremum seeking control for soft landing of an electromechanical valve actuator. Automatica 40(6), 1063–1069 (2004)
Centioli, C., Iannone, F., Mazza, G., Panella, M., Pangione, L., Podda, S., Tuccillo, A., Vitale, V., Zaccarian, L.: Extremum seeking applied to the plasma control system of the Frascati tokamak upgrade. In: Proceedings of the Conference on Decision and Control, pp. 8227–8232 (2005)
Carnevale, D., Zaccarian, L., Astolfi, A., Podda, S.: Extremum seeking without external dithering and its application to plasma RF heating on FTU. In: Proceedings of the Conference on Decision and Control, pp. 3151–3156 (2008)
Ou, Y., Xu, C., Schuster, E., Luce, T., Ferron, J.R., Walker, M.: Extremum-seeking finite-time optimal control of plasma current profile at the diii-d tokamak. In: Proceedings of the American Control Conference, pp. 4015–4020 (2007)
Cardenas, R., Pena, R.: Sensorless vector control of induction machines for variable-speed wind energy applications. IEEE Trans. Energy Convers. 19(1), 196–205 (2004)
Liu, Q., He, Y., Zhao, R.: The maximal wind-energy tracking control of a variable-speed constant-frequency wind-power generation system. Autom. Electr. Power Syst. 27(20), 62–67 (2003)
Geng, H., Yang, G.: A novel control strategy of MPPT taking dynamics of wind turbine into account. In: Proceedings of the 37th IEEE Power Electronic Specialists Conference, pp. 1–6 (2006)
Leyva, R., Alonso, C., Queinnec, I., Cid-Pastor, A., Lagrange, D., Martínez-Salamero, L.: MPPT of photovoltaic systems using extremum-seeking control. IEEE Trans. Aerosp. Electron. Syst. 42(1), 249–258 (2006)
Pan, T., Ji, Z., Jiang, Z.: Maximum power point tracking of wind energy conversion systems based on sliding mode extremum seeking control. In: Proceedings of the IEEE Energy Conference, pp. 1–5 (2008)
Zheng, X., Li, L., Xu, D., Platts, J.: Sliding mode MPPT control of variable speed wind power system. In: Asia-Pacific Power and Energy Engineering Conference (APPEEC 2009), pp. 1–4 (2009)
Bizon, N.: On tracking robustness in adaptive extremum seeking control of the fuel cell power plants. Appl. Energy 87(10), 3115–3130 (2010)
Moura, S.J., Chang, Y.A.: Asymptotic convergence through Lyapunov-based switching in extremum seeking with application to photovoltaic systems. In: Proceedings of the American Control Conference, pp. 3542–3548 (2010)
Fu, D., Xing, Y., Ma, Y.: MPPT of VSCF wind energy conversion system using extremum control strategy. In: World Non-Grid-Connected Wind Power and Energy Conference (WNWEC, 2010), pp. 1–6 (2010)
Lu, J., Zahedi, A.: Maximum efficiency point tracking control for fuel cell power systems. In: International Conference on Power System Technology (POWERCON, 2010), pp. 1–6 (2010)
Lei, P., Li, Y., Seem, J.: Sequential ESC based global MPPT control for photovoltaic array with variable shading. IEEE Trans. Sustain. Energy (2011)
Bratcu, A.I., Munteanu, I., Bacha, S., Picault, D., Raison, B.: Cascaded dc-dc converter photovoltaic systems: Power optimization issues. IEEE Trans. Ind. Electron. 58(2), 403–411 (2011)
Chang, Y.A., Moura, S.J.: Air flow control in fuel cell systems: An extremum seeking approach. In: Proceedings of the American Control Conference, pp. 1052–1059 (2009)
Komatsu, H.O.M., Miyamoto, H., Sano, A.: Output maximization control of wind turbine based on extremum control strategy. In: Proceedings of the American Control Conference, pp. 1739–1740 (2001)
Li, Y., Rotea, M.A., Chiu, G.T.-C., Mongeau, L.G., Paek, I.-S.: Extremum seeking control of tunable thermoacoustic cooler. In: Proceedings of the American Control Conference, pp. 2033–2038 (2004)
Dower, P., Farrell, P., Nešić, D.: Extremum seeking control of cascaded Raman optical amplifiers. IEEE Trans. Control Syst. Technol. 16(3), 396–407 (2008)
Schuster, E., Morinaga, E., Allen, C.K., Krstić, M.: Optimal beam matching in particle accelerators via extremum seeking. In: Proceedings of the American Control Conference, pp. 1962–1967 (2006)
Schuster, E., Xu, C., Torres, N.: Extremum seeking adaptive control of beam envelope in particle accelerators. In: Proceedings of the IEEE Conference on Control Applications (2006)
Schuster, E., Xu, C., Torres, N., Morinaga, E., Allen, C., Krstić, M.: Beam matching adaptive control via extremum seeking. Nucl. Instrum. Methods Phys. Res., Sect. A, Accel. Spectrom. Detect. Assoc. Equip. 581, 799–815 (2007)
Cistelecan, M.R.: Power control in mobile wireless network using sliding mode extremum seeking control implementing bifurcations. In: Proceedings of 17th IEEE International Conference on Control Applications, pp. 67–72 (2008)
Pan, Y., Furuta, K.: Variable structure control with sliding sector based on hybrid switching law. Int. J. Adapt. Control Signal Process. 21(8–9), 764–778 (2007)
Schuster, E., Sondak, D., Arastoo, R., Walker, M.L., Humphreys, D.A.: Optimal tuning of tokamak plasma equilibrium controllers in the presence of time delays. In: IEEE International Conference on Control Applications (CCA), Intelligent Control (ISIC, 2009), pp. 1188–1194 (2009)
Zuo, B., Hu, Y.-A., Li, J.: Pid controller tuning by using extremum seeking algorithm based on annealing recurrent neural network. In: 3rd International Symposium on Knowledge Acquisition and Modeling (KAM, 2010), pp. 132–135 (2010)
Dong, W., Hu, Y.-A., Zuo, B., Dong, W.: Backstepping control optimized by the multi-parameter ESA. In: International Conference on Artificial Intelligence and Education (ICAIE, 2010), pp. 155–158 (Oct. 2010)
Frihauf, P., Krstic, M., Basar, T.: Nash equilibrium seeking for games with non-quadratic payoffs. In: Proceedings of the Conference on Decision and Control, pp. 881–886 (2010)
Krstic, M., Frihauf, P., Krieger, J., Basar, T.: Nash equilibrium seeking with finitely- and infinitely-many players. In: Proceedings of the 8th IFAC Symposium on Nonlinear Control Systems (2010)
Stankovic, M.S., Johansson, K.H., Stipanovic, D.M.: Distributed seeking of Nash equilibria in mobile sensor networks. In: Proceedings of the Conference on Decision and Control, pp. 5598–5603 (2010)
Wang, H.-H., Krstić, M.: Extremum seeking for limit cycle minimization. IEEE Trans. Autom. Control 45(12), 2432–2436 (2000)
Johansen, T.A., Sbárbaro, D.: Lyapunov-based optimizing control of nonlinear blending processes. IEEE Trans. Control Syst. Technol. 13(4), 631–638 (2005)
Antonello, R., Oboe, R.: Stability analysis of an extremum seeking controller for mode-matching in vibrating microgyros. In: The 8th IEEE International Workshop on Advanced Motion Control, pp. 116–121 (2008)
Antonello, R., Oboe, R., Prandi, L., Biganzoli, F.: Automatic mode matching in MEMS vibrating gyroscopes using extremum-seeking control. IEEE Trans. Ind. Electron. 56(10), 3880–3891 (2009)
Danielson, C., Lacy, S., Hindman, B., Collier, P., Hunt, J., Moser, R.: Extremum seeking control for simultaneous beam steering and wavefront correction. In: Proceedings of the American Control Conference, pp. 4483–4488 (2006)
Sane, H.S., Haugstetter, C., Bortoff, S.A.: Building HVAC control systems—role of controls and optimization. In: Proceedings of the American Control Conference, pp. 1121–1126 (2006)
Li, P., Li, Y., Seem, J.E.: Extremum seeking control for efficient and reliable operation of air-side economizers. In: Proceedings of the American Control Conference, pp. 20–25 (2009)
Tyagi, V., Sane, H.S., Darbha, S.: An extremum seeking algorithm for determining the set point temperature for condensed water in a cooling tower. In: Proceedings of the American Control Conference, pp. 1127–1131 (2006)
Zhang, X.T., Dawson, D.M., Dixon, W.E., Xian, B.: Extremum seeking nonlinear controllers for a human exercise machine. In: Proceedings of the 43th Conference on Decision and Control, pp. 3950–3955 (2004)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2012 Springer-Verlag London Limited
About this chapter
Cite this chapter
Zhang, C., Ordóñez, R. (2012). Introduction. In: Extremum-Seeking Control and Applications. Advances in Industrial Control. Springer, London. https://doi.org/10.1007/978-1-4471-2224-1_1
Download citation
DOI: https://doi.org/10.1007/978-1-4471-2224-1_1
Publisher Name: Springer, London
Print ISBN: 978-1-4471-2223-4
Online ISBN: 978-1-4471-2224-1
eBook Packages: EngineeringEngineering (R0)