Abstract
A procedure for designing a feedback control to asymptoticallystabilize, with probability one, a quasi-partially integrableHamiltonian system is proposed. First, the averaged stochasticdifferential equations for controlled r first integrals are derived fromthe equations of motion of a given system by using the stochasticaveraging method for quasi-partially integrable Hamiltonian systems.Second, a dynamical programming equation for the ergodic control problemof the averaged system with undetermined cost function is establishedbased on the dynamical programming principle. The optimal control law isderived from minimizing the dynamical programming equation with respectto control. Third, the asymptotic stability with probability one of theoptimally controlled system is analyzed by evaluating the maximalLyapunov exponent of the completely averaged Itô equations for the rfirst integrals. Finally, the cost function and optimal control forces aredetermined by the requirements of stabilizing the system. An example isworked out in detail to illustrate the application of the proposedprocedure and the effect of optimal control on the stability of thesystem.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Khasminskii, R. Z., Stochastic Stability of Differential Equation, Sijthoff and Noordhoff, Alphen aan de Rijn, 1980.
Afanasev, V. N., Kolmanovskii, V. B., and Nosov, V. R., Mathematical Theory of Control Systems Design, Kluwer, Dordrecht, 1996.
Florchinger, D., 'Feedback stabilization of affine in the control stochastic differential systems by the control Lyapunov function method', SIAM Journal of Control and Optimization 35, 1997, 500–511.
Krstic, M. and Deng, H., Stabilization of Nonlinear Uncertain Systems, Springer, London, 1998.
Oseledec, V. I., 'A multiplicative ergodic theorem: Lyapunov characteristic number for dynamical systems', Transactions of Moscow Mathematical Society 19, 1968, 197–231.
Khasminskii, R. Z., 'Necessary and sufficient conditions for the asymptotic stability of linear stochastic systems', Theory of Probability and Application 12, 1967, 144–147.
Ariaratnam, S. T. and Xie, W. C., 'Lyapunov exponents and stochastic stability of coupled linear systems under real noise excitation', ASME Journal of Applied Mechanics 59, 1992, 664–673.
Zhu, W. Q. and Huang, Z. L., 'Lyapunov exponents and stochastic stability of quasi-integrable-Hamiltonian systems', ASME Journal of Applied Mechanics 66, 1999, 211–217.
Stratonovich, R. L., Topics in the Theory of Random Noise, Vol. 1. Gorden and Breach, New York, 1963.
Khasminskii, R. Z., 'A limit theorem for the solutions of differential equations with random right hand sides', Theory of Probability and Applications 11, 1966, 390–406.
Blankenship, G. and Papanicolaou, G. C., 'Stability and control of stochastic systems with wide-band noise disturbances', SIAM Journal of Applied Mathematics 34, 1978, 437–476.
Kushner, H. D. and Runggaldier, W., 'Nearly optimal state feedback controls for stochastic systems with wideband noise disturbances', SIAM Journal of Control and Optimization 25, 1987, 298–315.
Zhu, W. Q., Huang, Z. L., and Suzuki, Y., 'Stochastic averaging and Lyapunov exponent of quasi partially integrable Hamiltonian systems', International Journal of Non-Linear Mechanics 37, 2002, 419–437.
Zhu, W. Q. and Ying, Z. G., 'Optimal nonlinear feedback control of quasi Hamiltonian systems', Science in China (Series A) 42, 1999, 1213–1219.
Zhu, W. Q., Ying, Z. G., Ni, Y. Q., and Ko, J.M., 'Optimal nonlinear stochastic control of hysteretic systems', ASCE Journal of Engineering Mechanics 123, 2000, 1027–1032.
Zhu, W. Q., Ying, Z. G., and Soong, T. T., 'An optimal nonlinear feedback control strategy for randomly excited structural systems', Nonlinear Dynamics 24, 2001, 31–51.
Zhu, W. Q. and Yang, Y. Q., 'Stochastic averaging of quasi non-integrable Hamiltonian systems', ASME Journal of Applied Mechanics 64, 1997, 157–164.
Zhu, W. Q., Huang, Z. L., and Yang, Y. Q., 'Stochastic averaging of quasi integrable Hamiltonian systems', ASME Journal of Applied Mechanics 64, 1997, 975–984.
Fleming, W. H. and Soner, H. M., Controlled Markov Processes and Viscosity Solutions, Springer, New York, 1992.
Jiongmin, Y. and Xun, Y. Z., Stochastic Control, Hamiltonian Systems and HJB Equations, Springer, New York, 1999.
Khasminskii, R. Z., 'On the averaging principle for stochastic equation', Kibernetika 4, 1968, 260–279 [in Russian].
Kushner, J., 'Optimality conditions for the average cost per unit time problem with a diffusion model', SIAM Journal of Control and Optimization 16, 1978, 330–346.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Zhu, W.Q., Huang, Z.L. Stochastic Stabilization of Quasi-Partially Integrable Hamiltonian Systems by Using Lyapunov Exponent. Nonlinear Dynamics 33, 209–224 (2003). https://doi.org/10.1023/A:1026010007067
Issue Date:
DOI: https://doi.org/10.1023/A:1026010007067