Cumulants and Risk-Sensitive Control: A Cost Mean and Variance Theory with Application to Seismic Protection of Structures
The risk-sensitive optimal stochastic control problem is interpreted in terms of managing the value of linear combinations of the cumulants of a traditional performance index. The coefficients in these linear combinations are fixed, explicit functions of the risk parameter. This paper demonstrates the possibility of controlling linear combinations of index cumulants with broader opportunities to choose the coefficients. In view of the considerable interest given to cumulants in the theories of signal processing, detection, and estimation over the last decade, such an interpretation offers the possibility of new insights into the broad modern convergence of the concepts of robust control in general. Considered in detail are the foundations for a full-state-feedback solution to the problem of controlling the second cumulant of a cost function, given modest constraints on the first cumulant. The formulation is carried out for a class of nonlinear stochastic differential equations, associated with an appropriate class of nonquadratic performance indices. A Hamilton-Jacobi framework is adopted; and the defining equations for solving the linear, quadratic case are determined. The method is then applied to a situation in which a building is to be protected from earthquakes. Densities of the cost function are computed, so as to give insight into the question of how the first and second cumulants affect a cost considered as a random variable.
KeywordsEntropy Covariance Doyle
Unable to display preview. Download preview PDF.
- Başar, T. and P. Bernhard. H ∞ -Optimal Control and Related Minimax Design Problems. Birkhäuser, Boston, 1991.Google Scholar
- Fleming, W. H. and H. M. Soner. Controlled Markov Processes and Viscosity Solutions. Springer-Verlag, New York, 1992.Google Scholar
- Glover, K. Minimum Entropy and Risk-Sensitive Control: The Continuous Time Case. Proceedings of the 28th IEEE Conference on Decision and Control, pp. 388–391, December 1989.Google Scholar
- Liu, R. W. and R.J.L. Leake. Inverse Lyapunov Problems. Technical Report No. EE-6510, Department of Electrical Engineering, University of Notre Dame, August 1965.Google Scholar
- Sain, M. K. On Minimal-Variance Control of Linear Systems with Quadratic Loss. Ph.D. Dissertation, Department of Electrical Engineering, University of Illinois, Urbana, January 1965.Google Scholar
- Sain, M. K. A Sufficiency Condition for Minimum Variance Control of Markov Processes. Proceedings of the Fourth Allerton Conference on Circuit and System Theory, Monticello, IL, pp. 593–599, October 1966.Google Scholar
- Sain, M. K. Performance Moment Recursions, with Application to Equalizer Control Laws. Proceedings of the Fifth Allerton Conference on Circuit and System Theory, Monticello, IL, pp. 327–336, 1967.Google Scholar
- Won, Chang-Hee, M. K. Sain, and B. F. Spencer, Jr. Performance and Stability Characteristics of Risk-Sensitive Controlled Structures under Seismic Disturbances. Proceedings of the American Control Conference, pp. 1926–1930, June 1995.Google Scholar
- Wonham, W. M. Stochastic Problems in Optimal Control. 1963 IEEE Int. Conv. Rec., part 2, pp. 114–124,1963.Google Scholar