Optimization Techniques for State-Constrained Control and Obstacle Problems
- 265 Downloads
The design of control laws for systems subject to complex state constraints still presents a significant challenge. This paper explores a dynamic programming approach to a specific class of such problems, that of reachability under state constraints. The problems are formulated in terms of nonstandard minmax and maxmin cost functionals, and the corresponding value functions are given in terms of Hamilton-Jacobi-Bellman (HJB) equations or variational inequalities. The solution of these relations is complicated in general; however, for linear systems, the value functions may be described also in terms of duality relations of convex analysis and minmax theory. Consequently, solution techniques specific to systems with a linear structure may be designed independently of HJB theory. These techniques are illustrated through two examples.
KeywordsNonlinear systems control synthesis state constraints obstacle problems dynamic programming variational inequalities convex analysis
- 2.KURZHANSKI, A. B., and VARAIYA, P., Reachability under State Constraints. The Ellipsoidal Technique, Proceedings of the IFAC 2002 World Congress, Barcelona, Spain, Elsevier, Amsterdem, Holland, 2002.Google Scholar
- 3.KURZHANSKI, A. B., and VARAIYA, P., On Some Nonstandard Dynamic Programming Problems of Control Theory, Variational Methods and Applications, Edited by F. Giannessi and A. Maugeri, Kluwer Academic Publishers, New York, NY, pp. 613–627, 2004.Google Scholar
- 4.GUSEV, M. I., and KURZHANSKI, A. B., Optimization of Controlled Systems with Bounds on the Controls and State Coordinates, Differential Equations, Vol. 7, pp. 1591–1602, 1971, and Vol. 7, pp. 1789–1800, 1971.Google Scholar
- 5.KRASOVSKII N. N., Game-Theoretic Problems on the Encounter of Motions, Nauka, Moscow, Russia, 1970 (in Russian). English Translation: Rendezvous Game Problems, National Technical Information Service, Springfield, Virginia, 1971.Google Scholar
- 6.KURZHANSKI, A. B., Control and Observation under Uncertainty, Nauka, Moscow, Russia, 1977 (in Russian).Google Scholar
- 7.KURZHANSKI, A. B., and OSIPOV, YU. S., On Optimal Control under Restricted Coordinates, PMM (Applied Mathematics and Mechanics), Vol. 33, pp. xxx–xxx, 1969.Google Scholar
- 8.LEITMANN, G., Optimality and Reachability via Feedback Controls, Dynamic Systems and Microphysics, Edited by A. Blaquière and G. Leitmann, Academic Press, New York, NY, pp. 119–141, 1982.Google Scholar
- 9.LYGEROS, J., On the Relation of Reachability to Minimum-Cost Control, Proceedings of the 41st IEEE Control and Decision Conference, Las Vegas, Nevade, 2002.Google Scholar
- 10.KURZHANSKI, A. B., MITCHELL, I. M., and VARAIYA, P., Control Synthesis for State Constrained and Obstacle Problems, Proceedings of the IFAC Symposium NOLCOS-2004, Stuttgart, Germany, Elsevier, Amsterdam, Holland, 2004.Google Scholar
- 11.FILIPPOV A. F., Differential Equations with a Discontinuous Right-Hand Side, Kluwer Academic Publishers, Dondrecht, Holland, 1988.Google Scholar
- 17.LIONS P. L., Viscosity Solutions and Optimal Control, Proceedings of the International Congress on industrial and Applied Mathematics, ICIAM 91, SIAM Publications, Philadelphia, Pennsylvania, pp. 182–195, 1992.Google Scholar
- 18.SUBBOTIN, A. I., Generalized Solutions of First-Order PDE's: The Dynamic Optimization Perspective, Birkhauser, Boston, Massachusettss, 1995.Google Scholar
- 21.OSHER, S., and FEDKIW, R., Level Set Methods and Implicit Surfaces, Springer Verlag, New York, NY, 2002.Google Scholar
- 22.MITCHELL, I., A Toolbox of Level Set Methods, Technical Report TR-2004-09, Department of Computer Science, University of British Columbia, Vancouver, BC, Canada, 2004 (Available at http://www.cs.ubc.ca/~mitchell/ToolboxLS).
- 23.VARAIYA P., Reach Set Computation Using Optimal Control, Proceedings of the KIT Workshop on Verification of Hybrid Systems, Verimag, Grenoble, France, 1998.Google Scholar
- 25.FAN, K., Minimax Theorems, Proceedings of the National Academy of Sciences of the USA, Vol. 31, pp. 42–47, 1953.Google Scholar
- 26.DEMYANOV, V. F., and MALOZEMOV, X. X., Introduction to the Minmax, Halsted Press, New York, NY, 1974.Google Scholar
- 28.KURZHANSKI, A. B., MITCHELL, I. M., and VARAIYA, P., Optimization Techniques for State-Constrained and Obstacle Problems, Available at (http://paleale.eecs.berkeley.edu/~varaiya/hybrid.html).