Abstract
The aim of this tutorial paper is to present the relationship that exists between the control of singularly perturbed hybrid stochastic systems and the decomposition approach in structured linear programs The mathematical sophistication is voluntarily kept at a low level byavoiding the full development of the theorems demonstrations that can be found in papers already published or to appear shortly. On another hand, since it corresponds to a new application of a convex optimization method that has been successfully applied in other contexts, we give a rather detailed account of the decomposition technique used in the numerical approximation method and of the comparison with a direct linear programming method.
This research has been supported by The Swiss Science Foundation (FNRS # 1214-057093.99).
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Abbad, M. (1991). Perturbation and Stability Theory for Markov Control ProblemsPh.D. thesis, University of Maryland at Baltimore County, Dept. of Mathematics.
Abbad, M., Filar, J.A.(1992). Algorithms for singularly perturbed limiting average markov control problems. IEEE Transactions on Automatic Control, 37: 1421–1425.
Benders, J.F. (1962). Partitioning procedures for solving mixed-variables programming problems. Numerische Mathematik, 4: 238–252.
de Ghellinck, G.T. (1960). Les problè de décision séquentielles. Cahier du Centre d’Etudes de Recherche Operationnelle, 2: 161–179.
du Merle, 0. (1995).Interior points and cutting planes: development and inmplementation of methods for convex optimization and large scale structured linear programmingPhD thesis, Department of Management Studies, University of Geneva, Switzerland. (in French.)
Filar, J.A., and Haurie, A. (1997). Optimal ergodic control of singularly perturbed hybrid stochastic systems.Lectures in Applied Mathematics33: 101-126.
Filar, J.A., and Haurie, A. (2001). A two factor stochastic production model with two time scales. Automatica, 37: 1505–1513.
Ghost, M.K., Arapostathis, A., and Marcus, S.I. (1997). Ergodic control of switching diffusionSIAM Journal of Control and Optimization35(6): 1952-1988.
Goffin, J.-L.,Haurie, A. and Vial,J.-P.(1992).Decomposition and nondifferentiable optimization with the projective algorithm.Management Science38: 284—302.
Goffin, J.-L. and Vial, J.-P. (1999) Convex nondifferentiable optimization: a survey focussed on the analytic center cutting plane method. Technical report, Logilab, Department of Management Studies, University of Geneva, Switzerland. To appear inOptimization Methods and Software
Gondzio, J., du Merle, O., Sarkissian, R., and Vial, J.-P. (1996). ACCPM—a library for convex optimisation based on an analytic center cutting plane method. European Journal of Operational Research94: 206-211.
Kushner, H.J. and Dupuis, P.G. (1992). Numerical Methods for Stochastic Control Problems in Continuous Time. Springer Verlag, New York.
Layard, P.R.G. and Walters, A.A. (1978)Microeconomic Theory)McGraw Hill, New York.
Manne, A. (1960). Linear programming and sequential decisions.Management Science6(3):259-267.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Kluwer Academic Publishers
About this chapter
Cite this chapter
Haurie, A., Moresino, F., Vial, JP. (2002). Singularly Perturbed Hybrid Control Systems Approximated by Structured Linear Programs. In: Hou, Z., Filar, J.A., Chen, A. (eds) Markov Processes and Controlled Markov Chains. Springer, Boston, MA. https://doi.org/10.1007/978-1-4613-0265-0_28
Download citation
DOI: https://doi.org/10.1007/978-1-4613-0265-0_28
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4613-7968-3
Online ISBN: 978-1-4613-0265-0
eBook Packages: Springer Book Archive