Abstract
We present a prototype expert system for the treatment of stochastic control problems. The objective is to automate all the steps involved in the solution of such problems, using computer algebra, inference techniques and symbolic manipulations. The system, written in Macsyma, Lisp and Prolog, accepts input in natural language and in symbolic form; it carries out the basic analysis of the problem, makes theoretical analyses to study the existence and uniqueness of solutions and selects a method among: Dynamic Programming, Optimization in the class of local feedbacks, Monte Carlo or Stochastic Gradient method, Perturbation method. The system generates a Fortran code for the numerical solution of the problem and finally a report including a description of the method and graphs for the numerical results. In this paper, we emphasize the automatic generation of the report.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Bellman, R. (1957), Dynamic Programming, Princeton University Press.
Bensoussan, A. (1982), Stochastic Control by Functional Analysis Methods, North-Holland.
Bensoussan, A. (1985), Méthodes de perturbation en contrôle optimal.
Bensoussan, A. and Lesourne, J. (1981), ‘Optimal growth of a firm facing a risk of bankruptcy’, Infor. 19 (4), 292–310 (Nov).
Bensoussan, A. and Lions, J.L. Application des inéquations variationnelles en contrôle stochastique. Dunod.
Chancelier, J.P., Gomez, C., Quadrat, J.P., and Sulem, A. (1985), ‘Vers un système expert pour 1'optimisation de systèmes dynamiques’. Congrès d'Analyse Numérique INRIA, Versailles, North Holland (December).
Chancelier, J.P., Gomez, C., Quadrat, J.P., and Sulem, A. (1986), ‘Automatique study in stochastic control’. Proc. Conf. Stochastic Control, Minneapolis, IMA, to appear.
Blankenship, G.L., Chancelier, J.P., Gomez, C., La Vigna, A., MacEnany, D.C., Quadrat, J.P., Sulem, A., and Yan, I. (1984), ‘An expert system for control and signal processing with automatic Fortran program generation’. Proc. MNTS Conference Stockholm, (June).
Claude, D. (1982), ‘Decoupling of nonlinear systems’. Systems Control Letters no. 1. pp. 242–248.
Colleter, P., Delebecque, F., Falgarone, F. and Quadrat, J.P. (1980), ‘Application of stochastic control methods to the management of energy production in New Caledonia’. Applied Stoch. Cont. in Econ. and Manag. Sc. A. Bensoussan (ed.), North-Holland.
Cruz, J.B. (1972), Feedback systems. McGraw-Hill.
Delebecque, F. and Quadrat, J.P. (1978), ‘Sur l'estimation des caractéristiques locales d'un processus de diffusion avec sauts’. Rapport INRIA. idem (1981), ‘Contribution of stochastic control singular perturbation averaging and team theories to an example of large-scale system: management of hydropower production’. EDF, Bulletin serie C, No. 2.
Dodu, J.C., Goursat, M., Hertz, A., Quadrat, J.P., and Viot, M. (1981), ‘Méthodes de gradient stochastique pour l'optimisation des investissements dans un réseau électrique’. EDF Bulletin Série C, No. 2.
Fleming, W.H. (1971), ‘Control for small noise intensities’. SIAM J. Control, 9 (3).
Fleming, W.H. and Rishel, R. (1975), Optimal Deterministic and Stochastic Control, Springer-Verlag.
Geromel, F., Levine, J., and Willis, P. (1984), ‘A fast algorithm for systems decoupling using formal calculus’, L.N.C.I.S. No. 63, Springer-Verlag, 1984.
Gloess, P. (1984), Logis User's Manual. Université de Compiègne, January.
Gomez, C., Quadrat, J.P., and Sulem, A. (1984), ‘Towards an expert system in stochastic control: the Hamilton-Jacobi equation part’. L.N.C.I.S. No. 63, Springer-Verlag.
Gomez, C., Quadrat, J.P., and Sulem, A. (1985), “Towards an expert system in stochastic control: the local-feedback part”. Congrès Rome sur le contrôle stochastique, L.N.C.I.S., Springer Verlag.
Gomez, C., Quadrat, J.P., and Sulem, A. (1985) ‘Computer algebra as a tool for solving optimal control prolems’. Appliations of Computer Algebra. R. Pavelle (ed.) Kluwer Academic Publ.
Goursat, M. and Quadrat, J.P. (1975a), ‘Analyse numérique d'inéquations quasi-variationnelles elliptiques associées à des problèmes de contrôle impulsionnel’, IRIA RapportIdem (1975b), ‘Analyse numérique d'inéquations variationnelles elliptiques associées à des problèmes de temps d'arrêt optimaux’. IRIA Rapport.
Kushner, H.J. (1977), Probability Methods in Stochastic Control and for Elliptic Equations. Academic Press.
Kushner, H.J. and Clark, D.S. (1978). Stochastic Approximation Methods for Constrained and Unconstrained Systems. Springer-Verlag.
Lions, J.L. (1969), Quelques méthodes de résolution des problèmes aux limites non linéaires. Dunod, Gauthier-Villars.
LISP Machine (1982), Lisp Manual, MIT Press.
MACSYMA Manual (1983), MIT Press.
Polyak, B.T. (1973), ‘Convergence and convergence rate of iterative stochastic algorithms’. Automatica i Telemekhanika, 3.
Polyak, B.T. (1978), Subgradient methods, a Survey of Soviet Research in Nonsmooth Optimization'. C. Lemarechal and K. Mifflin (eds.) Pergamon Press.
Polyak, B.T. and Tsypkin, Y.Z. (1973), ‘Pseudogradient adaptation and training algorithms’. Automatica i Telemekhanika, 3.
Quadrat, J.P. (1974), ‘Numerical application of stochastic optimal control to inventory and investment problems’. Congres IMP Stockholm.
Quadrat, J.P. and Viot, M. (1980), ‘Produce form and optimal local feedback for multi-index Markov chains’. Allerton Conference.
Queinnec, C. (1983), ‘LISP language d'un autre type’. Eyrolles.
Robbins, H. and Monro, S. (1951), ‘A stochastic approximation method’. Ann. Math. Statist. 22, 400–407.
‘THEOSYS Numerical methods in stochastic control’ (1983). RAIRO Automatique.
Torrion, X. (1985), Différentes méthodes d'optimisation appliquées à la gestion annuelle du dystème offre-demande français’. Note EDF, EEG.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Chancelier, JP., Gomez, C., Quadrat, JP. et al. An Expert System for Stochastic Control Problems: Automatic Report Generation. Computer Science in Economics and Management 2, 65–82 (1989). https://doi.org/10.1007/BF00454705
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF00454705