Analysis of Divergence pp 417-440 | Cite as

# Optimal control of divergent control systems

## Abstract

The study of Lagrange problems defined on an unbounded interval begins in the arena of mathematical economics when Ramsey [36] formulated a model of economic growth and, through the development of the Euler-Lagrange equations, stated the fist “golden rule of accumulation” now known as Ramsey’s rule. The study of these problems remained dormant until the 1940’s when the students of Tonelli initiated a systematic treatment for free problems in the calculus of variations defined on [0,∞).These works; Cinquini [18], [19], Faedo [22], [23], and Darbo [21]; provide a rather complete theory providing existence theorems, necessary conditions, and most importantly (at least for the purposes here) the asymptotic convergence of optimal trajectories to a steady state. In all of these works, the objective or cost function was assumed to be a convergent improper integral. That this may not be the case was realized by Ramsey in his seminal paper. To circumvent this he introduced what we now call the “optimal steady-state problem,” which in Rarnsey’s model was referred to as the “maximal sustainable rate of enjoyment,” or more simply as “Bliss.” In his approach, Ramsey introduces a new problem in which the optimal value is finite whenever it is possible to “control” the system to reach Bliss in a finite time. This approach leads to what we now know as the *asymptotic* *turnpike theory*.

## Keywords

Optimal Control Problem State Constraint Optimal Trajectory Admissible Pair Infinite Horizon## Preview

Unable to display preview. Download preview PDF.

## References

- [1]H. Atsumi, Neoclassical growth and the efficient program of capital accumulation, Review of Economic Studies
**30**(1963), 127–136.Google Scholar - [2]E. J. Balder, An existence result for optimal economic growth, Journal of Mathematical Analysis and its Applications 95 (1983), 195–213.MathSciNetMATHCrossRefGoogle Scholar
- [3]G. R. Bates, Lower closure and existence theorems for optimal control problems with infinite horizon, Journal of Optimization Theory and Applications
**24**(1978), 639–649.MathSciNetMATHCrossRefGoogle Scholar - [4]R. F. Baum, Existence theorems for lagrange control problems with unbounded time domain, Journal of Optimization Theory and Applications
**19**(1976), 89–116.MathSciNetMATHCrossRefGoogle Scholar - [5]W. A. Brock and A. Haurie, On existence of overtaking optimal trajectories over an infinite time horizon, Mathematics of Operations Research
**1**(1976), 337–346.MathSciNetMATHCrossRefGoogle Scholar - [6]C. Carathéodory, Calculus of variations and partial differential equations, Chelsea, New York, New York, 1982.MATHGoogle Scholar
- [7]D. A. Carlson, On the existence of catching up optimal solutions for lagrange problems defined on unbounded intervals, Journal of Optimization Theory and Applications
**49**(1986), 207–225.MathSciNetMATHCrossRefGoogle Scholar - [8]D. A. Carlson, The existence of catching-up optimal solutions for a class of infinite horizon optimal control problems with time delay, SIAM Journal on Control and Optimization
**28**(1990), 402–422.MathSciNetMATHCrossRefGoogle Scholar - [9]D. A. Carlson, Asymptotic stability for optimal trajectories of infinite horizon optimal control models with state and control dependent discounting, Proceedings of the International Workshop in Analysis and its Applications (Novi Sad, Yugoslavia) (C. Stanojević and O. Hadžić, eds.), Institute of Mathematics, 1991, pp. 281–300.Google Scholar
- [10]D. A. Carlson, Overtaking optimal solutions for convex lagrange problems with time delay, Journal of Mathematical Analysis and Applications
**208**(1997), 31–48.MathSciNetMATHCrossRefGoogle Scholar - [11]D. A. Carlson and Haurie A., Overtaking equilibria for infinite horizon dynamic games with coupled state constraints, to appear in the Annals of International Society of Dynamic Games.Google Scholar
- [12]D. A. Carlson, A. Haurie, and A. Jabrane, Existence of overtaking solutions to infinite dimensional control problems on unbounded intervals, SIAM Journal on Control and Optimization
**25**(1987), 1517–1541.MathSciNetMATHCrossRefGoogle Scholar - [13]D. A. Carlson, A. Haurie, and A. Leizarowitz, Infinite horizon optimal control: Deterministic and stochastic systems, 2nd ed., Springer- Verlag, New York, 1991.MATHGoogle Scholar
- [14]D.A. Carlson, Infinite-horizon optimal controls for problems governed by a volterra integral equation with state-and-control-dependent discount factor, Journal of Optimization Theory and Applications
**66**(1990), no. 2, 311–336.MathSciNetMATHCrossRefGoogle Scholar - [15]D. Cass and K. Shell, The hamiltonian approach to dynamic economies, Academic Press, New York, New York, 1976.Google Scholar
- [16]L. Cesari, Optimization-theory and applications: Problems with ordinary differential equations, Applications of Applied Mathematics, vol. 17, Springer-Verlag, New York, 1983.MATHGoogle Scholar
- [17]S. Chakravarty, The existence of an optimum savings program, Econometrica
**30**(1962), 178–187.MATHCrossRefGoogle Scholar - [18]S. Cinquini, Una nuova estensione dei moderni metodi del calcolo delle variazioni, Annali della Scuola Normale Superiore di Pisa, Serie 2
**9**(1940), 258–261.Google Scholar - [19]S. Cinquini, Sopra l’esistenza delľestremo assoluto per integrali estesi a intervalli infiniti, Rendiconti della Accademia Nazionale dei Lincei, Serie 8
**32**(1962), 320–325 and 845–851.MathSciNetMATHGoogle Scholar - [20]F. H. Clarke, Optimization and nonsmooth analysis, John Wiley and Sons, Inc., New York, New York, 1983.MATHGoogle Scholar
- [21]G. Darbo, L’estremo assoluto per gli integrali su intervallo infinito, Rendiconti del Seminario Matematico dell’Universitá Padova
**22**(1953), 319–416.Google Scholar - [22]S. Faedo, Il calcolo dell variazioni per gli integrali su intervalli infiniti, Commentationes Pontificia Academia Scientarium
**8**(1944), 319–421.MathSciNetGoogle Scholar - [23]S. Faedo, Il calcolo delle variazoni per gli integrali su intervalli infiniti, Rendiconti di Matematica e delle Sue Applicazioni
**8**(1949), 94–125.MathSciNetMATHGoogle Scholar - [24]S. Faedo, Il calcolo delle variazioni per gli integrali estesi a intervalli infiniti, Annali della Suola Normale Superiore di Pisa
**7**(1968), 91–132.MathSciNetGoogle Scholar - [25]C. D. Feinstein and S. S. Oren, A “funnel” turnpike theorem for optimal growth problems with discounting, Journal of Economic Dynamics and Control 9 (1985), 25–39.MathSciNetCrossRefGoogle Scholar
- [26]C.D. Feinstein and D.G. Luenberger, Analysis of the asymptotic behavior of optimal control trajectories, SIAM Journal on Control and Optimization
**19**(1981), 561–585.MathSciNetMATHCrossRefGoogle Scholar - [27]H. Halkin, Necessary conditions for optimal control problems with infinite horizon, Econometrica
**42**(1974), 267–273.MathSciNetMATHCrossRefGoogle Scholar - [28]A. Leizarowitz, Existence of overtaking optimal trajectories for problems with convex integrands, Mathematics of Operations Research
**10**(1985), 450–461.MathSciNetMATHCrossRefGoogle Scholar - [29]A. Leizarowitz, Infinite-horizon stochastic regulation and tracking with the overtaking criterion, Stochastics
**22**(1987), 117–150.MathSciNetMATHCrossRefGoogle Scholar - [30]A. Leizarowitz, Optimal trajectories of infinite horizon deterministic control systems, Applied Mathematics and Optimization
**19**(1989), 11–39.MathSciNetMATHCrossRefGoogle Scholar - [31]A. Leizarowitz, Optimal control for diffusions in ℝ
^{d}-a min-max formula for the minimal cost-growth rate, Journal of Mathematical Analysis and its Applications (1990).Google Scholar - [32]M. Magill, On a general economic theory of motion, Springer-Verlag, 1970.MATHGoogle Scholar
- [33]L. W. McKenzie, Turnpike theorems for a generalized leontief model, Econometrica
**31**(1963), 165–180.MATHCrossRefGoogle Scholar - [34]Lionel W. McKenzie, Turnpike theory, Econometrica
**44**(1976), no. 5, 841–865.MathSciNetMATHCrossRefGoogle Scholar - [35]R. Radner, Paths of economic growth that are optimal with regard only to final state: A turnpike theorem, Review of Economic Studies
**28**(1961), 98–104.CrossRefGoogle Scholar - [36]F. Ramsey, A mathematical theory of saving, Economic Journal
**38**(1928), 543–549.CrossRefGoogle Scholar - [37]R. T. Rockafellar, Convex Analysis, Princeton University Press, Princeton, New Jersey, 1970.MATHGoogle Scholar
- [38]R. T. Rockafellar, Saddle points of hamiltonian systems in convex lagrange problems having nonzero discount rate, Journal of Economic Theory
**12**(1976), 71–113.MathSciNetMATHCrossRefGoogle Scholar - [39]P.A. Samuelson, A caternary turnpike theory involving consumption and the golden rule, American Economic Review
**55**(1965), 486–496.Google Scholar - [40]L. J. Stern, Criteria for optimality in the infinite-time optimal control problem, Journal of Optimization Theory and Applications
**44**(1984), 497–508.MathSciNetMATHCrossRefGoogle Scholar - [41]J. Von Neumann, A model of general economic equilibrium, Review of Economic Studies
**13**(1945), 1–9.CrossRefGoogle Scholar - [42]C.C. Von Weizäcker, Existence of optimal programs of accumulation for an infinite time horizon, Review of Economic Studies
**32**(1965), 85–104.CrossRefGoogle Scholar - [43]A. Zaslavski, Optimal programs on infinite horizons 1 and 2, SIAM Journal on Control and Optimization
**33**(1995), 1643–1660, 1661–1686.MathSciNetMATHCrossRefGoogle Scholar