This is the second part of a work dealing with key issues that have not been addressed in the modeling and numerical optimization of nonlinear stochastic delay systems. We consider new classes of models, such as those with nonlinear functions of several controls (such as products), each with is own delay, controlled random Poisson measure driving terms, admissions control with delayed retrials, and others. Part I was concerned with issues concerning the class of admissible controls and their approximations, since the classical definitions are inadequate for our models. This part is concerned with transportation equation representations and their approximations. Such representations of nonlinear stochastic delay models have been crucial in the development of numerical algorithms with much reduced memory and computational requirements. The representations for the new models are not obvious and are developed. They also provide a template for the adaptation of the Markov chain approximation numerical methods.
This is a preview of subscription content, log in to check access.
Ethier, S.N., Kurtz, T.G.: Markov Processes: Characterization and Convergence. Wiley, New York (1986)
Kushner, H.J.: Numerical algorithms for optimal controls for nonlinear stochastic systems with delays. IEEE Trans. Autom. Control 55, 2170–2176 (2010)
Kushner, H.J.: Numerical methods for controls for nonlinear stochastic systems with delays and jumps: applications to admission control. Stoch., Int. J. Probab. Stat. 83, 277–310 (2011)
Kushner, H.J.: Numerical methods for the optimization of nonlinear stochastic delay systems, and an application to Internet regulation. In: Proceedings of the 49th Conference on Decision and Control. IEEE Press, New York (2010)
Krstic, M.: Compensation of infinite-dimesional actuator and sensor dynamics: nonlinear and adaptive systems. IEEE Control Syst. Mag. 30, 22–41 (2010)
Kushner, H.J., Dupuis, P.: Numerical Methods for Stochastic Control Problems in Continuous Time, Springer, Berlin (1992), 2nd edn. (2001)
Vinter, R.B., Kwong, R.H.: The infinite time quadratic control problem for linear systems with state and control delays: an evolution equation approach. SIAM J. Control Optim. 19, 139–153 (1981)