On the Optimal Control of a Random Walk with Jumps and Barriers
- First Online:
The modeling and optimal control of a class of random walks (RWs) is investigated in the framework of the Chapman-Kolmogorov (CK) and Fokker-Planck (FP) equations. This class of RWs includes jumps driven by a compound Poisson process and are subject to different barriers. A control mechanism is investigated that is included in the CK stochastic transition matrix and the purpose of the control is to track a desired discrete probability density function and attain a desired terminal density configuration. Existence and characterization of optimal controls are discussed. The proposed approach allows the derivation of a new FP model that accommodates the presence of the jumps and guarantees conservation of total probability in the case of reflecting barriers, which are modelled by appropriate operators. Results of numerical experiments are presented that successfully validate the proposed control framework.
KeywordsRandom walk with jumps Optimal control Modeling of random walk Fokker-Planck equation
Mathematics Subject Classification (2010)93E20 60G50 34K99 60J27
Unable to display preview. Download preview PDF.
- Amann H, Escher J (2008) Analysis II. BirkhäuserGoogle Scholar
- Annunziato M, Gottschalk H (2015) Calibration of Lévy processes using optimal control of Kolmogorov equations with periodic boundary conditions. arXiv:1506.08439
- Arnold L (1974) Stochastic differential equations. Wiley, New YorkGoogle Scholar
- Bensoussan A (2011) Stochastic control by functional analysis methods, vol 11. ElsevierGoogle Scholar
- Fleming WH, Soner HM (2006) Controlled Markov processes and viscosity solutions, vol 25. Springer Science & Business MediaGoogle Scholar
- Friedman A (2006) Stochastic differential equations and applications. Dover Publications, Inc., New YorkGoogle Scholar
- Luenberger DG (1969) Optimization by vector space methods. WileyGoogle Scholar
- Milstein GN, Tretyakov MV (2013) Stochastic numerics for mathematical physics. Springer Science & Business MediaGoogle Scholar