Skip to main content
SpringerLink
Log in

On the Maximum Principle for Optimal Control Problems of Stochastic Volterra Integral Equations with Delay

  • Published:
Applied Mathematics & Optimization Aims and scope Submit manuscript

Abstract

In this paper, we prove both necessary and sufficient maximum principles for infinite horizon discounted control problems of stochastic Volterra integral equations with finite delay and a convex control domain. The corresponding adjoint equation is a novel class of infinite horizon anticipated backward stochastic Volterra integral equations. Our results can be applied to discounted control problems of stochastic delay differential equations and fractional stochastic delay differential equations. As an example, we consider a stochastic linear-quadratic regulator problem for a delayed fractional system. Based on the maximum principle, we prove the existence and uniqueness of the optimal control for this concrete example and obtain a new type of explicit Gaussian state-feedback representation formula for the optimal control.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Abi Jaber, E., Miller, E., Pham, H.: Linear-Quadratic control for a class of stochastic Volterra equations: solvability and approximation. Ann. Appl. Probab. 31(5), 2244–2274 (2021)

    Article  MathSciNet  MATH  Google Scholar 

  2. Abi Jaber, E., Miller, E., Pham, H.: Integral operator Riccati equations arising in stochastic Volterra control problems. SIAM J. Control Optim. 59(2), 1581–1603 (2021)

    Article  MathSciNet  MATH  Google Scholar 

  3. Bergounioux, M., Bourdin, L.: Pontryagin maximum principle for general Caputo fractional optimal control problems with Borza cost and terminal constraints. ESAIM Control Optim. Calc. Var. 26, 35 (2020)

    Article  MATH  Google Scholar 

  4. Bismut, J.M.: An introductory approach to duality in optimal stochastic control. SIAM Rev. 20(1), 62–78 (1978)

    Article  MathSciNet  MATH  Google Scholar 

  5. Boltyanski, V.G., Gamkrelidze, R.V., Pontryagin, L.S.: On the theory of optimal processes. Dokl. Akad. Nauk SSSR 10, 7–10 (1956). (in Russian)

    MathSciNet  Google Scholar 

  6. Bonaccorsi, S., Confortola, F., Mastrogiacomo, E.: Optimal control for stochastic Volterra equations with completely monotone kernels. SIAM J. Control Optim. 50(2), 748–789 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  7. Chen, L., Wu, Z.: Maximum principle for the stochastic optimal control problem with delay and application. Automatica 46(6), 1074–1080 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  8. Confortola, F., Mastrogiacomo, E.: Feedback optimal control for stochastic Volterra equations with completely monotone kernels. arXiv:1112.3818

  9. Dalir, M., Bashour, M.: Applications of fractional calculus. Appl. Math. Sci. 4, 1021–1032 (2010)

    MathSciNet  MATH  Google Scholar 

  10. Diethelm, K.: The Analysis of Fractional Differential Equations. Springer, New York (2007)

    MATH  Google Scholar 

  11. Gripenberg, G., Londen, S.O., Staffans, O.: Volterra Integral and Functional Equations. Encyclopedia of Mathematics and its Applications, vol. 34. Cambridge University Press, Cambridge (1990)

    Book  MATH  Google Scholar 

  12. Hamaguchi, Y.: Infinite horizon backward stochastic Volterra integral equations and discounted control problems. ESAIM Control Optim. Calc. Var. 27(101), 47 (2021)

    MathSciNet  MATH  Google Scholar 

  13. Jajarmi, A., Baleanu, D.: Suboptimal control of fractional-order dynamic systems with delay argument. J. Vib. Control 24(12), 2430–2446 (2018)

    Article  MathSciNet  MATH  Google Scholar 

  14. Lin, P., Yong, J.: Controlled singular Volterra integral equations and Pontryagin maximum principle. SIAM J. Control Optim. 58(1), 136–164 (2020)

    Article  MathSciNet  MATH  Google Scholar 

  15. Mastrogiacomo, E.: Infinite horizon stochastic optimal control for Volterra equations with completely monotone kernels. J. Math. Anal. Appl. 472, 61–93 (2019)

    Article  MathSciNet  MATH  Google Scholar 

  16. Maslowski, B., Veverka, P.: Sufficient stochastic maximum principle for discounted control problem. Appl. Math. Optim. 70, 225–252 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  17. Moghaddam, B.P., Zhang, Lei, Lopes, A.M., Tenreiro Machado, J.A., Mostaghim, Z.S.: Sufficient conditions for existence and uniqueness of fractional stochastic delay differential equations. Stochastics 92(3), 379–396 (2020)

    Article  MathSciNet  MATH  Google Scholar 

  18. Øksendal, B., Sulem, A., Zhang, T.: Optimal control of stochastic delay equations and time-advanced backward stochastic differential equations. Adv. Appl. Probab. 43(2), 572–596 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  19. Orrieri, C., Veverka, P.: Necessary stochastic maximum principle for dissipative systems on infinite time horizon. ESAIM Control Optim. Calc. Var. 23, 337–371 (2017)

    Article  MathSciNet  MATH  Google Scholar 

  20. Peng, S.: A general stochastic maximum principle for optimal control problems. SIAM J. Control Optim. 28(4), 966–979 (1990)

    Article  MathSciNet  MATH  Google Scholar 

  21. Peng, S., Yang, Z.: Anticipated backward stochastic differential equations. Ann. Probab. 37, 877–902 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  22. Rahimy, M.: Applications of fractional differential equations. Appl. Math. Sci. 4, 2453–2461 (2010)

    MathSciNet  MATH  Google Scholar 

  23. Samko, S.G., Kilbas, A.A., Marichev, O.I.: Fractional Integrals and Derivatives. Theory and Applications. Gordon and Breach Science Publishers, Yverdon (1987)

    MATH  Google Scholar 

  24. Tien, D.N.: Fractional stochastic differential equations with applications to finance. J. Math. Anal. Appl. 397(1), 334–348 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  25. Wang, T.: Necessary conditions of Pontraygin’s type for general controlled stochastic Volterra integral equations. ESAIM Control Optim. Calc. Var. 26(16), 29 (2020)

    MathSciNet  MATH  Google Scholar 

  26. Wang, T., Yong, J.: Spike variations for stochastic Volterra integral equations. arXiv:2205.13486

  27. Wen, J., Shi, Y.: Solvability of anticipated backward stochastic Volterra integral equations. Stat. Probab. Lett. 156, 108599 (2020)

    Article  MathSciNet  MATH  Google Scholar 

  28. Yong, J.: Backward stochastic Volterra integral equations and some related problems. Stoch. Anal. Appl. 116(5), 779–795 (2006)

    MathSciNet  MATH  Google Scholar 

  29. Yong, J.: Well-posedness and regularity of backward stochastic Volterra integral equations. Probab. Theory Relat. Fields 142(1–2), 2–77 (2008)

    MathSciNet  Google Scholar 

  30. Yong, J., Zhou, X.Y.: Stochastic Controls: Hamiltonian Systems and HJB Equations. Springer, New York (1999)

    Book  MATH  Google Scholar 

  31. Zhang, X., Agarwal, P., Liu, Z., Peng, H., You, F., Zhu, Y.: Existence and uniqueness of solutions for stochastic differential equations of fractional-order \(q>1\) with finite delays. Adv. Differ. Equ. 2017, 123 (2017)

    Article  MathSciNet  MATH  Google Scholar 

Download references

Acknowledgements

The author was supported by JSPS KAKENHI Grant Number 21J00460 and also partly by JSPS KAKENHI Grant Number 22K13958.

Author information

Authors and Affiliations

  1. Department of Systems Innovation, Graduate School of Engineering Science, Osaka University, 1-3, Machikaneyama, Toyonaka, Osaka, Japan

    Yushi Hamaguchi

Authors
  1. Yushi Hamaguchi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yushi Hamaguchi.

Ethics declarations

Competing Interests

The author declares that he has no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hamaguchi, Y. On the Maximum Principle for Optimal Control Problems of Stochastic Volterra Integral Equations with Delay. Appl Math Optim 87, 42 (2023). https://doi.org/10.1007/s00245-022-09958-w

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s00245-022-09958-w

Keywords

Mathematics Subject Classification

Search

Navigation