Skip to main content
Log in

On an Ergodic Two-Sided Singular Control Problem

  • Published:
Applied Mathematics & Optimization Aims and scope Submit manuscript

Abstract

Motivated by applications in natural resource management, risk management, and finance, this paper is focused on an ergodic two-sided singular control problem for a general one-dimensional diffusion process. The control is given by a bounded variation process. Under some mild conditions, the optimal reward value as well as an optimal control policy are derived by the vanishing discount method. Moreover, the Abelian and Cesàro limits are established. Then a direct solution approach is provided at the end of the paper.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Alvarez, L.H.R.: A class of solvable stationary singular stochastic control problems. (2018). https://arxiv.org/pdf/1803.03464.pdf

  2. Alvarez, L.H.R., Shepp, L.A.: Optimal harvesting of stochastically fluctuating populations. J. Math. Biol. 37(2), 155–177 (1998)

    Article  MathSciNet  Google Scholar 

  3. Alvarez, L.H., Hening, A.: Optimal sustainable harvesting of populations in random environments. Stoch. Process. Appl. (2019). https://doi.org/10.1016/j.spa.2019.02.008

  4. Borodin, A.N., Salminen, P.: Handbook of Brownian Motion–Facts and Formulae. Probability and Its Applications, 2nd edn. Birkhäuser Verlag, Basel (2002)

    Book  Google Scholar 

  5. Burdzy, K., Kang, W., Ramanan, K.: The Skorokhod problem in a time-dependent interval. Stoch. Process. Appl. 119(2), 428–452 (2009)

    Article  MathSciNet  Google Scholar 

  6. De Angelis, T., Ferrari, G.: A stochastic partially reversible investment problem on a finite time-horizon: free-boundary analysis. Stoch. Process. Appl. 124(12), 4080–4119 (2014)

    Article  MathSciNet  Google Scholar 

  7. Feller, W.: An Introduction to Probability Theory and Its Applications, vol. I, 3rd edn. Wiley, New York (1968)

    MATH  Google Scholar 

  8. Guo, X., Pham, H.: Optimal partially reversible investment with entry decision and general production function. Stoch. Process. Appl. 115(5), 705–736 (2005)

    Article  MathSciNet  Google Scholar 

  9. Harrison, J.M.: Brownian Motion and Stochastic Flow Systems. Wiley Series in Probability and Mathematical Statistics: Probability and Mathematical Statistics. Wiley, New York (1985)

    Google Scholar 

  10. Hening, A., Tran, K.Q.: Harvesting and seeding of stochastic populations: analysis and numerical approximation. J. Math. Biol. 81(1), 65–112 (2020)

    Article  MathSciNet  Google Scholar 

  11. Hening, A., Tran, K.Q., Phan, T.T., Yin, G.: Harvesting of interacting stochastic populations. J. Math. Biol. 79(2), 533–570 (2019)

    Article  MathSciNet  Google Scholar 

  12. Hynd, R.: Analysis of Hamilton-Jacobi-Bellman equations arising in stochastic singular control. ESAIM Control Optim. Calc. Var. 19(1), 112–128 (2013)

    Article  MathSciNet  Google Scholar 

  13. Jack, A., Zervos, M.: Impulse control of one-dimensional Itô diffusions with an expected and a pathwise ergodic criterion. Appl. Math. Optim. 54(1), 71–93 (2006)

    Article  MathSciNet  Google Scholar 

  14. Jin, Z., Yang, H., George Yin, G.: Numerical methods for optimal dividend payment and investment strategies of regime-switching jump diffusion models with capital injections. Autom. J. IFAC 49(8), 2317–2329 (2013)

    Article  MathSciNet  Google Scholar 

  15. Karatzas, I.: A class of singular stochastic control problems. Adv. Appl. Probab. 15(2), 225–254 (1983)

    Article  MathSciNet  Google Scholar 

  16. Karatzas, I., Shreve, S.E.: Brownian Motion and Stochastic Calculus, volume 113 of Graduate Texts in Mathematics, 2nd edn. Springer, New York (1991)

    Google Scholar 

  17. Karlin, S., Taylor, H.M.: A Second Course in Stochastic Processes. Academic Press Inc. [Harcourt Brace Jovanovich Publishers], New York (1981)

    MATH  Google Scholar 

  18. Khasminskii, R.: Stochastic Stability of Differential Equations, volume 66 of Stochastic Modelling and Applied Probability, 2nd edn. Springer, New York (2012)

    Book  Google Scholar 

  19. Lindensjö, K., Lindskog, F.: Optimal dividends and capital injection under dividend restrictions. Math. Methods Oper. Res. 92(3), 461–487 (2020)

    Article  MathSciNet  Google Scholar 

  20. Lungu, E., Øksendal, B.: Optimal harvesting from a population in a stochastic crowded environment. Math. Biosci. 145(1), 47–75 (1997)

    Article  MathSciNet  Google Scholar 

  21. Matomäki, P.: On solvability of a two-sided singular control problem. Math. Methods Oper. Res. 76(3), 239–271 (2012)

    Article  MathSciNet  Google Scholar 

  22. Menaldi, J.L., Robin, M.: Singular ergodic control for multidimensional Gaussian-Poisson processes. Stochastics 85(4), 682–691 (2013)

    Article  MathSciNet  Google Scholar 

  23. Song, Q.S., Stockbridge, R.H., Zhu, C.: On optimal harvesting problems in random environments. SIAM J. Control Optim. 49(2), 859–889 (2011)

    Article  MathSciNet  Google Scholar 

  24. Weerasinghe, A.: Stationary stochastic control for Itô processes. Adv. Appl. Probab. 34(1), 128–140 (2002)

    Article  MathSciNet  Google Scholar 

  25. Weerasinghe, A.: A bounded variation control problem for diffusion processes. SIAM J. Control Optim. 44(2), 389–417 (2005)

    Article  MathSciNet  Google Scholar 

  26. Weerasinghe, A.: An abelian limit approach to a singular ergodic control problem. SIAM J. Control Optim. 46(2), 714–737 (2007)

    Article  MathSciNet  Google Scholar 

  27. Wu, Y.-L., Chen, Z.-Y.: On the solutions of the problem for a singular ergodic control. J. Optim. Theory Appl. 173(3), 746–762 (2017)

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgements

The authors would like to express their appreciation for the insightful comments by the referee, which improved the paper’s results and exposition.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Chao Zhu.

Ethics declarations

Competing Interests

The authors do not have any competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

F. Xi: The research of this author was supported in part by the National Natural Science Foundation of China under Grant 12071031. G. Yin: The research of this author was supported in part by the National Science Foundation under Grant DMS-2204240. C. Zhu: The research of this author was supported in part by the Simons Foundation under Grant 523736, and in part by a DIG award from the University of Wisconsin-Milwaukee.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kunwai, K., Xi, F., Yin, G. et al. On an Ergodic Two-Sided Singular Control Problem. Appl Math Optim 86, 26 (2022). https://doi.org/10.1007/s00245-022-09881-0

Download citation

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s00245-022-09881-0

Keywords

Mathematics Subject Classification

Navigation