Skip to main content
SpringerLink
Log in

On necessary and sufficient conditions for near-optimal singular stochastic controls

  • Original Paper
  • Published:
Optimization Letters Aims and scope Submit manuscript

Abstract

In this paper we discuss the necessary and sufficient conditions for near-optimal singular stochastic controls for the systems driven by a nonlinear stochastic differential equations (SDEs in short). The proof of our result is based on Ekeland’s variational principle and some delicate estimates of the state and adjoint processes. It is well known that optimal singular controls may fail to exist even in simple cases. This justifies the use of near-optimal singular controls, which exist under minimal conditions and are sufficient in most practical cases. Moreover, since there are many near-optimal singular controls, it is possible to choose suitable ones, that are convenient for implementation. This result is a generalization of Zhou’s stochastic maximum principle for near-optimality to singular control problem.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Alvarez L.H.R.: A class of solvable singular stochastic control problems. Stochastics, Stochastics Rep. 67, 83–122 (1999)

    Article  MathSciNet  MATH  Google Scholar 

  2. Alvarez L.H.R.: Singular stochastic control linear diffusion and optimal stopping: a class of solvable problems. SIAM J. Contr. Optim. 39, 1697–1710 (2001)

    Article  MATH  Google Scholar 

  3. Bahlali S., Chala A.: The stochastic maximum principle in optimal control of singular diffusions with non linear coefficients. Random Oper. Stoch. Equ. (ROSE) 13, 1–10 (2005)

    Article  MathSciNet  MATH  Google Scholar 

  4. Bahlali S., Mezerdi B.: A general stochastic maximum principle for singular control problems. Electron. J. Probab. 10, 988–1004 (2005)

    Article  MathSciNet  Google Scholar 

  5. Bahlali K., Khelfallah N., Mezerdi B.: Necessary and sufficient conditions for near optimality in stochastic control of FBSDEs. Syst. Control Lett. 58, 857–864 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  6. Bellman R.: Dynamic programming. Princeton University Press, Princeton (1957)

    MATH  Google Scholar 

  7. Cadenillas A., Haussman U.: The stochastic maximum principle for singular control problem. Stochastics Rep. 49(3–4), 211–237 (1994)

    MATH  Google Scholar 

  8. Chighoub F., Mezerdi B.: Near optimality conditions in stochastic control of jump diffusion processes. Syst. Control Lett. 60, 907–916 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  9. Clarke F.H.: Optimization and nonsmooth analysis. Wiley, New York (1983)

    MATH  Google Scholar 

  10. Dufour F., Miller B.: Maximum principle for singular stochastic control problem. Siam J. Control Optim. 45(2), 668–698 (2006)

    Article  MathSciNet  Google Scholar 

  11. Dufour F., Miller B.: Singular stochastic control problem. Siam J. Control Optim. 43(2), 705–730 (2004)

    Article  MathSciNet  Google Scholar 

  12. Ekeland I.: On the variational principle. J. Math. Anal. Appl. 47, 443–474 (1974)

    Article  MathSciNet  Google Scholar 

  13. Haussmann, U.G., Suo, W.: Singular optimal control I, II. SIAM J. Contr. Optim. 33(3), 916–936, 937–959 (1995)

    Google Scholar 

  14. Karatzas I., Ocone D., Wang H., Zervos M.: Finite-fuel singular control with discretionary stopping. Stochastics Rep. 71, 1–50 (2000)

    MathSciNet  MATH  Google Scholar 

  15. Gabasov R., Kirillova M., Mordukhovich B.S.: The ε − maximum principle for suboptimal controls. Soviet Math Dokh 27, 95–99 (1983)

    MATH  Google Scholar 

  16. Pan L.P., Teo K.L.: Near-optimal controls of class of volterra integral systems. J. Optim. Control Theory Appl. 101(2), 355–373 (1999)

    Article  MathSciNet  MATH  Google Scholar 

  17. Peng S.: A general stochastic maximum principle for optimal control problems. SIAM J. Contr. Optim. 28(4), 966–979 (1990)

    Article  MATH  Google Scholar 

  18. Pontryagin L.S., Boltanskii V.G., Gamkrelidze R.V.: The Mathematical Theory of Optimal Processes. Inter-scien, New York (1962)

    MATH  Google Scholar 

  19. Yong J., Zhou X.Y.: Stochastic Controls. Hamiltonian Systems and HJB Equations. Springer-Verlag, New York (1999)

    MATH  Google Scholar 

  20. Zhou X.Y.: Deterministic near-optimal controls. Part I: Necessary and sufficient conditions for near optimality. J. Optim. Theory Appl. 85, 473–488 (1995)

    Article  MathSciNet  MATH  Google Scholar 

  21. Zhou X.Y.: Deterministic near-optimal controls. Part II: Dynamic programming and viscosity solution approach. Math. Operat. Res. 21, 655–674 (1996)

    Article  MATH  Google Scholar 

  22. Zhou X.Y.: Stochastic near-optimal controls: Necessary and sufficient conditions for near-optimality. SIAM. Control. Optim. 36, 929–947 (1998)

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Laboratory of Applied Mathematics, Mohamed Khider University, Po Box 145, Biskra, 07000, Algeria

    Mokhtar Hafayed

  2. School of Basic Sciences, Indian Institute of Technology Mandi, Mandi, HP, 175001, India

    Syed Abbas

  3. Faculty of Nuclear Sciences and Physical Engineering, Department of Mathematics, Czech Technical University, Trojanova 13, Prague, 12000, Czech Republic

    Petr Veverka

Authors
  1. Mokhtar Hafayed
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Syed Abbas
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Petr Veverka
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Syed Abbas.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Hafayed, M., Abbas, S. & Veverka, P. On necessary and sufficient conditions for near-optimal singular stochastic controls. Optim Lett 7, 949–966 (2013). https://doi.org/10.1007/s11590-012-0484-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11590-012-0484-6

Keywords

Search

Navigation