Discrete Time Approximations of Continuous Time Finite Horizon Stopping Problems

  • Lukasz StettnerEmail author
Part of the Systems & Control: Foundations & Applications book series (SCFA)


In this chapter, we approximate continuous time finite horizon stopping problems using either continuous and discrete time penalty approach or direct discretization. We point out possible errors of such approximations and construct approximate optimal stopping times.



Research supported by MNiSzW grant NN 201 371836.


  1. 1.
    Bensoussan, A., Lions, J.L.: Applications of Variational Inequalities in Stochastic Control. Elsevier North Holland (1982)Google Scholar
  2. 2.
    Davis, M., Karatzas, I.: A deterministic approach to optimal stopping with applications to a prophet inequality. P. Whittle Festschrift, in Wiley Ser. Probab. Math. Statist. Probab. Math. Statist., Wiley, Chichester, 455–466 (1994)Google Scholar
  3. 3.
    Dynkin, E.B.: Markov processes. Berlin, Gottingen, Heidelberg, Springer (1965)zbMATHGoogle Scholar
  4. 4.
    Fakeev, A.G.: On the question of the optimal stopping of a Markov process. (Russian) Teor. Verojatnost. i Primenen. 16, 708-710 (1971)Google Scholar
  5. 5.
    Haugh, M.B., Kogan, L.: Pricing American Options: a Duality Approach. Operations Research 52, 258–270 (2004)MathSciNetzbMATHCrossRefGoogle Scholar
  6. 6.
    Krylov, N.V.: The problem with two free boundaries for an elliptic equation and optimal stopping of Markov processes. Dokl. Akad. Nauk USSR 194, 1263–1265 (1970)Google Scholar
  7. 7.
    Meyer, P.A.: Processes de Markov, LNM 26, Berlin, Heidelberg, New York, Springer (1967)CrossRefGoogle Scholar
  8. 8.
    Palczewski, J., Stettner, L.: Finite Horizon Optimal Stopping of Time - Discontinuous Functionals with Applications to Impulse Control with Delay. SIAM J. Control Optim. 48, 4874–4909 (2010)MathSciNetzbMATHCrossRefGoogle Scholar
  9. 9.
    Palczewski, J., Stettner, L.: Stopping of discontinuous functionals with the first exit time discontinuity. Stoch. Proc. Their Appl., 121, 2361–2392 (2011)MathSciNetzbMATHCrossRefGoogle Scholar
  10. 10.
    Robin, M.: Controle impulsionnel des processus de Markov (Thesis), University of Paris IX (1978)Google Scholar
  11. 11.
    Rogers, L.C.G.: Monte Carlo Valuation of American Options. Mathematical Finance 12, 271–286 (2002)MathSciNetzbMATHCrossRefGoogle Scholar
  12. 12.
    Rogers, L.C.G.: Dual Valuation and Hedging of Bermidian Options. SIAM J. Financial Math. 1, 604–608 (2010)MathSciNetzbMATHCrossRefGoogle Scholar
  13. 13.
    Stettner, L.: Zero-sum markov Games with Stopping and Impulsive Strategies. Appl. Math. Optimiz. 9, 1–24 (1982)MathSciNetzbMATHCrossRefGoogle Scholar
  14. 14.
    Stettner, L.: Penalty method for finite horizon stopping problems. SIAM J. Control Optim. 49, 1078–1999 (2011)MathSciNetzbMATHCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2012

Authors and Affiliations

  1. 1.Institute of Mathematics Polish Academy of SciencesWarsawPoland

Personalised recommendations