Mathematical Methods of Operations Research

, Volume 81, Issue 1, pp 109–135 | Cite as

Monte Carlo methods via a dual approach for some discrete time stochastic control problems

  • Lajos Gergely GyurkóEmail author
  • Ben M. Hambly
  • Jan Hendrik Witte
Original Article


We consider a class of discrete time stochastic control problems motivated by a range of financial applications. We develop a numerical technique based on the dual formulation of these problems to obtain an estimate of the value function which improves on purely regression based methods. We demonstrate the competitiveness of the method on the example of a gas storage valuation problem.


Stochastic control Dual formulation Monte Carlo Least squares regression 


  1. Aleksandrov N, Hambly BM (2010) A dual approach to multiple exercise options under constraints. Math Methods Oper Res 71:503–533CrossRefzbMATHMathSciNetGoogle Scholar
  2. Aleksandrov N, Hambly BM (2010) Liquidity modelling and optimal liquidation in bond markets (in press)Google Scholar
  3. Almgren R, Chriss N (2000/2001) Optimal execution of portfolio transactions. J Risk 3:5–39Google Scholar
  4. Alfonsi A, Fruth A, Schied A (2010) Optimal execution strategies in limit order books with general shape functions. Quant Finance 10(2):143–157CrossRefzbMATHMathSciNetGoogle Scholar
  5. Alfonsi A, Schied A (2010) Optimal trade execution and absence of price manipulation un limit order book models. SIAM J Financ Math 1:490–522CrossRefzbMATHMathSciNetGoogle Scholar
  6. Belomestny D, Kolodko A, Schoenmakers J (2009/10) Regression methods for stochastic control problems and their convergence analysis. SIAM J Control Optim 48:3562–3588Google Scholar
  7. Bender C (2011a) Dual pricing of multi-exercise options under volume constraints. Finance Stoch 15:1–26CrossRefzbMATHMathSciNetGoogle Scholar
  8. Bender C (2011b) Primal and dual pricing of multiple exercise options in continuous time. SIAM J Finance Math 2:562–586CrossRefzbMATHGoogle Scholar
  9. Bender C, Schoenmakers J, Zhang J (2013) Dual representations for general multiple optimal stopping problems. Math FinanceGoogle Scholar
  10. Boogert A, Jong C (2008) Gas storage valuation using a Monte Carlo method. J Deriv 15:81–98CrossRefGoogle Scholar
  11. Brown DB, Smith JE, Peng S (2010) Information relaxations and duality in stochastic dynamic programs. Oper Res 58:785–801CrossRefzbMATHMathSciNetGoogle Scholar
  12. Carmona R, Touzi N (2008) Optimal multiple stopping and valuation of swing options. Math Finance 18(2):239–268CrossRefzbMATHMathSciNetGoogle Scholar
  13. Chandramouli SS, Haugh MB (2012) A unified approach to multiple stopping and duality. Oper Res Lett 40:258–264CrossRefzbMATHMathSciNetGoogle Scholar
  14. Chen Z, Forsyth PA (2007) A semi-Lagrangian approach for natural gas storage valuation and optimal operation. SIAM J Sci Comput 30:339–368CrossRefzbMATHMathSciNetGoogle Scholar
  15. Clement E, Lamberton D, Protter P (2002) An analysis of a least squares regression method for American option pricing. Finance Stoch 6:449–471CrossRefzbMATHMathSciNetGoogle Scholar
  16. Davis MHA, Karatzas I (1994) A deterministic approach to optimal stopping. Probability statistics and optimisation, Wiley series probability of mathematical statistics. Wiley, Chichester, pp 455–466Google Scholar
  17. Glasserman P (2003) Monte carlo methods in financial engineering. Springer, New YorkCrossRefGoogle Scholar
  18. Haugh MB, Kogan L (2004) Pricing American options: a duality approach. Oper Res 52:258–270CrossRefzbMATHMathSciNetGoogle Scholar
  19. Longstaff FA, Schwartz ES (2001) Valuing American options by simulation: a simple least-squares approach. Rev Financ Stud 14:113–147CrossRefGoogle Scholar
  20. Ludovski M, Carmona R (2010) Valuation of energy storage: an optimal switching approach. Quant Finance 10:359–374CrossRefMathSciNetGoogle Scholar
  21. Meinshausen N, Hambly BM (2004) Monte Carlo methods for the valuation of multiple exercise options. Math Finance 14:557–583CrossRefzbMATHMathSciNetGoogle Scholar
  22. Rogers LCG (2002) Monte Carlo valuation of american options. Math Finance 12:271–286CrossRefzbMATHMathSciNetGoogle Scholar
  23. Rogers LCG (2007) Pathwise stochastic optimal control. SIAM J Control Optim 46:1116–1132CrossRefzbMATHMathSciNetGoogle Scholar
  24. Schöneborn T (2011) Adaptive basket liquidation,
  25. Schonmakers J (2010) A pure martingale dual for multiple stopping. Finance Stoch 30. doi: 10.1007/s00780-010-0149-1
  26. Thompson M, Davison M, Rasmussen H (2009) Natural gas storage valuation and optimization: a real options application. Naval Res Logist 56:226–238CrossRefzbMATHMathSciNetGoogle Scholar
  27. Tsitsiklis JN, Van Roy B (2001) Regression methods for pricing complex American-style options. IEEE Trans Neural Netw 12:694–703CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2014

Authors and Affiliations

  • Lajos Gergely Gyurkó
    • 1
    Email author
  • Ben M. Hambly
    • 1
  • Jan Hendrik Witte
    • 1
  1. 1.Mathematical Institute, University of Oxford, Andrew Wiles BuildingRadcliffe Observatory QuarterOxfordUK

Personalised recommendations