Importance Sampling for Metastable and Multiscale Dynamical Systems

  • K. Spiliopoulos


In this article, we address the issues that come up in the design of importance sampling schemes for rare events associated to stochastic dynamical systems. We focus on the issue of metastability and on the effect of multiple scales. We discuss why seemingly reasonable schemes that follow large deviations optimal paths may perform poorly in practice, even though they are asymptotically optimal. Pre-asymptotic optimality is important when one deals with metastable dynamics and we discuss possible ways as to how to address this issue. Moreover, we discuss how the effect of the multiple scales (either in periodic or random environments) on the efficient design of importance sampling should be addressed. We discuss the mathematical and practical issues that come up, how to overcome some of the issues and discuss future challenges.



This work was partially supported by the National Science Foundation CAREER award DMS 1550918.


  1. 1.
    S. Asmussen, P.W. Glynn, Stochastic Simulation: Algorithms and Analysis (Springer, New York, 2007)Google Scholar
  2. 2.
    P. Banushkina, M. Meuwly, Diffusive dynamics on multidimensional rough free energy surfaces. J. Chem. Phys. 127, 135101 (2007)CrossRefGoogle Scholar
  3. 3.
    A. Bensoussan, J.L. Lions, G. Papanicolaou, Asymptotic Analysis for Periodic Structures, vol. 5, Studies in Mathematics and its Applications (North-Holland Publishing Co., Amsterdam, 1978)Google Scholar
  4. 4.
    J.H. Blanchet, P. Glynn, Efficient rare-event simulation for the maximum of heavy-tailed random walks. Ann. Appl. Prob. 18, 1351–1378 (2008)MathSciNetCrossRefMATHGoogle Scholar
  5. 5.
    J.H. Blanchet, J.C. Liu, State-dependent importance sampling for regularly varying random walks. Adv. Appl. Probab. 40, 1104–1128 (2008)MathSciNetCrossRefMATHGoogle Scholar
  6. 6.
    J.H. Blanchet, P. Glynn, J.C. Liu, Fluid heuristics, Lyapunov bounds and efficient importance sampling for a heavy-tailed G/G/1 queue. Queueing Syst. 57, 99–113 (2007)MathSciNetCrossRefMATHGoogle Scholar
  7. 7.
    J.H. Blanchet, P. Glynn, K. Leder, On Lyapunov inequalities and subsolutions for efficient importance sampling. ACM TOMACS 22(3), Artical No. 13 (2012)Google Scholar
  8. 8.
    A. Bovier, M. Eckhoff, V. Gayrard, M. Klein, Metastability in reversible diffusion processes I. Sharp estimates for capacities and exit times. J. Eur. Math. Soc. 6, 399–424 (2004)CrossRefMATHGoogle Scholar
  9. 9.
    A. Bovier, V. Gayrard, M. Klein, Metastability in reversible diffusion processes II. Precise estimates for small eigenvalues. J. Eur. Math. Soc. 7, 69–99 (2005)CrossRefMATHGoogle Scholar
  10. 10.
    P. Boyle, M. Broadie, P. Glasserman, Monte Carlo methods for security pricing. J. Econ. Dyn. Control. 21, 1257–1321 (1997)MathSciNetCrossRefMATHGoogle Scholar
  11. 11.
    M. Cameron, Finding the quasipotential for nongradient SDEs. Phys. D: Nonlinear Phenom. 241(18), 1532–1550 (2012)MathSciNetCrossRefMATHGoogle Scholar
  12. 12.
    M. Day, T. Darden, Some regularity results on the Ventcel-Freidlin quasi-potential function. Appl. Math Opt. 13 259–282 (1985)CrossRefMATHGoogle Scholar
  13. 13.
    A. Dembo, O. Zeitouni, Large Deviations Techniques and Applications, vol. 38, 2nd ed., Applications of Mathematics (Springer, New York, 1998)Google Scholar
  14. 14.
    P. Dupuis, K. Spiliopoulos, Large deviations for multiscale problems via weak convergence methods. Stochastic Process. Appl. 122, 1947–1987 (2012)MathSciNetCrossRefMATHGoogle Scholar
  15. 15.
    P. Dupuis, K. Spiliopoulos, Rare event simulation in the neighborhood of a rest point, in 2014 Winter Simulation Conference (IEEE, 2014), pp. 564–573Google Scholar
  16. 16.
    P. Dupuis, H. Wang, Importance sampling, large deviations and differential games. Stochastics Stochastics Rep. 76, 481–508 (2004)MathSciNetCrossRefMATHGoogle Scholar
  17. 17.
    P. Dupuis, H. Wang, Subsolutions of an Isaacs equation and efficient schemes of importance sampling. Math. Oper. Res. 32, 723–757 (2007)MathSciNetCrossRefMATHGoogle Scholar
  18. 18.
    P. Dupuis, K. Leder, H. Wang, Large deviations and importance sampling for a tandem network with slow-down. Queueing Syst. 57, 71–83 (2007)MathSciNetCrossRefMATHGoogle Scholar
  19. 19.
    P. Dupuis, A. Sezer, H. Wang, Dynamic importance sampling for queueing networks. Ann. Appl. Probab. 17, 1306–1346 (2007)MathSciNetCrossRefMATHGoogle Scholar
  20. 20.
    P. Dupuis, K. Leder, H. Wang, Importance sampling for weighted serve-the-longest-queue. Math. Oper. Res. 34(3), 642–660 (2009)MathSciNetCrossRefMATHGoogle Scholar
  21. 21.
    P. Dupuis, K. Spiliopoulos, H. Wang, Rare event simulation in rough energy landscapes, in 2011 Winter Simulation Conference (2011), pp. 504–515Google Scholar
  22. 22.
    P. Dupuis, K. Spiliopoulos, H. Wang, Importance sampling for multiscale diffusions. Multiscale Model. Simul. 12(1), 1–27 (2012)MathSciNetCrossRefMATHGoogle Scholar
  23. 23.
    P. Dupuis, K. Spiliopoulos, X. Zhou, Escape from an equilibrium: importance sampling and rest points I. Ann. Appl. Probab. 25(5), 2909–2958 (2015)MathSciNetCrossRefMATHGoogle Scholar
  24. 24.
    W.H. Fleming, M.R. James, Asymptotic series and exit time probabilities. Ann. Probab. 20(3), 1369–1384 (1992)MathSciNetCrossRefMATHGoogle Scholar
  25. 25.
    W.H. Fleming, H.M. Soner, Controlled Markov Processes and Viscosity Solutions, 2nd edn. (Springer, Berlin, 2006)MATHGoogle Scholar
  26. 26.
    M. Freidlin, R. Sowers, A comparison of homogenization and large deviations with applications to wavefront propagation. Stochastic Process Appl. 82, 23–52 (1999)MathSciNetCrossRefMATHGoogle Scholar
  27. 27.
    M.I. Freidlin, A.D. Wentzell, Random Perturbations of Dynamical Systems, 2nd edn. (Springer, New York, 1988)MATHGoogle Scholar
  28. 28.
    P. Glasserman, Monte Carlo Methods in Financial Engineering (Springer, New York, 2004)MATHGoogle Scholar
  29. 29.
    P. Glasserman, S. Kou, Analysis of an important sampling estimator for tandem queues. ACM Trans. Model. Comput. Simul. 4, 22–42 (1995)CrossRefMATHGoogle Scholar
  30. 30.
    P. Glasserman, Y. Wang, Counter examples in importance sampling for large deviations probabilities. Ann. Appl. Probab. 7, 731–746 (1997)MathSciNetCrossRefMATHGoogle Scholar
  31. 31.
    P.W. Glynn, D.L. Iglehart, Simulation methods for queues: an overview. Queueing Syst.: Theory Appl. 3, 221–256 (1988)Google Scholar
  32. 32.
    R.C. Griffiths, S. Tavaré, Simulating probability distributions in the coalescent. Theor. Popul. Biol. 46, 131–159 (1994)CrossRefMATHGoogle Scholar
  33. 33.
    W. Janke, Rugged Free-Energy Landscapes, Lecture Notes in Physics, vol. 736/2008 (Springer, Berlin, 2008)Google Scholar
  34. 34.
    T. Komorowski, C. Landim, S. Olla, Fluctuations in Markov Processes: Time Symmetry and Martingale Approximation (Springer, Berlin, 2012)CrossRefMATHGoogle Scholar
  35. 35.
    E. Kosygina, F. Rezakhanlou, S.R.S. Varadhan, Stochastic homogenization of Hamilton-Jacobi-Bellman equations, Commun. Pure Appl. Math. LIX, 0001–0033 (2006)Google Scholar
  36. 36.
    R.D. Levine, Monte Carlo, maximum entropy and importance sampling. Chem. Phys. 228, 255–264Google Scholar
  37. 37.
    S. Lifson, J.L. Jackson, On the self-diffusion of ions in a polyelectrolyte solution. J. Chem. Phys. 36, 2410–2414 (1962)CrossRefGoogle Scholar
  38. 38.
    R.S. Maier, D.L. Stein, Escape problem for irreversible systems. Phys. Rev. E 48(2), 931–938 (1993)CrossRefGoogle Scholar
  39. 39.
    R.S. Maier, D.L. Stein, Limiting exit location distributions in the stochastic exit problem. SIAM J. Appl. Math. 57(3), 752–790 (1997)MathSciNetCrossRefMATHGoogle Scholar
  40. 40.
    O. Mazonka, C. Jarzynski, J. Blocki, Computing probabilities of very rare events for Langevin processes: a new method based on importance sampling. Nucl. Phys. A 641, 335–354 (1998)CrossRefGoogle Scholar
  41. 41.
    S. Olla, Homogenization of diffusion processes in random fields (1994). Available at Google Scholar
  42. 42.
    H. Osada, Homogenization of diffusion processes with random stationary coefficients, in Probability Theory and Mathematical Statistics. Lecture Notes in Mathematics, vol. 1021 (Springer, Berlin, 1983), pp. 507–517Google Scholar
  43. 43.
    G.A. Pavliotis, A.M. Stuart, Multiscale Methods: Averaging and Homogenization (Springer, Berlin, 2007)MATHGoogle Scholar
  44. 44.
    G. Papanicolaou, S.R.S. Varadhan, Boundary value problems with rapidly oscillating random coefficients, in Colloquia Mathematica Societatis Janos Bolyai 27, Random Fields, Esztergom (Hungary) 1979, North Holland (1982), pp. 835–873Google Scholar
  45. 45.
    M. Salins, K. Spiliopoulos, Rare event simulation via importance sampling for linear SPDE’s. stochostics and Partial Differential Equation: Analysis and computations (accepted, 2017)Google Scholar
  46. 46.
    D. Siegmund, Importance sampling in the Monte Carlo study of sequential tests. Ann. Stat. 4, 673–684 (1976)MathSciNetCrossRefMATHGoogle Scholar
  47. 47.
    K. Spiliopoulos, Large deviations and importance sampling for systems of slow-fast motion. Appl. Math. Optim. 67, 123–161 (2013)MathSciNetCrossRefMATHGoogle Scholar
  48. 48.
    K. Spiliopoulos, Non-asymptotic performance analysis of importance sampling schemes for small noise diffusions. J. Appl. Probab. 52, 1–14 (2015)MathSciNetCrossRefMATHGoogle Scholar
  49. 49.
    K. Spiliopoulos, Quenched large deviations for multiscale diffusion processes in random environments. Electron. J. Probab. 20(15), 1–29 (2015)MathSciNetMATHGoogle Scholar
  50. 50.
    K. Spiliopoulos, Rare event simulation for multiscale diffusions in random environments. SIAM Multiscale Model. Simul. 13(4), 1290–1311 (2015)MathSciNetCrossRefMATHGoogle Scholar
  51. 51.
    E. Vanden-Eijnden, J. Weare, Rare event simulation with vanishing error for small noise diffusions. Commun. Pure Appl. Math. 65(12), 1770–1803 (2012)CrossRefMATHGoogle Scholar
  52. 52.
    S.R.S. Varadhan, Large Deviations and Applications. CBMS-NSF Regional Conference Series in Applied Mathematics, vol. 46 (Society for Industrial and Applied Mathematics (SIAM), Philadelphia, 1984)Google Scholar
  53. 53.
    A. Viel, M.V. Patel, P. Niyaz, K. Whaley, Importance sampling in rigid body diffusion Monte Carlo. Comput. Phys. Commun. 145, 24–47 (2002)CrossRefMATHGoogle Scholar
  54. 54.
    D. Zuckerman, T. Woolf, Efficient dynamic importance sampling of rare events in one dimension. Phys. Rev. E 63(016702), 1–10 (2000)Google Scholar
  55. 55.
    R. Zwanzig, Diffusion in a rough potential. Proc. Natl. Acad. Sci. U. S. A. 85, 2029–2030 (1988)MathSciNetCrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.Department of Mathematics and StatisticsBoston UniversityBostonUSA

Personalised recommendations