General Introduction to Monte Carlo and Multi-level Monte Carlo Methods

  • Robin SchmidtEmail author
  • Matthias Voigt
  • Michele Pisaroni
  • Fabio Nobile
  • Penelope Leyland
  • Jordi Pons-Prats
  • Gabriel Bugeda
Part of the Notes on Numerical Fluid Mechanics and Multidisciplinary Design book series (NNFM, volume 140)


In this chapter, we present a general introduction to Monte Carlo (MC)-based methods, sampling methodologies, stratification methods, and variance reduction techniques. In the first part, we will discuss the theoretical basis and the convergence proprieties of MC methods. The next part is devoted to pseudorandom and quasi-random number generation, the generation of random variables and the application of stratification. It is followed by techniques for correlation and discrepancy control. The third part presents the concept of Latin Hypercube Sampling (LHS). The last part introduces the concept of Multi-Level Monte Carlo (MLMC).


Monte Carlo Sampling Latin hypercube Variance reduction Multi-Level Monte Carlo 


  1. 1.
    Kroese, D.P., Taimre, T., Botev, Z.I.: Handbook of Monte Carlo Methods. Wiley, Inc. (2011)Google Scholar
  2. 2.
    Matsumoto, M., Nishimura, T.: Mersenne twister: a 623-dimensionally equidistributed uniform pseudo-random number generator. ACM Trans. Model. Comput. Simul. (TOMACS) 8(1), 3–30 (1998)CrossRefGoogle Scholar
  3. 3.
    L’Ecuyer, P.: Good parameters and implementations for combined multiple recursive random number generators. Oper. Res. 47(1), 159–164 (1999)CrossRefGoogle Scholar
  4. 4.
    Niederreiter, H.: Random number generation and quasi-Monte Carlo methods. In: Society for Industrial and Applied Mathematics, CBMS-NSF Regional Conference Series in Applied Mathematics, vol. 63, Pa (1992)Google Scholar
  5. 5.
    Morokoff, W.J., Caflisch, R.E.: Quasi-Monte Carlo integration. J. Comput. Phys. 122(2), 218–230 (1995)MathSciNetCrossRefGoogle Scholar
  6. 6.
    Kocis, L., Whiten, W.J.: Computational investigations of low-discrepancy sequences. ACM Trans. Math. Softw. (TOMS) 23(2), 266–294 (1997)CrossRefGoogle Scholar
  7. 7.
    Hong, H.S., Hickernell, F.J.: Algorithm 823: implementing scrambled digital sequences. ACM Trans. Math. Softw. (TOMS) 29(2), 95–109 (2003)MathSciNetCrossRefGoogle Scholar
  8. 8.
    Cochran, W.G.: Sampling Techniques, 3rd edn. Wiley Series in Probability and Mathematical Statistics. Wiley, New York (1977)Google Scholar
  9. 9.
    Nataf, A.: Dtermination des distributions de probabilits dont les marges sont donns. Comptes Rendus de l’Acadmie des Sciences 225, 42–43 (1962)zbMATHGoogle Scholar
  10. 10.
    Ditlevsen, O., Madsen, H.O.: Structural Reliability Methods. Wiley, Chichester, New York (1996)Google Scholar
  11. 11.
    Iman, R.L., Conover, W.J.: A distribution-free approach to inducing rank correlation among input variables. Commun. Stat. Simul. Comput. 11(3), 311–334 (1982)CrossRefGoogle Scholar
  12. 12.
    Dandekar, R.A., Cohen, M., Kirkendall, N.: Sensitive micro data protection using Latin hypercube sampling technique. In: Inference Control in Statistical Databases, Springer, pp. 117–125 (2002)Google Scholar
  13. 13.
    Vořechovský, M., Novák, D.: Correlation control in small-sample Monte Carlo type simulations I: a simulated annealing approach. Probab. Eng. Mech. 24(3), 452–462 (2009)CrossRefGoogle Scholar
  14. 14.
    Liefvendahl, M., Stocki, R.: A study on algorithms for optimization of Latin hypercubes. J. Stat. Plan. Inference 136(9), 3231–3247 (2006)MathSciNetCrossRefGoogle Scholar
  15. 15.
    Damblin, G., Couplet, M., Iooss, B.: Numerical studies of space-filling designs: optimization of Latin hypercube samples and subprojection properties. J. Simul. 7(4), 276–289 (2013)CrossRefGoogle Scholar
  16. 16.
    Hickernell, F.: A generalized discrepancy and quadrature error bound. Math. Comput. Am. Math. Soc. 67(221), 299–322 (1998)MathSciNetCrossRefGoogle Scholar
  17. 17.
    McKay, M.D., Beckman, R.J., Conover, W.J.: A comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics 42(1), 55–61 (1979)MathSciNetCrossRefGoogle Scholar
  18. 18.
    Iman, R.L., Conover, W.: Small sample sensitivity analysis techniques for computer models with an application to risk assessment. Commun. Stat. Theory Methods 9(17), 1749–1842 (1980)MathSciNetCrossRefGoogle Scholar
  19. 19.
    Stein, M.: Large sample properties of simulations using Latin hypercube sampling. Technometrics 29(2), 143–151 (1987)MathSciNetCrossRefGoogle Scholar
  20. 20.
    Manteufel, R.D.: Evaluating the convergence of Latin hypercube sampling. In: 41st AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference (2000)Google Scholar
  21. 21.
    Heinrich, S.: Monte Carlo complexity of global solution of integral equations. J. Complex. 14(2), 151–175 (1998)MathSciNetCrossRefGoogle Scholar
  22. 22.
    Heinrich, S., Sindambiwe, E.: Monte Carlo complexity of parametric integration. J. Complex. 15(3), 317–341 (1999)MathSciNetCrossRefGoogle Scholar
  23. 23.
    Giles, M.B.: Multilevel Monte Carlo path simulation. Oper. Res. 56(3), 607–617 (2008)MathSciNetCrossRefGoogle Scholar
  24. 24.
    Barth, A., Lang, A., Schwab, C.: Multilevel Monte Carlo method for parabolic stochastic partial differential equations. BIT Numer. Math. 53(1), 3–27 (2013)MathSciNetCrossRefGoogle Scholar
  25. 25.
    Barth, A., Schwab, C., Zollinger, N.: Multi-level Monte Carlo finite element method for elliptic PDEs with stochastic coefficients. Numer. Math. 119(1), 123–161 (2011)MathSciNetCrossRefGoogle Scholar
  26. 26.
    Charrier, J., Scheichl, R., Teckentrup, A.L.: Finite element error analysis of elliptic PDEs with random coefficients and its application to multi level Monte Carlo methods. SIAM J. Numer. Anal. 51(1), 322–352 (2013)MathSciNetCrossRefGoogle Scholar
  27. 27.
    Cliffe, K., Giles, M., Scheichl, R., Teckentrup, A.L.: Multilevel Monte Carlo methods and applications to elliptic PDEs with random coefficients. Comput. Vis. Sci. 14(1), 3–15 (2011)MathSciNetCrossRefGoogle Scholar
  28. 28.
    Teckentrup, A., Scheichl, R., Giles, M., Ullmann, E.: Further analysis of multilevel Monte Carlo methods for elliptic PDEs with random coefficients. Numer. Math. 125(3), 569–600 (2013)MathSciNetCrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2019

Authors and Affiliations

  • Robin Schmidt
    • 1
    Email author
  • Matthias Voigt
    • 1
  • Michele Pisaroni
    • 2
  • Fabio Nobile
    • 2
  • Penelope Leyland
    • 2
  • Jordi Pons-Prats
    • 3
  • Gabriel Bugeda
    • 3
    • 4
  1. 1.Institute of Fluid MechanicsTechnische Universität DresdenDresdenGermany
  2. 2.Scientific Computing and Uncertainty QuantificationEcole Polytechnique Fédérale de LausanneLausanneSwitzerland
  3. 3.CIMNE, Aeronautical GroupBarcelonaSpain
  4. 4.Universitat Politecnica de Catalunya - BarcelonaTechBarcelonaSpain

Personalised recommendations