Archives of Computational Methods in Engineering

, Volume 17, Issue 4, pp 435–454 | Cite as

Reduced Basis Techniques for Stochastic Problems

  • S. Boyaval
  • C. Le Bris
  • T. Lelièvre
  • Y. Maday
  • N. C. Nguyen
  • A. T. Patera
Original Paper


We report here on the recent application of a now classical general reduction technique, the Reduced-Basis (RB) approach initiated by C. Prud’homme et al. in J. Fluids Eng. 124(1), 70–80, 2002, to the specific context of differential equations with random coefficients. After an elementary presentation of the approach, we review two contributions of the authors: in Comput. Methods Appl. Mech. Eng. 198(41–44), 3187–3206, 2009, which presents the application of the RB approach for the discretization of a simple second order elliptic equation supplied with a random boundary condition, and in Commun. Math. Sci., 2009, which uses a RB type approach to reduce the variance in the Monte-Carlo simulation of a stochastic differential equation. We conclude the review with some general comments and also discuss possible tracks for further research in the direction.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ainsworth M, Oden JT (2000) A posteriori error estimation in finite element analysis. Wiley-Interscience, New York MATHGoogle Scholar
  2. 2.
    Almroth BO, Stern P, Brogan FA (1978) Automatic choice of global shape functions in structural analysis. AIAA J 16:525–528 CrossRefGoogle Scholar
  3. 3.
    Arouna B (2004) Robbins-Monroe algorithms and variance reduction in finance. J Comput Finance 7(2):35–62 Google Scholar
  4. 4.
    Babuška I, Tempone R, Zouraris G (2005) Solving elliptic boundary value problems with uncertain coefficients by the finite element method: the stochastic formulation. Comput Methods Appl Mech Eng 194:1251–1294 MATHCrossRefGoogle Scholar
  5. 5.
    Babuška I, Nobile F, Tempone R (2007) A stochastic collocation method for elliptic partial differential equations with random input data. SIAM J Numer Anal 45(3):1005–1034 MATHCrossRefMathSciNetGoogle Scholar
  6. 6.
    Barrault M, Nguyen NC, Maday Y, Patera AT (2004) An “empirical interpolation” method: Application to efficient reduced-basis discretization of partial differential equations. C R Acad Sci Paris, Sér I 339:667–672 MATHMathSciNetGoogle Scholar
  7. 7.
    Barrett A, Reddien G (1995) On the reduced basis method. Z Angew Math Mech 75(7):543–549 MATHMathSciNetGoogle Scholar
  8. 8.
    Becker R, Rannacher R (2001) An optimal control approach to a posteriori error estimation in finite element methods. Acta Numer 37:1–225 MathSciNetGoogle Scholar
  9. 9.
    Binev P, Cohen A, Dahmen W, DeVore R, Petrova G, Wojtaszczyk P (2010) Convergence rate for greedy algorithms in reduced basis methods, submitted for publication (preprint available at
  10. 10.
    Bonvin J, Picasso M (1999) Variance reduction methods for CONNFFESSIT-like simulations. J Non-Newton Fluid Mech 84:191–215 MATHCrossRefGoogle Scholar
  11. 11.
    Boyaval S (2008) Reduced-basis approach for homogenization beyond the periodic setting. SIAM Multiscale Model Simul 7(1):466–494 MATHCrossRefMathSciNetGoogle Scholar
  12. 12.
    Boyaval S (2009) Mathematical modeling and simulation for material science. PhD thesis, Université Paris Est Google Scholar
  13. 13.
    Boyaval S, Lelièvre T (2009) A variance reduction method for parametrized stochastic differential equations using the reduced basis paradigm. In: Zhang P (ed) Communication in mathematical sciences, Special issue “Mathematical issues on complex fluids” Google Scholar
  14. 14.
    Boyaval S, Le Bris C, Maday Y, Nguyen NC, Patera AT (2009) A reduced basis approach for variational problems with stochastic parameters: Application to heat conduction with variable Robin coefficient. Comput Methods Appl Mech Eng 198(41–44):3187–3206 CrossRefGoogle Scholar
  15. 15.
    Buffa A, Maday Y, Patera AT, Prud’homme C, Turinici G A priori convergence of the greedy algorithm for the parametrized reduced basis. M2AN (Math Model Numer Anal) (preprint available at
  16. 16.
    Burkardt J, Gunzburger MD, Lee HC (2006) POD and CVT-based reduced order modeling of Navier-Stokes flows. Comput Methods Appl Mech 196:337–355 MATHCrossRefMathSciNetGoogle Scholar
  17. 17.
    Ciarlet Ph (1978) The finite element method for elliptic problems. North-Holland, Amsterdam MATHGoogle Scholar
  18. 18.
    Deb MK, Babuška IM, Oden JT (2001) Solution of stochastic partial differential equations using Galerkin finite element techniques. Comput Methods Appl Mech Eng 190(48):6359–6372 MATHCrossRefGoogle Scholar
  19. 19.
    Debusschere BJ, Najm HN, Pebay PP, Knio OM, Ghanem RG, Le Maître OP (2004) Numerical challenges in the use of polynomial chaos representations for stochastic processes. SIAM J Sci Comput 26(2):698–719 MATHCrossRefMathSciNetGoogle Scholar
  20. 20.
    Deparis S (2009) Reduced basis error bound computation of parameter-dependent Navier-Stokes equations by the natural norm approach. SIAM J Numer Anal 46(4):2039–2067 CrossRefMathSciNetGoogle Scholar
  21. 21.
    Devore RA (1993) Constructive approximation. Acta Numer 7:51–150 CrossRefMathSciNetGoogle Scholar
  22. 22.
    Fink JP, Rheinboldt WC (1983) On the error behavior of the reduced basis technique for nonlinear finite element approximations. Z Angew Math Mech 63(1):21–28 MATHCrossRefMathSciNetGoogle Scholar
  23. 23.
    Fox RL, Miura H (1971) An approximate analysis technique for design calculations. AIAA J 9(1):177–179 CrossRefGoogle Scholar
  24. 24.
    Ghanem RG, Spanos PD (1991) Stochastic finite elements: A spectral approach. Dover, New York. Revised edition, Springer, New York (2003) MATHGoogle Scholar
  25. 25.
    Golub G, van Loan C (1996) Matrix computations, 3rd edn. The Johns Hopkins University Press, London MATHGoogle Scholar
  26. 26.
    Grepl MA, Patera AT (2005) A Posteriori error bounds for reduced-basis approximations of parametrized parabolic partial differential equations. M2AN (Math Model Numer Anal) 39(1):157–181 MATHCrossRefMathSciNetGoogle Scholar
  27. 27.
    Grepl MA, Maday Y, Nguyen NC, Patera AT (2007) Efficient reduced-basis treatment of nonaffine and nonlinear partial differential equations. M2AN (Math Model Numer Anal) 41(2):575–605. doi:10.1051/m2an:2007031 MATHCrossRefMathSciNetGoogle Scholar
  28. 28.
    Gunzburger MD (1989) Finite element methods for viscous incompressible flows. Academic Press, New York MATHGoogle Scholar
  29. 29.
    Haasdonk B, Ohlberger M (2008) Reduced basis method for finite volume approximations of parametrized linear evolution equations. M2AN (Math Model Numer Anal) 42(3):277–302 MATHCrossRefMathSciNetGoogle Scholar
  30. 30.
    Haasdonk B, Ohlberger M (2008) Adaptive basis enrichment for the reduced basis method applied to finite volume schemes. In: Proc 5th international symposium on finite volumes for complex applications, June 08–13, 2008, Aussois, France, pp 471–478 Google Scholar
  31. 31.
    Hammersley J, Handscomb D (eds) (1964) Monte Carlo methods. Chapman and Hall Ltd, London MATHGoogle Scholar
  32. 32.
    Huynh DBP, Patera AT (2007) Reduced-basis approximation and a posteriori error estimation for stress intensity factors. Int J Numer Methods Eng 72(10):1219–1259. doi:10.1002/nme.2090 MATHCrossRefGoogle Scholar
  33. 33.
    Huynh DBP, Rozza G, Sen S, Patera AT (2007) A successive constraint linear optimization method for lower bounds of parametric coercivity and inf-sup stability constants. C R Math Acad Sci Paris 345:473–478 MATHMathSciNetGoogle Scholar
  34. 34.
    Huynh DBP, Knezevic DJ, Chen Y, Hesthaven JS, Patera AT (2010) A natural-norm successive constraint method for inf-sup lower bounds. Comput Methods Appl Mech Eng 199:1963–1975. doi:10.1016/j.cma.2010.02.011 CrossRefGoogle Scholar
  35. 35.
    Karhunen K (1946) Zur spektraltheorie stochastischer prozesse. Ann Acad Sci Fenn 37 Google Scholar
  36. 36.
    Kloeden P, Platen E (2000) Numerical solution of stochastic differential equations. Springer, Berlin Google Scholar
  37. 37.
    Knezevic DJ, Patera AT (2010) A certified reduced basis method for the Fokker-Planck equation of dilute polymeric fluids: FENE dumbbells in extensional flow. SIAM J Sci Comput 32(2):793–817. doi:10.1137/090759239 CrossRefMathSciNetGoogle Scholar
  38. 38.
    Kunisch K, Volkwein S (2002) Galerkin proper orthogonal decomposition methods for a general equation in fluid dynamics. SIAM J Numer Anal 40(2):492–515 MATHCrossRefMathSciNetGoogle Scholar
  39. 39.
    Le Bris C (2005) Systèmes multi-échelles : Modélisation & simulation. Mathématiques & applications, vol 47. Springer, Berlin MATHGoogle Scholar
  40. 40.
    Le Bris C, Lelièvre T (2009) Multiscale modelling of complex fluids: A mathematical initiation. In: Engquist B, Lötstedt P, Runborg O (eds) Multiscale modeling and simulation in science series. LNCSE, vol 66. Springer, Berlin, pp 49–138 CrossRefGoogle Scholar
  41. 41.
    Lee Lin MY (1991) Estimation of the error in the reduced-basis method solution of differential algebraic equations. SIAM J Numer Anal 28:512–528 MATHCrossRefMathSciNetGoogle Scholar
  42. 42.
    Lienhard JH IV, Lienhard JH V, (2002) A heat transfer textbook. Phlogiston Press, Cambridge Google Scholar
  43. 43.
    Loève M (1978) Probability theory, vol I–II. Springer, New York MATHGoogle Scholar
  44. 44.
    Luschy H, Pagès G (2002) Functional quantization of Gaussian processes. J Funct Anal 196:486–531 CrossRefMathSciNetGoogle Scholar
  45. 45.
    Maday Y (2006) Reduced-basis method for the rapid and reliable solution of partial differential equations. In: Proceedings of international conference of mathematicians, Madrid. European Mathematical Society, Zurich Google Scholar
  46. 46.
    Maday Y, Patera AT, Turinici G (2002) A priori convergence theory for reduced-basis approximations of single-parameter elliptic partial differential equations. J Sci Comput 17(1–4):437–446 MATHCrossRefMathSciNetGoogle Scholar
  47. 47.
    Maday Y, Nguyen NC, Patera AT, Pau G (2009) A general, multipurpose interpolation procedure: the magic points. Commun Pure Appl Anal 8(1):383–404 MATHCrossRefMathSciNetGoogle Scholar
  48. 48.
    Matthies HG, Keese A (2005) Galerkin methods for linear and nonlinear elliptic stochastic pdes. Comput Methods Appl Mech Eng 194:1295–1331 MATHCrossRefMathSciNetGoogle Scholar
  49. 49.
    Melchior M, Öttinger HC (1995) Variance reduced simulations of stochastic differential equations. J Chem Phys 103:9506–9509 CrossRefGoogle Scholar
  50. 50.
    Milstein GN, Tretyakov MV (2006) Practical variance reduction via regression for simulating diffusions. Technical Report MA-06-19, School of Mathematics and Computer Science, University of Leicester Google Scholar
  51. 51.
    Nagy DA (1979) Modal representation of geometrically nonlinear behaviour by the finite element method. Comput Struct 10:683–688 MATHCrossRefGoogle Scholar
  52. 52.
    Newton NJ (1994) Variance reduction for simulated diffusions. SIAM J Appl Math 54(6):1780–1805 MATHCrossRefMathSciNetGoogle Scholar
  53. 53.
    Nguyen NC (2007) A multiscale reduced-basis method for parametrized elliptic partial differential equations with multiple scales. J Comput Phys 227:9807–9822 CrossRefGoogle Scholar
  54. 54.
    Nguyen NC, Veroy K, Patera AT (2005) Certified real-time solution of parametrized partial differential equations. In: Yip S (ed) Springer, Berlin, pp 1523–1558 Google Scholar
  55. 55.
    Nguyen NC, Rozza G, Huynh DBP, T Patera A (2009) Reduced basis approximation and a posteriori error estimation for parametrized parabolic pdes; application to real-time Bayesian parameter estimation. In: Biegler, Biros, Ghattas, Heinkenschloss, Keyes, Mallick, Tenorio, van Bloemen Waanders, Willcox (eds) Computational methods for large scale inverse problems and uncertainty quantification. Wiley, Berlin Google Scholar
  56. 56.
    Nguyen NC, Rozza G, Patera AT (2009) Reduced basis approximation and a posteriori error estimation for the time-dependent viscous burgers equation. Calcolo 46(3):157–185 MATHCrossRefMathSciNetGoogle Scholar
  57. 57.
    Noor AK (1981) Recent advances in reduction methods for nonlinear problems. Comput Struct 13:31–44 MATHCrossRefGoogle Scholar
  58. 58.
    Noor AK (1982) On making large nonlinear problems small. Comput Methods Appl Mech Eng 34:955–985 MATHCrossRefGoogle Scholar
  59. 59.
    Noor AK, Peters JM (1980) Reduced basis technique for nonlinear analysis of structures. AIAA J 18(4):455–462 CrossRefGoogle Scholar
  60. 60.
    Noor AK, Peters JM (1983) Multiple-parameter reduced basis technique for bifurcation and post-buckling analysis of composite plates. Int J Numer Methods Eng 19:1783–1803 MATHCrossRefGoogle Scholar
  61. 61.
    Noor AK, Peters JM (1983) Recent advances in reduction methods for instability analysis of structures. Comput Struct 16:67–80 MATHCrossRefGoogle Scholar
  62. 62.
    Noor AK, Balch CD, Shibut MA (1984) Reduction methods for non-linear steady-state thermal analysis. Int J Numer Methods Eng 20:1323–1348 MATHCrossRefGoogle Scholar
  63. 63.
    Noor AK, Peters JM, Andersen CM (1984) Mixed models and reduction techniques for large-rotation nonlinear problems. Comput Methods Appl Mech Eng 44:67–89 MATHCrossRefGoogle Scholar
  64. 64.
    Nouy A (2007) A generalized spectral decomposition technique to solve a class of linear stochastic partial differential equations. Comput Methods Appl Mech Eng 196(45–48):4521–4537 MATHCrossRefMathSciNetGoogle Scholar
  65. 65.
    Nouy A (2008) Generalized spectral decomposition method for solving stochastic finite element equations: Invariant subspace problem and dedicated algorithms. Comput Methods Appl Mech Eng 197(51–52):4718–4736 MATHCrossRefMathSciNetGoogle Scholar
  66. 66.
    Öttinger HC, van den Brule BHAA, Hulsen MA (1997) Brownian configuration fields and variance reduced CONNFFESSIT. J Non-Newton Fluid Mech 70(30):255–261 CrossRefGoogle Scholar
  67. 67.
    Pagès G, Printems J (2005) Functional quantization for numerics with an application to option pricing. Monte Carlo Methods Appl 11(4):407–446 MATHCrossRefMathSciNetGoogle Scholar
  68. 68.
    Pagès G, Sellami A (2008) Convergence of multi-dimensional quantized SDE’s.
  69. 69.
    Patera AT, Rønquist EM (2007) Reduced basis approximations and a posteriori error estimation for a Boltzmann model. Comput Methods Appl Mech Eng 196:2925–2942 MATHCrossRefGoogle Scholar
  70. 70.
    Patera AT, Rozza G Reduced basis approximation and a posteriori error estimation for parametrized partial differential equations. Copyright MIT, 2006–2007. To appear in MIT Pappalardo monographs in mechanical engineering Google Scholar
  71. 71.
    Peterson JS (1989) The reduced basis method for incompressible viscous flow calculations. SIAM J Sci Stat Comput 10(4):777–786 MATHCrossRefGoogle Scholar
  72. 72.
    Pinkus A (1985) n-widths in approximation theory. Springer, Berlin MATHGoogle Scholar
  73. 73.
    Porsching TA (1985) Estimation of the error in the reduced basis method solution of nonlinear equations. Math Comput 45(172):487–496 MATHCrossRefMathSciNetGoogle Scholar
  74. 74.
    Porsching TA, Lee Lin MY (1987) The reduced-basis method for initial value problems. SIAM J Numer Anal 24:1277–1287 MATHCrossRefMathSciNetGoogle Scholar
  75. 75.
    Prud’homme C, Rovas D, Veroy K, Maday Y, Patera AT, Turinici G (2002) Reliable real-time solution of parametrized partial differential equations: Reduced-basis output bounds methods. J Fluids Eng 124(1):70–80 CrossRefGoogle Scholar
  76. 76.
    Quarteroni A (2009) Numerical models for differential problems, vol 2. Springer, Berlin MATHGoogle Scholar
  77. 77.
    Rheinboldt WC (1981) Numerical analysis of continuation methods for nonlinear structural problems. Comput Struct 13(1–3):103–113 MATHCrossRefMathSciNetGoogle Scholar
  78. 78.
    Rheinboldt WC (1993) On the theory and error estimation of the reduced basis method for multi-parameter problems. Nonlinear Anal Theory Methods Appl 21(11):849–858 MATHCrossRefMathSciNetGoogle Scholar
  79. 79.
    Rozza G, Huynh DBP, Patera AT (2008) Reduced basis approximation and a posteriori error estimation for affinely parametrized elliptic coercive partial differential equations—application to transport and continuum mechanics. Arch Comput Methods Eng 15(3):229–275. doi:10.1007/s11831-008-9019-9 MATHCrossRefMathSciNetGoogle Scholar
  80. 80.
    Schwab C, Todor RA (2006) Karhunen-loève approximation of random fields by generalized fast multipole methods. J Comput Phys 217(1):100–122 MATHCrossRefMathSciNetGoogle Scholar
  81. 81.
    Sen S (2008) Reduced-basis approximation and a posteriori error estimation for many-parameter heat conduction problems. Numer Heat Transf Part B, Fundam 54(5) Google Scholar
  82. 82.
    Sen S, Veroy K, Huynh DBP, Deparis S, Nguyen NC, Patera AT (2006) “Natural norm” a posteriori error estimators for reduced basis approximations. J Comput Phys 217:37–62 MATHCrossRefMathSciNetGoogle Scholar
  83. 83.
    Strang G, Fix GJ (1973) An analysis of the finite element method. Prentice-Hall, New York MATHGoogle Scholar
  84. 84.
    Temlyakov VN (2008) Nonlinear methods of approximation. Found Comput Math 3:33–107 CrossRefMathSciNetGoogle Scholar
  85. 85.
    Veroy K, Rovas D, Patera AT (2002) A Posteriori error estimation for reduced-basis approximation of parametrized elliptic coercive partial differential equations: “convex inverse” bound conditioners. ESAIM Control Optim Calc Var 8:1007–1028 MATHCrossRefMathSciNetGoogle Scholar
  86. 86.
    Veroy K, Prud’homme C, Rovas DV, Patera AT (2003) A posteriori error bounds for reduced-basis approximation of parametrized noncoercive and nonlinear elliptic partial differential equations. In: Proceedings of the 16th AIAA computational fluid dynamics conference. Paper 2003-3847 Google Scholar

Copyright information

© CIMNE, Barcelona, Spain 2010

Authors and Affiliations

  • S. Boyaval
    • 1
    • 2
  • C. Le Bris
    • 1
    • 2
  • T. Lelièvre
    • 1
    • 2
  • Y. Maday
    • 3
    • 4
  • N. C. Nguyen
    • 5
  • A. T. Patera
    • 5
  1. 1.CERMICS, Ecole des ponts ParisTechUniversité Paris-EstMarne la Vallée Cedex 2France
  2. 2.MICMAC project teamINRIALe Chesnay CedexFrance
  3. 3.UMR 7598, Laboratoire Jacques-Louis LionsUPMC Univ Paris 06ParisFrance
  4. 4.Division of Applied MathematicsBrown UniversityProvidenceUSA
  5. 5.Department of Mechanical EngineeringMassachusetts Institute of TechnologyCambridgeUSA

Personalised recommendations