Skip to main content
Log in

Reduced Basis Techniques for Stochastic Problems

  • Original Paper
  • Published:
Archives of Computational Methods in Engineering Aims and scope Submit manuscript

Abstract

We report here on the recent application of a now classical general reduction technique, the Reduced-Basis (RB) approach initiated by C. Prud’homme et al. in J. Fluids Eng. 124(1), 70–80, 2002, to the specific context of differential equations with random coefficients. After an elementary presentation of the approach, we review two contributions of the authors: in Comput. Methods Appl. Mech. Eng. 198(41–44), 3187–3206, 2009, which presents the application of the RB approach for the discretization of a simple second order elliptic equation supplied with a random boundary condition, and in Commun. Math. Sci., 2009, which uses a RB type approach to reduce the variance in the Monte-Carlo simulation of a stochastic differential equation. We conclude the review with some general comments and also discuss possible tracks for further research in the direction.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Ainsworth M, Oden JT (2000) A posteriori error estimation in finite element analysis. Wiley-Interscience, New York

    MATH  Google Scholar 

  2. Almroth BO, Stern P, Brogan FA (1978) Automatic choice of global shape functions in structural analysis. AIAA J 16:525–528

    Article  Google Scholar 

  3. Arouna B (2004) Robbins-Monroe algorithms and variance reduction in finance. J Comput Finance 7(2):35–62

    Google Scholar 

  4. Babuška I, Tempone R, Zouraris G (2005) Solving elliptic boundary value problems with uncertain coefficients by the finite element method: the stochastic formulation. Comput Methods Appl Mech Eng 194:1251–1294

    Article  MATH  Google Scholar 

  5. Babuška I, Nobile F, Tempone R (2007) A stochastic collocation method for elliptic partial differential equations with random input data. SIAM J Numer Anal 45(3):1005–1034

    Article  MATH  MathSciNet  Google Scholar 

  6. Barrault M, Nguyen NC, Maday Y, Patera AT (2004) An “empirical interpolation” method: Application to efficient reduced-basis discretization of partial differential equations. C R Acad Sci Paris, Sér I 339:667–672

    MATH  MathSciNet  Google Scholar 

  7. Barrett A, Reddien G (1995) On the reduced basis method. Z Angew Math Mech 75(7):543–549

    MATH  MathSciNet  Google Scholar 

  8. Becker R, Rannacher R (2001) An optimal control approach to a posteriori error estimation in finite element methods. Acta Numer 37:1–225

    MathSciNet  Google Scholar 

  9. Binev P, Cohen A, Dahmen W, DeVore R, Petrova G, Wojtaszczyk P (2010) Convergence rate for greedy algorithms in reduced basis methods, submitted for publication (preprint available at www.sciencesmath-paris.fr/uploaded/dahmen.pdf)

  10. Bonvin J, Picasso M (1999) Variance reduction methods for CONNFFESSIT-like simulations. J Non-Newton Fluid Mech 84:191–215

    Article  MATH  Google Scholar 

  11. Boyaval S (2008) Reduced-basis approach for homogenization beyond the periodic setting. SIAM Multiscale Model Simul 7(1):466–494

    Article  MATH  MathSciNet  Google Scholar 

  12. Boyaval S (2009) Mathematical modeling and simulation for material science. PhD thesis, Université Paris Est

  13. Boyaval S, Lelièvre T (2009) A variance reduction method for parametrized stochastic differential equations using the reduced basis paradigm. In: Zhang P (ed) Communication in mathematical sciences, Special issue “Mathematical issues on complex fluids”

  14. Boyaval S, Le Bris C, Maday Y, Nguyen NC, Patera AT (2009) A reduced basis approach for variational problems with stochastic parameters: Application to heat conduction with variable Robin coefficient. Comput Methods Appl Mech Eng 198(41–44):3187–3206

    Article  Google Scholar 

  15. Buffa A, Maday Y, Patera AT, Prud’homme C, Turinici G A priori convergence of the greedy algorithm for the parametrized reduced basis. M2AN (Math Model Numer Anal) (preprint available at http://augustine.mit.edu/methodology/papers/atp_M2AN_preprint_Nov09.pdf)

  16. Burkardt J, Gunzburger MD, Lee HC (2006) POD and CVT-based reduced order modeling of Navier-Stokes flows. Comput Methods Appl Mech 196:337–355

    Article  MATH  MathSciNet  Google Scholar 

  17. Ciarlet Ph (1978) The finite element method for elliptic problems. North-Holland, Amsterdam

    MATH  Google Scholar 

  18. Deb MK, Babuška IM, Oden JT (2001) Solution of stochastic partial differential equations using Galerkin finite element techniques. Comput Methods Appl Mech Eng 190(48):6359–6372

    Article  MATH  Google Scholar 

  19. Debusschere BJ, Najm HN, Pebay PP, Knio OM, Ghanem RG, Le Maître OP (2004) Numerical challenges in the use of polynomial chaos representations for stochastic processes. SIAM J Sci Comput 26(2):698–719

    Article  MATH  MathSciNet  Google Scholar 

  20. Deparis S (2009) Reduced basis error bound computation of parameter-dependent Navier-Stokes equations by the natural norm approach. SIAM J Numer Anal 46(4):2039–2067

    Article  MathSciNet  Google Scholar 

  21. Devore RA (1993) Constructive approximation. Acta Numer 7:51–150

    Article  MathSciNet  Google Scholar 

  22. Fink JP, Rheinboldt WC (1983) On the error behavior of the reduced basis technique for nonlinear finite element approximations. Z Angew Math Mech 63(1):21–28

    Article  MATH  MathSciNet  Google Scholar 

  23. Fox RL, Miura H (1971) An approximate analysis technique for design calculations. AIAA J 9(1):177–179

    Article  Google Scholar 

  24. Ghanem RG, Spanos PD (1991) Stochastic finite elements: A spectral approach. Dover, New York. Revised edition, Springer, New York (2003)

    MATH  Google Scholar 

  25. Golub G, van Loan C (1996) Matrix computations, 3rd edn. The Johns Hopkins University Press, London

    MATH  Google Scholar 

  26. Grepl MA, Patera AT (2005) A Posteriori error bounds for reduced-basis approximations of parametrized parabolic partial differential equations. M2AN (Math Model Numer Anal) 39(1):157–181

    Article  MATH  MathSciNet  Google Scholar 

  27. Grepl MA, Maday Y, Nguyen NC, Patera AT (2007) Efficient reduced-basis treatment of nonaffine and nonlinear partial differential equations. M2AN (Math Model Numer Anal) 41(2):575–605. doi:10.1051/m2an:2007031

    Article  MATH  MathSciNet  Google Scholar 

  28. Gunzburger MD (1989) Finite element methods for viscous incompressible flows. Academic Press, New York

    MATH  Google Scholar 

  29. Haasdonk B, Ohlberger M (2008) Reduced basis method for finite volume approximations of parametrized linear evolution equations. M2AN (Math Model Numer Anal) 42(3):277–302

    Article  MATH  MathSciNet  Google Scholar 

  30. Haasdonk B, Ohlberger M (2008) Adaptive basis enrichment for the reduced basis method applied to finite volume schemes. In: Proc 5th international symposium on finite volumes for complex applications, June 08–13, 2008, Aussois, France, pp 471–478

    Google Scholar 

  31. Hammersley J, Handscomb D (eds) (1964) Monte Carlo methods. Chapman and Hall Ltd, London

    MATH  Google Scholar 

  32. Huynh DBP, Patera AT (2007) Reduced-basis approximation and a posteriori error estimation for stress intensity factors. Int J Numer Methods Eng 72(10):1219–1259. doi:10.1002/nme.2090

    Article  MATH  Google Scholar 

  33. Huynh DBP, Rozza G, Sen S, Patera AT (2007) A successive constraint linear optimization method for lower bounds of parametric coercivity and inf-sup stability constants. C R Math Acad Sci Paris 345:473–478

    MATH  MathSciNet  Google Scholar 

  34. Huynh DBP, Knezevic DJ, Chen Y, Hesthaven JS, Patera AT (2010) A natural-norm successive constraint method for inf-sup lower bounds. Comput Methods Appl Mech Eng 199:1963–1975. doi:10.1016/j.cma.2010.02.011

    Article  Google Scholar 

  35. Karhunen K (1946) Zur spektraltheorie stochastischer prozesse. Ann Acad Sci Fenn 37

  36. Kloeden P, Platen E (2000) Numerical solution of stochastic differential equations. Springer, Berlin

    Google Scholar 

  37. Knezevic DJ, Patera AT (2010) A certified reduced basis method for the Fokker-Planck equation of dilute polymeric fluids: FENE dumbbells in extensional flow. SIAM J Sci Comput 32(2):793–817. doi:10.1137/090759239

    Article  MathSciNet  Google Scholar 

  38. Kunisch K, Volkwein S (2002) Galerkin proper orthogonal decomposition methods for a general equation in fluid dynamics. SIAM J Numer Anal 40(2):492–515

    Article  MATH  MathSciNet  Google Scholar 

  39. Le Bris C (2005) Systèmes multi-échelles : Modélisation & simulation. Mathématiques & applications, vol 47. Springer, Berlin

    MATH  Google Scholar 

  40. Le Bris C, Lelièvre T (2009) Multiscale modelling of complex fluids: A mathematical initiation. In: Engquist B, Lötstedt P, Runborg O (eds) Multiscale modeling and simulation in science series. LNCSE, vol 66. Springer, Berlin, pp 49–138

    Chapter  Google Scholar 

  41. Lee Lin MY (1991) Estimation of the error in the reduced-basis method solution of differential algebraic equations. SIAM J Numer Anal 28:512–528

    Article  MATH  MathSciNet  Google Scholar 

  42. Lienhard JH IV, Lienhard JH V, (2002) A heat transfer textbook. Phlogiston Press, Cambridge

    Google Scholar 

  43. Loève M (1978) Probability theory, vol I–II. Springer, New York

    MATH  Google Scholar 

  44. Luschy H, Pagès G (2002) Functional quantization of Gaussian processes. J Funct Anal 196:486–531

    Article  MathSciNet  Google Scholar 

  45. Maday Y (2006) Reduced-basis method for the rapid and reliable solution of partial differential equations. In: Proceedings of international conference of mathematicians, Madrid. European Mathematical Society, Zurich

    Google Scholar 

  46. Maday Y, Patera AT, Turinici G (2002) A priori convergence theory for reduced-basis approximations of single-parameter elliptic partial differential equations. J Sci Comput 17(1–4):437–446

    Article  MATH  MathSciNet  Google Scholar 

  47. Maday Y, Nguyen NC, Patera AT, Pau G (2009) A general, multipurpose interpolation procedure: the magic points. Commun Pure Appl Anal 8(1):383–404

    Article  MATH  MathSciNet  Google Scholar 

  48. Matthies HG, Keese A (2005) Galerkin methods for linear and nonlinear elliptic stochastic pdes. Comput Methods Appl Mech Eng 194:1295–1331

    Article  MATH  MathSciNet  Google Scholar 

  49. Melchior M, Öttinger HC (1995) Variance reduced simulations of stochastic differential equations. J Chem Phys 103:9506–9509

    Article  Google Scholar 

  50. Milstein GN, Tretyakov MV (2006) Practical variance reduction via regression for simulating diffusions. Technical Report MA-06-19, School of Mathematics and Computer Science, University of Leicester

  51. Nagy DA (1979) Modal representation of geometrically nonlinear behaviour by the finite element method. Comput Struct 10:683–688

    Article  MATH  Google Scholar 

  52. Newton NJ (1994) Variance reduction for simulated diffusions. SIAM J Appl Math 54(6):1780–1805

    Article  MATH  MathSciNet  Google Scholar 

  53. Nguyen NC (2007) A multiscale reduced-basis method for parametrized elliptic partial differential equations with multiple scales. J Comput Phys 227:9807–9822

    Article  Google Scholar 

  54. Nguyen NC, Veroy K, Patera AT (2005) Certified real-time solution of parametrized partial differential equations. In: Yip S (ed) Springer, Berlin, pp 1523–1558

    Google Scholar 

  55. Nguyen NC, Rozza G, Huynh DBP, T Patera A (2009) Reduced basis approximation and a posteriori error estimation for parametrized parabolic pdes; application to real-time Bayesian parameter estimation. In: Biegler, Biros, Ghattas, Heinkenschloss, Keyes, Mallick, Tenorio, van Bloemen Waanders, Willcox (eds) Computational methods for large scale inverse problems and uncertainty quantification. Wiley, Berlin

    Google Scholar 

  56. Nguyen NC, Rozza G, Patera AT (2009) Reduced basis approximation and a posteriori error estimation for the time-dependent viscous burgers equation. Calcolo 46(3):157–185

    Article  MATH  MathSciNet  Google Scholar 

  57. Noor AK (1981) Recent advances in reduction methods for nonlinear problems. Comput Struct 13:31–44

    Article  MATH  Google Scholar 

  58. Noor AK (1982) On making large nonlinear problems small. Comput Methods Appl Mech Eng 34:955–985

    Article  MATH  Google Scholar 

  59. Noor AK, Peters JM (1980) Reduced basis technique for nonlinear analysis of structures. AIAA J 18(4):455–462

    Article  Google Scholar 

  60. Noor AK, Peters JM (1983) Multiple-parameter reduced basis technique for bifurcation and post-buckling analysis of composite plates. Int J Numer Methods Eng 19:1783–1803

    Article  MATH  Google Scholar 

  61. Noor AK, Peters JM (1983) Recent advances in reduction methods for instability analysis of structures. Comput Struct 16:67–80

    Article  MATH  Google Scholar 

  62. Noor AK, Balch CD, Shibut MA (1984) Reduction methods for non-linear steady-state thermal analysis. Int J Numer Methods Eng 20:1323–1348

    Article  MATH  Google Scholar 

  63. Noor AK, Peters JM, Andersen CM (1984) Mixed models and reduction techniques for large-rotation nonlinear problems. Comput Methods Appl Mech Eng 44:67–89

    Article  MATH  Google Scholar 

  64. Nouy A (2007) A generalized spectral decomposition technique to solve a class of linear stochastic partial differential equations. Comput Methods Appl Mech Eng 196(45–48):4521–4537

    Article  MATH  MathSciNet  Google Scholar 

  65. Nouy A (2008) Generalized spectral decomposition method for solving stochastic finite element equations: Invariant subspace problem and dedicated algorithms. Comput Methods Appl Mech Eng 197(51–52):4718–4736

    Article  MATH  MathSciNet  Google Scholar 

  66. Öttinger HC, van den Brule BHAA, Hulsen MA (1997) Brownian configuration fields and variance reduced CONNFFESSIT. J Non-Newton Fluid Mech 70(30):255–261

    Article  Google Scholar 

  67. Pagès G, Printems J (2005) Functional quantization for numerics with an application to option pricing. Monte Carlo Methods Appl 11(4):407–446

    Article  MATH  MathSciNet  Google Scholar 

  68. Pagès G, Sellami A (2008) Convergence of multi-dimensional quantized SDE’s. http://arxiv.org/abs/0801.0726

  69. Patera AT, Rønquist EM (2007) Reduced basis approximations and a posteriori error estimation for a Boltzmann model. Comput Methods Appl Mech Eng 196:2925–2942

    Article  MATH  Google Scholar 

  70. Patera AT, Rozza G Reduced basis approximation and a posteriori error estimation for parametrized partial differential equations. Copyright MIT, 2006–2007. To appear in MIT Pappalardo monographs in mechanical engineering

  71. Peterson JS (1989) The reduced basis method for incompressible viscous flow calculations. SIAM J Sci Stat Comput 10(4):777–786

    Article  MATH  Google Scholar 

  72. Pinkus A (1985) n-widths in approximation theory. Springer, Berlin

    MATH  Google Scholar 

  73. Porsching TA (1985) Estimation of the error in the reduced basis method solution of nonlinear equations. Math Comput 45(172):487–496

    Article  MATH  MathSciNet  Google Scholar 

  74. Porsching TA, Lee Lin MY (1987) The reduced-basis method for initial value problems. SIAM J Numer Anal 24:1277–1287

    Article  MATH  MathSciNet  Google Scholar 

  75. Prud’homme C, Rovas D, Veroy K, Maday Y, Patera AT, Turinici G (2002) Reliable real-time solution of parametrized partial differential equations: Reduced-basis output bounds methods. J Fluids Eng 124(1):70–80

    Article  Google Scholar 

  76. Quarteroni A (2009) Numerical models for differential problems, vol 2. Springer, Berlin

    MATH  Google Scholar 

  77. Rheinboldt WC (1981) Numerical analysis of continuation methods for nonlinear structural problems. Comput Struct 13(1–3):103–113

    Article  MATH  MathSciNet  Google Scholar 

  78. Rheinboldt WC (1993) On the theory and error estimation of the reduced basis method for multi-parameter problems. Nonlinear Anal Theory Methods Appl 21(11):849–858

    Article  MATH  MathSciNet  Google Scholar 

  79. Rozza G, Huynh DBP, Patera AT (2008) Reduced basis approximation and a posteriori error estimation for affinely parametrized elliptic coercive partial differential equations—application to transport and continuum mechanics. Arch Comput Methods Eng 15(3):229–275. doi:10.1007/s11831-008-9019-9

    Article  MATH  MathSciNet  Google Scholar 

  80. Schwab C, Todor RA (2006) Karhunen-loève approximation of random fields by generalized fast multipole methods. J Comput Phys 217(1):100–122

    Article  MATH  MathSciNet  Google Scholar 

  81. Sen S (2008) Reduced-basis approximation and a posteriori error estimation for many-parameter heat conduction problems. Numer Heat Transf Part B, Fundam 54(5)

  82. Sen S, Veroy K, Huynh DBP, Deparis S, Nguyen NC, Patera AT (2006) “Natural norm” a posteriori error estimators for reduced basis approximations. J Comput Phys 217:37–62

    Article  MATH  MathSciNet  Google Scholar 

  83. Strang G, Fix GJ (1973) An analysis of the finite element method. Prentice-Hall, New York

    MATH  Google Scholar 

  84. Temlyakov VN (2008) Nonlinear methods of approximation. Found Comput Math 3:33–107

    Article  MathSciNet  Google Scholar 

  85. Veroy K, Rovas D, Patera AT (2002) A Posteriori error estimation for reduced-basis approximation of parametrized elliptic coercive partial differential equations: “convex inverse” bound conditioners. ESAIM Control Optim Calc Var 8:1007–1028

    Article  MATH  MathSciNet  Google Scholar 

  86. Veroy K, Prud’homme C, Rovas DV, Patera AT (2003) A posteriori error bounds for reduced-basis approximation of parametrized noncoercive and nonlinear elliptic partial differential equations. In: Proceedings of the 16th AIAA computational fluid dynamics conference. Paper 2003-3847

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to S. Boyaval.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Boyaval, S., Le Bris, C., Lelièvre, T. et al. Reduced Basis Techniques for Stochastic Problems. Arch Computat Methods Eng 17, 435–454 (2010). https://doi.org/10.1007/s11831-010-9056-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11831-010-9056-z

Keywords

Navigation