Skip to main content
SpringerLink
Log in

Proper Generalized Decompositions and Separated Representations for the Numerical Solution of High Dimensional Stochastic Problems

  • Original Paper
  • Published:
Archives of Computational Methods in Engineering Aims and scope Submit manuscript

Abstract

Uncertainty quantification and propagation in physical systems appear as a critical path for the improvement of the prediction of their response. Galerkin-type spectral stochastic methods provide a general framework for the numerical simulation of physical models driven by stochastic partial differential equations. The response is searched in a tensor product space, which is the product of deterministic and stochastic approximation spaces. The computation of the approximate solution requires the solution of a very high dimensional problem, whose calculation costs are generally prohibitive. Recently, a model reduction technique, named Generalized Spectral Decomposition method, has been proposed in order to reduce these costs. This method belongs to the family of Proper Generalized Decomposition methods. It takes part of the tensor product structure of the solution function space and allows the a priori construction of a quasi optimal separated representation of the solution, which has quite the same convergence properties as a posteriori Hilbert Karhunen-Loève decompositions. The associated algorithms only require the solution of a few deterministic problems and a few stochastic problems on deterministic reduced basis (algebraic stochastic equations), these problems being uncoupled. However, this method does not circumvent the “curse of dimensionality” which is associated with the dramatic increase in the dimension of stochastic approximation spaces, when dealing with high stochastic dimension. In this paper, we propose a marriage between the Generalized Spectral Decomposition algorithms and a separated representation methodology, which exploits the tensor product structure of stochastic functions spaces. An efficient algorithm is proposed for the a priori construction of separated representations of square integrable vector-valued functions defined on a high-dimensional probability space, which are the solutions of systems of stochastic algebraic equations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Ammar A, Mokdad B, Chinesta F, Keunings R (2006) A new family of solvers for some classes of multidimensional partial differential equations encountered in kinetic theory modelling of complex fluids. J Non-Newton Fluid Mech 139(3):153–176

    Article  MATH  Google Scholar 

  2. Babuška I, Tempone R, Zouraris GE (2005) Solving elliptic boundary value problems with uncertain coefficients by the finite element method: the stochastic formulation. Comput Methods Appl Mech Eng 194:1251–1294

    Article  MATH  Google Scholar 

  3. Babuška I, Nobile F, Tempone R (2007) A stochastic collocation method for elliptic partial differential equations with random input data. SIAM J Numer Anal 45(3):1005–1034

    Article  MATH  MathSciNet  Google Scholar 

  4. Barron AR, Cohen A, Dahmen W, DeVore RA (2008) Approximation and learning by greedy algorithms. Ann Stat 36(1):64–94

    Article  MATH  MathSciNet  Google Scholar 

  5. Beylkin G, Mohlenkamp MJ (2005) Algorithms for numerical analysis in high dimensions. SIAM J Sci Comput 26(6):2133–2159

    Article  MATH  MathSciNet  Google Scholar 

  6. Blatman G, Sudret B (2007) Sparse polynomial chaos expansions and adaptive stochastic finite elements using a regression approach. C R, Méc 336(6):518–523

    Google Scholar 

  7. Canuto C, Kozubek T (2007) A fictitious domain approach to the numerical solution of PDEs in stochastic domains. Numer Math 107(2):257–293

    Article  MATH  MathSciNet  Google Scholar 

  8. De Lathauwer L, De Moor B, Vandewalle J (2000) A multilinear singular value decomposition. SIAM J Matrix Anal Appl 21(4):1253–1278

    Article  MATH  MathSciNet  Google Scholar 

  9. de Silva V, Lim L-H (2008) Tensor rank and ill-posedness of the best low-rank approximation problem. SIAM J Matrix Anal Appl 30(3):1084–1127

    Article  MathSciNet  Google Scholar 

  10. Deb M, Babuška I, Oden JT (2001) Solution of stochastic partial differential equations using Galerkin finite element techniques. Comput Methods Appl Mech Eng 190:6359–6372

    Article  MATH  Google Scholar 

  11. DeVore RA, Temlyakov VN (1996) Some remarks on greedy algorithms. Adv Comput Math 5:173–187

    Article  MATH  MathSciNet  Google Scholar 

  12. Doostan A, Iaccarino G (2009) A least-squares approximation of partial differential equations with high-dimensional random inputs. J Comput Phys 228(12):4332–4345

    Article  MATH  MathSciNet  Google Scholar 

  13. Doostan A, Iaccarino G, Etemadi N (2007) A least-squares approximation of high-dimensional uncertain systems. Technical report, Center for Turbulence Research, Annual Research Briefs

  14. Webster CG, Nobile F, Tempone R (2007) A sparse grid stochastic collocation method for partial differential equations with random input data. SIAM J Numer Anal 46(5):2309–2345

    MathSciNet  Google Scholar 

  15. Falco A, Nouy A (2010) A proper generalized decomposition for the solution of elliptic problems in abstract form by using a functional Eckart-Young approach. J Math Anal Appl (submitted)

  16. Frauenfelder P, Schwab C, Todor RA (2005) Finite elements for elliptic problems with stochastic coefficients. Comput Methods Appl Mech Eng 194(2–5):205–228

    Article  MATH  MathSciNet  Google Scholar 

  17. Ghanem R (1999) Ingredients for a general purpose stochastic finite elements implementation. Comput Methods Appl Mech Eng 168:19–34

    Article  MATH  MathSciNet  Google Scholar 

  18. Ghanem R, Spanos P (1991) Stochastic finite elements: a spectral approach. Springer, Berlin

    MATH  Google Scholar 

  19. Ghiocel D, Ghanem R (2002) Stochastic finite-element analysis of seismic soil-structure interaction. ASCE J Eng Mech 128(1):66–77

    Article  Google Scholar 

  20. Gonzalez D, Ammar A, Chinesta F, Cueto E (2009) Recent advances on the use of separated representations. Int J Numer Methods Eng. doi:10.1002/nme.2710

    Google Scholar 

  21. Keese A (2003) A review of recent developments in the numerical solution of stochastic PDEs (stochastic finite elements). Technical report 2003-6, Technical report, Institute of Scientific Computing, Tech Univ Braunschweig, Germany. http://opus.tu-bs.de/opus/volltexte/2003/504/

  22. Keese A, Mathhies HG (2004) Adaptivity and sensitivity for stochastic problems. In: Spanos PD, Deodatis G (eds) Computational stochastic mechanics, vol 4. Millpress, Rotterdam, pp 311–316

    Google Scholar 

  23. Kolda TG (2003) A counterexample to the possibility of an extension of the Eckart-Young low-rank approximation theorem for the orthogonal rank tensor decomposition. SIAM J Matrix Anal Appl 24(3):762–767

    Article  MATH  MathSciNet  Google Scholar 

  24. Kolda TG (2001) Orthogonal tensor decompositions. SIAM J Matrix Anal Appl 23(1):243–255

    Article  MATH  MathSciNet  Google Scholar 

  25. Kolda TG, Bader BW (2009) Tensor decompositions and applications. SIAM Rev 51(3):455–500

    Article  MATH  MathSciNet  Google Scholar 

  26. Ladevèze P (1999) Nonlinear computational structural mechanics—new approaches and non-incremental methods of calculation. Springer, Berlin

    MATH  Google Scholar 

  27. Ladevèze P, Nouy A (2003) On a multiscale computational strategy with time and space homogenization for structural mechanics. Comput Methods Appl Mech Eng 192:3061–3087

    Article  MATH  Google Scholar 

  28. Ladevèze P, Passieux JC, Néron D (2010) The LATIN multiscale computational method and the Proper Generalized Decomposition. Comput Methods Appl Mech Eng 199(21–22):1287–1296

    Article  Google Scholar 

  29. Le Bris C, Lelievre T, Maday Y (2009) Results and questions on a nonlinear approximation approach for solving high-dimensional partial differential equations. Constr Approx 30(3):621–651

    Article  MATH  MathSciNet  Google Scholar 

  30. Le Maître OP, Knio OM, Najm HN, Ghanem RG (2004) Uncertainty propagation using Wiener-Haar expansions. J Comput Phys 197(1):28–57

    Article  MATH  MathSciNet  Google Scholar 

  31. Le Maître OP, Najm HN, Ghanem RG, Knio OM (2004) Multi-resolution analysis of Wiener-type uncertainty propagation schemes. J Comput Phys 197(2):502–531

    Article  MATH  MathSciNet  Google Scholar 

  32. Leibovici D, El Maâche H (1997) A singular value decomposition of an element belonging to a tensor product of k separable Hilbert spaces. C R Acad Sci Paris, Sér I, Math 325(7):779–782

    MATH  Google Scholar 

  33. Mathelin L, Le Maître O (2007) Dual-based a posteriori error estimate for stochastic finite element methods. Commun Appl Math Comput Sci 2(1):83–116

    Article  MATH  MathSciNet  Google Scholar 

  34. Matthies HG (2008) Stochastic finite elements: Computational approaches to stochastic partial differential equations. Z Angew Math Mech 88(11):849–873

    Article  MATH  MathSciNet  Google Scholar 

  35. Matthies HG, Keese A (2005) Galerkin methods for linear and nonlinear elliptic stochastic partial differential equations. Comput Methods Appl Mech Eng 194(12–16):1295–1331

    Article  MATH  MathSciNet  Google Scholar 

  36. Nouy A (2007) A generalized spectral decomposition technique to solve a class of linear stochastic partial differential equations. Comput Methods Appl Mech Eng 196(45–48):4521–4537

    Article  MATH  MathSciNet  Google Scholar 

  37. Nouy A (2008) Generalized spectral decomposition method for solving stochastic finite element equations: invariant subspace problem and dedicated algorithms. Comput Methods Appl Mech Eng 197:4718–4736

    Article  MATH  MathSciNet  Google Scholar 

  38. Nouy A (2009) Recent developments in spectral stochastic methods for the numerical solution of stochastic partial differential equations. Arch Comput Methods Eng 16(3):251–285

    Article  MathSciNet  Google Scholar 

  39. Nouy A (2010) A priori model reduction through Proper Generalized Decomposition for solving time-dependent partial differential equations. Comput Methods Appl Mech Eng 199(23–24):1603–1626

    Article  MathSciNet  Google Scholar 

  40. Nouy A, Ladevèze P (2004) Multiscale computational strategy with time and space homogenization: a radial-type approximation technique for solving micro problems. Int J Multiscale Comput Eng 170(2):557–574

    Article  Google Scholar 

  41. Nouy A, Le Maître OP (2009) Generalized spectral decomposition method for stochastic non linear problems. J Comput Phys 228(1):202–235

    Article  MATH  MathSciNet  Google Scholar 

  42. Nouy A, Clément A, Schoefs F, Moës N (2008) An extended stochastic finite element method for solving stochastic partial differential equations on random domains. Comput Methods Appl Mech Eng 197:4663–4682

    Article  MATH  Google Scholar 

  43. Soize C, Ghanem R (2004) Physical systems with random uncertainties: chaos representations with arbitrary probability measure. SIAM J Sci Comput 26(2):395–410

    Article  MATH  MathSciNet  Google Scholar 

  44. Sudret B (2008) Global sensitivity analysis using polynomial chaos expansions. Reliab Eng Syst Saf 93(7):964–979

    Article  Google Scholar 

  45. Todor RA, Schwab C (2007) Convergence rates for sparse chaos approximations of elliptic problems with stochastic coefficients. IMA J Numer Anal 27(2):232–261

    Article  MATH  MathSciNet  Google Scholar 

  46. Wan X, Karniadakis GE (2005) An adaptive multi-element generalized polynomial chaos method for stochastic differential equations. J Comput Phys 209:617–642

    Article  MATH  MathSciNet  Google Scholar 

  47. Wan X, Karniadakis GE (2006) Multi-element generalized polynomial chaos for arbitrary propability measures. SIAM J Sci Comput 28(3):901–928

    Article  MATH  MathSciNet  Google Scholar 

  48. Wan X, Karniadakis GE (2009) Error control in multi-element generalized polynomial chaos method for elliptic problems with random coefficients. Commun Comput Phys 5(2–4):793–820

    MathSciNet  Google Scholar 

  49. Xiu D (2007) Efficient collocational approach for parametric uncertainty analysis. Commun Comput Phys 2(2):293–309

    MATH  MathSciNet  Google Scholar 

  50. Xiu D (2009) Fast numerical methods for stochastic computations: a review. Commun Comput Phys 5:242–272

    MathSciNet  Google Scholar 

  51. Xiu D, Hesthaven JS (2005) High-order collocation methods for differential equations with random inputs. SIAM J Sci Comput 27(3):1118–1139

    Article  MATH  MathSciNet  Google Scholar 

  52. Xiu D, Karniadakis GE (2002) The Wiener-Askey polynomial chaos for stochastic differential equations. SIAM J Sci Comput 24(2):619–644

    Article  MATH  MathSciNet  Google Scholar 

  53. Xiu D, Tartakovsky DM (2006) Numerical methods for differential equations in random domains. SIAM J Sci Comput 28(3):1167–1185

    Article  MATH  MathSciNet  Google Scholar 

  54. Xiu D, Ganapathysubramanian B, Zabaras N (2007) Sparse grid collocation schemes for stochastic natural convection problems. J Comput Phys 225(1):652–685

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. GeM—Research Institute in Civil Engineering and Mechanics, UMR CNRS 6183, Ecole Centrale Nantes, Nantes, France

    Anthony Nouy

Authors
  1. Anthony Nouy
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Anthony Nouy.

Additional information

This work is supported by the French National Research Agency (grant ANR-06-JCJC-0064) and by GdR MoMaS with partners ANDRA, BRGM, CEA, CNRS, EDF, IRSN.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Nouy, A. Proper Generalized Decompositions and Separated Representations for the Numerical Solution of High Dimensional Stochastic Problems. Arch Computat Methods Eng 17, 403–434 (2010). https://doi.org/10.1007/s11831-010-9054-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11831-010-9054-1

Keywords

Search

Navigation