Skip to main content

Estimation of Ordinary Differential Equations Solutions with Gaussian Processes and Polynomial Chaos Expansion

  • Conference paper
  • First Online:
Information and Communication Technologies (TICEC 2021)

Abstract

Derivative modeling is a wide-used technique in the estimation of solutions of systems of differential equations whose numerical solution has an intractable computational complexity or in which the presence of error or infinitesimal perturbations could result in their divergence. The quantification of the uncertainty that is produced when estimating the solution in a finite mesh is an open problem and has been addressed from various probabilistic approaches. In this work, uncertainty estimation of solutions of ordinary differential equations by means of a GP process in a space of smoothed functions is addressed by implementing an algorithm that allows estimating the solution states x(t) and their derivatives in a sequential way. Besides, the addition of polynomial chaos expansions (PCE) using the resulting distributions of the algorithm is proposed to improve the prediction of the algorithm. To illustrate the methodology, the algorithms were tested on three known systems of ordinary differential equations and their effectiveness was quantified by three performance measures, resulting in an overall improvement in prediction by adding the polynomial chaos expansion.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Butcher, J.: Numerical methods for ordinary differential equations, pp. iā€“xxiv, August 2016

    Google ScholarĀ 

  2. Chkrebtii, O., Campbell, D., Girolami, M., Calderhead, B.: Bayesian solution uncertainty quantification for differential equations. Bayesian Anal. 11, 1239ā€“1267 (2013)

    MathSciNetĀ  MATHĀ  Google ScholarĀ 

  3. Doungmo Goufo, E.F., Maritz, R., Munganga, J.: Some properties of the Kermack-McKendrick epidemic model with fractional derivative and nonlinear incidence. Adv. Differ. Equ. 2014(1), 1ā€“9 (2014)

    ArticleĀ  MathSciNetĀ  Google ScholarĀ 

  4. FitzHugh, R.: Impulses and physiological states in theoretical models of nerve membrane. Biophys. J . 1(6), 445ā€“466 (1961)

    ArticleĀ  Google ScholarĀ 

  5. Heinonen, M., Yildiz, C., Mannerstrm, H., Intosalmi, J., Lhdesmki, H.: Learning unknown ode models with Gaussian processes, March 2018

    Google ScholarĀ 

  6. Huang, H., Handel, A., Song, X.: A Bayesian approach to estimate parameters of ordinary differential equation. Comput. Stat. 35 (2020)

    Google ScholarĀ 

  7. Infante, S., Luna, C., Snchez, L., Hernndez, A.: Approximations of the solutions of a stochastic differential equation using Dirichlet process mixtures and Gaussian mixtures. Stat. Optim. Inf. Comput. 4, 289ā€“307 (2016)

    ArticleĀ  MathSciNetĀ  Google ScholarĀ 

  8. Kersting, H., Hennig, P.: Active uncertainty calibration in Bayesian ODE solvers, May 2016

    Google ScholarĀ 

  9. Lorenz, E.: Deterministic nonperiodic flow. J. Atmos. Sci. 20, 130ā€“141 (1963)

    ArticleĀ  MathSciNetĀ  Google ScholarĀ 

  10. Overstall, A., Woods, D., Parker, B.: Bayesian optimal design for ordinary differential equation models with application in biological science. J. Am. Stat. Assoc. 115 (2019)

    Google ScholarĀ 

  11. Ramsay, J., Dalzell, C.: Some tools for functional data analysis. J. R. Stat. Soc. Ser. B (Methodol.) 53, 539ā€“561 (1991)

    Google ScholarĀ 

  12. Sandu, C., Sandu, A., Ahmadian, M.: Modeling multibody systems with uncertainties. Part II: Numerical applications. Multibody Syst. Dyn. 15, 241ā€“262 (2006)

    Google ScholarĀ 

  13. Schober, M., Srkk, S., Hennig, P.: A probabilistic model for the numerical solution of initial value problems. Stat. Comput. 29 (2019)

    Google ScholarĀ 

  14. Sherwood, W.E.: FitzHugh-Nagumo Model, pp. 1ā€“11. Springer, New York (2013)

    Google ScholarĀ 

  15. Skilling, J.: Bayesian Solution of Ordinary Differential Equations, pp. 23ā€“37. Springer, Dordrecht (1992)

    MATHĀ  Google ScholarĀ 

  16. SĆ”nchez, L., Infante, S., Marcano, J., Griffin, V.: Polynomial chaos based on the parallelized Ensamble Kalman filter to estimate precipitation states. Stat. Optim. Inf. Comput. 3, 79ā€“95 (2015)

    ArticleĀ  MathSciNetĀ  Google ScholarĀ 

  17. Solak, E., Murray-Smith, R., Leithead, W., Leith, D., Rasmussen, C.: Derivative observations in gaussian process models of dynamic systems. In: Appear Advance Neural Information Processing Systems, vol. 16 (2003)

    Google ScholarĀ 

  18. Tronarp, F., Kersting, H., Srkk, S., Hennig, P.: Probabilistic solutions to ordinary differential equations as nonlinear Bayesian filtering: a new perspective. Stat. Comput. 29 (2019)

    Google ScholarĀ 

  19. Yaglom, A., Newell, G.: An introduction to the theory of stationary random functions. J. Appl. Mech. 30, 479 (1963)

    ArticleĀ  Google ScholarĀ 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Naomi CedeƱo .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

Ā© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

CedeƱo, N., Infante, S. (2021). Estimation of Ordinary Differential Equations Solutions with Gaussian Processes and Polynomial Chaos Expansion. In: Salgado Guerrero, J.P., Chicaiza Espinosa, J., Cerrada Lozada, M., Berrezueta-Guzman, S. (eds) Information and Communication Technologies. TICEC 2021. Communications in Computer and Information Science, vol 1456. Springer, Cham. https://doi.org/10.1007/978-3-030-89941-7_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-89941-7_1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-89940-0

  • Online ISBN: 978-3-030-89941-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics