Abstract
We present a Gaussian process (GP) approach, called Gaussian process hydrodynamics (GPH) for approximating the solution to the Euler and Navier-Stokes (NS) equations. Similar to smoothed particle hydrodynamics (SPH), GPH is a Lagrangian particle-based approach that involves the tracking of a finite number of particles transported by a flow. However, these particles do not represent mollified particles of matter but carry discrete/partial information about the continuous flow. Closure is achieved by placing a divergence-free GP prior ξ on the velocity field and conditioning it on the vorticity at the particle locations. Known physics (e.g., the Richardson cascade and velocity increment power laws) is incorporated into the GP prior by using physics-informed additive kernels. This is equivalent to expressing ξ as a sum of independent GPs ξl, which we call modes, acting at different scales (each mode ξl self-activates to represent the formation of eddies at the corresponding scales). This approach enables a quantitative analysis of the Richardson cascade through the analysis of the activation of these modes, and enables us to analyze coarse-grain turbulence statistically rather than deterministically. Because GPH is formulated by using the vorticity equations, it does not require solving a pressure equation. By enforcing incompressibility and fluid-structure boundary conditions through the selection of a kernel, GPH requires significantly fewer particles than SPH. Because GPH has a natural probabilistic interpretation, the numerical results come with uncertainty estimates, enabling their incorporation into an uncertainty quantification (UQ) pipeline and adding/removing particles (quanta of information) in an adapted manner. The proposed approach is suitable for analysis because it inherits the complexity of state-of-the-art solvers for dense kernel matrices and results in a natural definition of turbulence as information loss. Numerical experiments support the importance of selecting physics-informed kernels and illustrate the major impact of such kernels on the accuracy and stability. Because the proposed approach uses a Bayesian interpretation, it naturally enables data assimilation and predictions and estimations by mixing simulation data and experimental data.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
FEFFERMAN, C. L. Existence and smoothness of the Navier-Stokes equation. The Millennium Prize Problems, 57, 67 (2000)
PHILLIPS, L. Turbulence, the oldest unsolved problem in physics. Retrieved from https://www.arstechnica.com/science/2018/10/turbulence-the-oldest-unsolved-problem-in-physics. Accessed October, 25, 2018 (2018)
LUCY, L. B. A numerical approach to the testing of the fission hypothesis. The Astronomical Journal, 82, 1013–1024 (1977)
GINGOLD, R. A. and MONAGHAN, J. J. Smoothed particle hydrodynamics: theory and application to non-spherical stars. Monthly Notices of the Royal Astronomical Society, 181, 375–389 (1977)
MONAGHAN, J. J. Smoothed particle hydrodynamics. Annual Review of Astronomy and Astrophysics, 30, 543–574 (1992)
LIU, M. and LIU, G. Smoothed particle hydrodynamics (SPH): an overview and recent developments. Archives of Computational Methods in Engineering, 17, 25–76 (2010)
VACONDIO, R., ALTOMARE, C., DE LEFFE, M., HU, X., LE TOUZÉ, D., LIND, S., MARONGIU, J. C., MARRONE, S., ROGERS, B. D., and SOUTO-IGLESIAS, A. Grand challenges for smoothed particle hydrodynamics numerical schemes. Computational Particle Mechanics, 8, 575–588 (2021)
OWHADI, H., SCOVEL, C., and SCHÄFER, F. Statistical numerical approximation. Notices of the American Mathematical Society, 66, 1608–1617 (2019)
OWHADI, H. and SCOVEL, C. Operator-Adapted Wavelets, Fast Solvers, and Numerical Homogenization: From a Game Theoretic Approach to Numerical Approximation and Algorithm Design, Vol. 35, Cambridge University Press, Cambridge (2019)
MICCHELLI, C. A. and RIVLIN, T. J. A survey of optimal recovery. Optimal Estimation in Approximation Theory, Springer, New York, 1–54 (1977)
OWHADI, H., SCOVEL, C., and YOO, G. R. Kernel Mode Decomposition and the Programming of Kernels, Springer, Cham (2021)
LEONARD, A. Vortex methods for flow simulation. Journal of Computational Physics, 37, 289–335 (1980)
COTTET, G. H. and KOUMOUTSAKOS, P. D. Vortex Methods: Theory and Practice, Vol. 8, Cambridge University Press, Cambridge (2000)
RAISSI, M., PERDIKARIS, P., and KARNIADAKIS, G. E. Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational Physics, 378, 686–707 (2019)
KARNIADAKIS, G. E., KEVREKIDIS, I. G., LU, L., PERDIKARIS, P., WANG, S., and YANG, L. Physics-informed machine learning. Nature Reviews Physics, 3, 422–440 (2021)
OWHADI, H. Bayesian numerical homogenization. Multiscale Modeling & Simulation, 13, 812–828 (2015)
OWHADI, H. and ZHANG, L. Gamblets for opening the complexity-bottleneck of implicit schemes for hyperbolic and parabolic ODEs/PDEs with rough coefficients. Journal of Computational Physics, 347, 99–128 (2017)
OWHADI, H. Multigrid with rough coefficients and multiresolution operator decomposition from hierarchical information games. SIAM Review, 59, 99–149 (2017)
SCHÄFER, F., KATZFUSS, M., and OWHADI, H. Sparse cholesky factorization by Kullback-Leibler minimization. SIAM Journal on Scientific Computing, 43, A2019–A2046 (2021)
SCHÄFER, F., SULLIVAN, T. J., and OWHADI, H. Compression, inversion, and approximate pca of dense kernel matrices at near-linear computational complexity. Multiscale Modeling & Simulation, 19, 688–730 (2021)
YOO, G. R. and OWHADI, H. De-noising by thresholding operator adapted wavelets. Statistics and Computing, 29, 1185–1201 (2019)
CHEN, Y., HOSSEINI, B., OWHADI, H., and STUART, A. M. Solving and learning nonlinear PDEs with Gaussian processes. Journal of Computational Physics, 447, 110668 (2021)
OWHADI, H. Computational graph completion. Research in the Mathematical Sciences, 9, 1–33 (2022)
BABUŠKA, I. and OSBORN, J. E. Can a finite element method perform arbitrarily badly? Mathematics of Computation, 69, 443–462 (2000)
OWHADI, H. Do ideas have shape? Idea registration as the continuous limit of artificial neural networks. arXiv Preprint, arXiv:2008.03920 (2020) https://doi.org/10.48550/arXiv.2008.03920
ALVAREZ, M. A., ROSASCO, L., and LAWRENCE, N. D. Kernels for vector-valued functions: a review. Foundations and Trends in Machine Learning, 4, 195–266 (2011)
SUN, H. W. and ZHOU, D. X. Reproducing kernel hilbert spaces associated with analytic translation-invariant mercer kernels. Journal of Fourier Analysis and Applications, 14, 89–101 (2008)
KOLMOGOROV, A. N. The local structure of turbulence in incompressible viscous fluid for very large Reynolds numbers. Doklady Akademii Nauk SSSR, 30, 301–305 (1941)
FRISCH, U. Turbulence: the legacy of A. N. Kolmogorov. Physics Today, 49, 82 (1996)
LINDBORG, E. Can the atmospheric kinetic energy spectrum be explained by two-dimensional turbulence? Journal of Fluid Mechanics, 388, 259–288 (1999)
BOFFETTA, G. and ECKE, R. E. Two-dimensional turbulence. Annual Review of Fluid Mechanics, 44, 427–451 (2012)
SOMMERIA, J. Experimental study of the two-dimensional inverse energy cascade in a square box. Journal of Fluid Mechanics, 170, 139–168 (1986)
WENDLAND, H. Scattered data approximation. Cambridge Monographs on Applied and Computational Mathematics, Vol. 17, Cambridge University Press, Cambridge (2005)
ZADRZYNSKA, E. and ZAJCZKOWSKI, W. M. Stability of two-dimensional Navier-Stokes motions in the periodic case. Journal of Mathematical Analysis and Applications, 423, 956–974 (2015)
LADYZHENSKAYA, O. A. Sixth problem of the millennium: Navier-Stokes equations, existence and smoothness. Russian Mathematical Surveys, 58, 251 (2003)
MARSDEN, J. E. and SHKOLLER, S. The anisotropic Lagrangian averaged Euler and Navier-Stokes equations. Archive for Rational Mechanics and Analysis, 166, 27–46 (2003)
OWHADI, H. and YOO, G. R. Kernel flows: from learning kernels from data into the ABYSS. Journal of Computational Physics, 389, 22–47 (2019)
CHEN, Y., OWHADI, H., and STUART, A. Consistency of empirical bayes and kernel flow for hierarchical parameter estimation. Mathematics of Computation, 90, 2527–2578 (2021)
HAMZI, B. and OWHADI, H. Learning dynamical systems from data: a simple cross-validation perspective, part i: parametric kernel flows. Physica D: Nonlinear Phenomena, 421, 132817 (2021)
HAMZI, B., MAULIK, R., and OWHADI, H. Simple, low-cost and accurate data-driven geophysical forecasting with learned kernels. Proceedings of the Royal Society A, 477, 20210326 (2021)
DARCY, M., HAMZI, B., SUSILUOTO, J., BRAVERMAN, A., and OWHADI, H. Learning dynamical systems from data: a simple cross-validation perspective, part ii: nonparametric kernel flows. preprint (2021) https://doi.org/10.13140/RG.2.2.16391.32164
LEE, J., DE BROUWER, E., HAMZI, B., and OWHADI, H. Learning dynamical systems from data: a simple cross-validation perspective, part iii: irregularly-sampled time series. arXiv Preprint, arXiv:2111.13037 (2021) https://doi.org/10.48550/arXiv.2111.13037
DARCY, M. D., HAMZI, B., LIVIERI, G., OWHADI, H., and TAVALLALI, P. One-shot learning of stochastic differential equations with data adapted kernels. Physica D: Nonlinear Phenomena, 444, 133583 (2023)
PRASANTH, S., HADDAD, Z., SUSILUOTO, J., BRAVERMAN, A., OWHADI, H., HAMZI, B., HRISTOVA-VELEVA, S., and TURK, J. Kernel flows to infer the structure of convective storms from satellite passive microwave observations. 2021 AGU Fall Meeting Abstracts, AGU, San Francisco, A55F-1445 (2021)
SUSILUOTO, J., BRAVERMAN, A., BRODRICK, P., HAMZI, B., JOHNSON, M., LAMMIN-PAA, O., OWHADI, H., SCOVEL, C., TEIXEIRA, J., and TURMON, M. Radiative transfer emulation for hyperspectral imaging retrievals with advanced kernel flows-based Gaussian process emulation. 2021 AGU Fall Meeting Abstracts, AGU, San Francisco, NG25A-0506 (2021)
AKIAN, J. L., BONNET, L., OWHADI, H., and SAVIN, E. Learning “best” kernels from data in Gaussian process regression with application to aerodynamics. Journal of Computational Physics, 470, 111595 (2022)
RAISSI, M., YAZDANI, A., and KARNIADAKIS, G. E. Hidden fluid mechanics: learning velocity and pressure fields from flow visualizations. Science, 367, 1026–1030 (2020)
Acknowledgements
This project was supported by the Air Force Office of Scientific Research under the MURI award number FA9550-20-1-0358 (Machine Learning and Physics-Based Modeling and Simulation) and by the Department of Energy under the award number DE-SC0023163 (SEA-CROGS: Scalable, Efficient, and Accelerated Causal Reasoning Operators, Graphs and Spikes for Earth and Embedded Systems). The author would also like to thank two anonymous referees for their comments and suggestions.
Author information
Authors and Affiliations
Corresponding author
Additional information
Citation: OWHADI, H. Gaussian process hydrodynamics. Applied Mathematics and Mechanics (English Edition), 44(7), 1175–1198 (2023) https://doi.org/10.1007/s10483-023-2990-9
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Owhadi, H. Gaussian process hydrodynamics. Appl. Math. Mech.-Engl. Ed. 44, 1175–1198 (2023). https://doi.org/10.1007/s10483-023-2990-9
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10483-023-2990-9