Abstract
Although deep learning has been successfully applied in a variety of science and engineering problems owing to its strong high-dimensional nonlinear mapping capability, it is of limited use in scientific knowledge discovery. In this work, we propose a deep learning based framework to discover the macroscopic governing equation of an important geophysical process, i.e., viscous gravity current, based on high-resolution microscopic simulation data without the need for prior knowledge of underlying terms. For two typical scenarios with different viscosity ratios, the deep learning based equations exactly capture the same dominant terms as the theoretically derived equations for describing long-term asymptotic behaviors, which validates the proposed framework. Unknown macroscopic equations are then obtained for describing short-term behaviors, and additional deep-learned compensation terms are eventually discovered. Comparison of posterior tests shows that the deep learning based PDEs actually perform better than the theoretically derived PDEs in predicting evolving viscous gravity currents for both long-term and short-term regimes. Moreover, the proposed framework is proven to be very robust against non-biased data noise for training, which is up to 20%. Consequently, the presented deep learning framework shows considerable potential for discovering unrevealed intrinsic laws in scientific semantic space from raw experimental or simulation results in data space.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
Data Availability
The data supporting the findings of this study are available from the corresponding author upon reasonable request.
Code availability
The codes used to generate and analyze data are available through Zenodo (https://doi.org/10.5281/zenodo.4587614).
References
Baldi, P., Sadowski, P., Whiteson, D.: Searching for exotic particles in high-energy physics with deep learning. Nat. Commun. 5, 1–9 (2014). https://doi.org/10.1038/ncomms5308
Raissi, M., Yazdani, A., Karniadakis, G.E.: Hidden Fluid Mechanics: Learning velocity and pressure fields from flow visualizations. Science 4741, 1–8 (2020). https://doi.org/10.1126/science.aaw4741
Kadow, C., Hall, D.M., Ulbrich, U.: Artificial intelligence reconstructs missing climate information. Nat. Geosci. 13, 408–413 (2020). https://doi.org/10.1038/s41561-020-0582-5
Reichstein, M., Camps-Valls, G., Stevens, B., Jung, M., Denzler, J., Carvalhais, N.: Prabhat: Deep learning and process understanding for data-driven Earth system science. Nature 566, 195–204 (2019). https://doi.org/10.1038/s41586-019-0912-1
Lecun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521, 436–444 (2015). https://doi.org/10.1038/nature14539
Roscher, R., Bohn, B., Duarte, M.F., Garcke, J.: Explainable Machine Learning for Scientific Insights and Discoveries. IEEE Access 8, 42200–42216 (2020). https://doi.org/10.1109/ACCESS.2020.2976199
Xu, H., Chang, H., Zhang, D.: DLGA-PDE: Discovery of PDEs with incomplete candidate library via combination of deep learning and genetic algorithm. J. Comput. Phys. 418, 109584 (2020). https://doi.org/10.1016/j.jcp.2020.109584
Raissi, M., Perdikaris, P., Karniadakis, G.E.: Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. J. Comput. Phys. 378, 686–707 (2019). https://doi.org/10.1016/j.jcp.2018.10.045
Berg, J., Nyström, K.: Data-driven discovery of PDEs in complex datasets. J. Comput. Phys. 384, 239–252 (2019). https://doi.org/10.1016/j.jcp.2019.01.036
Xu, H., Chang, H., Zhang, D.: DL-PDE: Deep learning based data-driven discovery of partial differential equations from discrete and noisy data. Phys. Fluids 33, 037132 (2021)
Brunton, S.L., Kutz, J.N.: Methods for data-driven multiscale model discovery for materials. J. Phys.: Mater. 2, 044002 (2019). https://doi.org/10.1088/2515-7639/ab291e
Kaiser, E., Nathan Kutz, J., Brunton, S.L.: Sparse identification of nonlinear dynamics for model predictive control in the low-data limit. Proc. R. Soc. A: Math. Phys. Eng. Sci. 474, 2219 (2018)
Quade, M., Abel, M., Nathan Kutz, J., Brunton, S.L.: Sparse identification of nonlinear dynamics for rapid model recovery. Chaos 28, 063116 (2018). https://doi.org/10.1063/1.5027470
Rudy, S.H., Brunton, S.L., Proctor, J.L.: Kutz: Data-driven discovery of partial differential equations. Sci. Adv. 3, e1602614 (2017)
Rudy, S., Alla, A., Brunton, S.L., Kutz, J.N.: Data-driven identification of parametric partial differential equations. SIAM J. Appl. Dyn. Syst. 18, 643–660 (2019). https://doi.org/10.1137/18M1191944
Zhang, S., Lin, G.: Robust data-driven discovery of governing physical laws with error bars. Proc. R. S. A: Math. Phys. Eng. Sci. 474, 20180305 (2018). https://doi.org/10.1098/rspa.2018.0305
Maslyaev, M., Hvatov, A., Kalyuzhnaya, A.: Data-driven PDE discovery with evolutionary approach (2019). Preprint at https://arxiv.org/abs/1903.08011
Xu, H., Zhang, D., Wang, N.: Deep learning based discovery of partial differential equations in integral form from sparse and noisy data. J. Comput. Phys. 445, 10592 (2020)
Gardner, G.H.F., Downie, J., Kendall, H.A.: Gravity segregation of miscible fluids in linear models. SPE J. 185, 95–104 (1964)
Davis, S.H., Hocking, L.M.: Spreading and imbibition of viscous liquid on a porous base. II. Physics of Fluids 12, 1646–1655 (2000). https://doi.org/10.1063/1.870416
Pritchard, D., Woods, A.W., Hogg, A.J.: On the slow draining of a gravity current moving through a layered permeable medium. J. Fluid Mech. 444, 23–47 (2001). https://doi.org/10.1017/S002211200100516X
Lake, L.: Enhanced oil recovery. Prentice Hall, Hoboken (1988)
Werner, A.D.: On the classification of seawater intrusion. J. Hydrol. 551, 619–631 (2017). https://doi.org/10.1016/j.jhydrol.2016.12.012
Werner, A.D., Bakker, M., Post, V.E.A., Vandenbohede, A., Lu, C., Ataie-Ashtiani, B., Simmons, C.T., Barry, D.A.: Seawater intrusion processes, investigation and management: Recent advances and future challenges. Adv. Water Resour. 51, 3–26 (2013). https://doi.org/10.1016/j.advwatres.2012.03.004
Woods, A.W.: Liquid and vapor flow in superheated rock. Annu. Rev. Fluid Mech. 31, 171–199 (1999). https://doi.org/10.1146/annurev.fluid.31.1.171
Bear, J.: Dynamics of fluids in Porous media. Dover Publications, New York (1972)
Pritchard, D., Hogg, A.J.: Draining viscous gravity currents in a vertical fracture. J. Fluid Mech. 459, 207–216 (2002). https://doi.org/10.1017/S0022112002008327
Woods, A.W., Mason, R.: The dynamics of two-layer gravity-driven flows in permeable rock. J. Fluid Mech. 421, 83–114 (2000). https://doi.org/10.1017/S0022112000001567
Di Federico, V., Longo, S., King, S.E., Chiapponi, L., Petrolo, D., Ciriello, V.: Gravity-driven flow of Herschel-Bulkley fluid in a fracture and in a 2D porous medium. J. Fluid Mech. 821, 59–84 (2017). https://doi.org/10.1017/jfm.2017.234
Chiapponi, L., Petrolo, D., Lenci, A., di Federico, V., Longo, S.: Dispersion induced by non-Newtonian gravity flow in a layered fracture or formation. J. Fluid Mech. 903, A14 (2020). https://doi.org/10.1017/jfm.2020.624
Longo, S., di Federico, V., Chiapponi, L.: A dipole solution for power-law gravity currents in porous formations. J. Fluid Mech. 778, 534–551 (2015). https://doi.org/10.1017/jfm.2015.405
Zheng, Z., Christov, I.C., Stone, H.A.: Influence of heterogeneity on second-kind self-similar solutions for viscous gravity currents. J. Fluid Mech. 747, 218–246 (2014). https://doi.org/10.1017/jfm.2014.148
Anderson, J.D.: Computational fluid dynamics: the basics with applications. McGraw-Hill, New York (1995)
Olsson, E., Kreiss, G.: A conservative level set method for two phase flow. J. Comput. Phys. 210, 225–246 (2005). https://doi.org/10.1016/j.jcp.2005.04.007
Notay, Y.: An aggregation-based algebraic multigrid method. Electron. Trans. Numer. Anal. 37, 123–146 (2010)
Gottlieb, S., Shu, C.-W.: Total variation diminishing Runge-Kutta schemes. Math. Comput. Am. Math. Soc. 67, 73–85 (1998). https://doi.org/10.1090/s0025-5718-98-00913-2
Roostaei, M., Nouri, A., Fattahpour, V., Chan, D.: Numerical simulation of proppant transport in hydraulic fractures. J. Petrol. Sci. Eng. 163, 119–138 (2018). https://doi.org/10.1016/j.petrol.2017.11.044
Jiang, G.S., Shu, C.W.: Efficient implementation of weighted ENO schemes. J. Comput. Phys. 126, 202–228 (1996)
Raissi, M., Perdikaris, P., Karniadakis, G.E.: Machine learning of linear differential equations using Gaussian processes. J. Comput. Phys. 348, 683–693 (2017). https://doi.org/10.1016/j.jcp.2017.07.050
Chang, H., Zhang, D.: Machine learning subsurface flow equations from data. Comput. Geosci. 23, 895–910 (2019). https://doi.org/10.1007/s10596-019-09847-2
Xu, H., Zhang, D.: Robust discovery of partial differential equations in complex situations. Phys. Rev. Res. 3, 033270 (2021). https://doi.org/10.1103/PhysRevResearch.3.033270
Acknowledgements
This work was supported and partially funded by the National Natural Science Foundation of China (Grant No. 52288101) and the National Center for Applied Mathematics Shenzhen (NCAMS).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflicts of interest to report regarding the publication of this paper.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Key points
• Macroscopic governing equation of viscous gravity current is discovered on the basis of high-resolution microscopic simulation data without the need of specifying the potential terms.
• Deep learning framework captures the dominant terms which agree with theoretically derived equations.
• Compensation PDE terms and modifying coefficients are discovered for interpreting the deviation between theoretical predictions and simulation results.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Zeng, J., Xu, H., Chen, Y. et al. Deep learning discovery of macroscopic governing equations for viscous gravity currents from microscopic simulation data. Comput Geosci 27, 987–1000 (2023). https://doi.org/10.1007/s10596-023-10244-z
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10596-023-10244-z