Fast and robust flow simulations in discrete fracture networks with GPGPUs

  • S. BerroneEmail author
  • A. D’Auria
  • F. Vicini
Original Paper
Part of the following topical collections:
  1. Numerical methods for processes in fractured porous media


A new approach for flow simulation in very complex discrete fracture networks based on PDE-constrained optimization has been recently proposed in Berrone et al. (SIAM J Sci Comput 35(2):B487–B510, 2013b; J Comput Phys 256:838–853, 2014) with the aim of improving robustness with respect to geometrical complexities. This is an essential issue, in particular for applications requiring simulations on geometries automatically generated like the ones used for uncertainty quantification analyses and hydro-mechanical simulations. In this paper, implementation of this approach in order to exploit Nvidia Compute Unified Device Architecture is discussed with the main focus to speed up the linear algebra operations required by the approach, being this task the most computational demanding part of the approach. Furthermore, two different approaches for linear algebra operations and two storage formats for sparse matrices are compared in terms of computational efficiency and memory constraints.


Discrete fracture network flow simulations Simulations in complex geometries GPGPU CUDA 

Mathematics Subject Classification

65N30 68U20 68W10 68W40 86-08 86A05 



  1. Ahmed, R., Edwards, M.G., Lamine, S., Huisman, B.A., Pal, M.: CVD-MPFA full pressure support, coupled unstructured discrete fracture–matrix Darcy-flux approximations. J. Comput. Phys. 349, 265–299 (2017)MathSciNetzbMATHGoogle Scholar
  2. Al-Hinai, O., Singh, G., Pencheva, G., Almani, T., Wheeler, M.F., et al.: Modeling multiphase flow with nonplanar fractures. In: SPE Reservoir Simulation Symposium. Society of Petroleum Engineers (2013)Google Scholar
  3. Al-Hinai, O., Wheeler, M.F., Yotov, I.: A generalized mimetic finite difference method and two-point flux schemes over Voronoi diagrams. ESAIM Math. Model. Numer. Anal. 51(2), 679–706 (2017)MathSciNetzbMATHGoogle Scholar
  4. Antonietti, P., Formaggia, L., Scotti, A., Verani, M., Verzott, N.: Mimetic finite difference approximation of flows in fractured porous media. ESAIM Math. Model. Numer. Anal. 50(3), 809–832 (2016)MathSciNetzbMATHGoogle Scholar
  5. Beirão da Veiga, L., Brezzi, F., Cangiani, A., Manzini, G., Marini, L.D., Russo, A.: Basic principles of virtual element methods. Math. Models Methods Appl. Sci. 23(01), 199–214 (2013)MathSciNetzbMATHGoogle Scholar
  6. Beirão da Veiga, L., Lipnikov, K., Manzini, G.: The Mimetic Finite Difference Method for Elliptic Problems, vol. 11. Springer, Berlin (2014)zbMATHGoogle Scholar
  7. Benedetto, M.F., Berrone, S., Pieraccini, S., Scialò, S.: The virtual element method for discrete fracture network simulations. Comput. Methods Appl. Mech. Eng. 280, 135–156 (2014)MathSciNetzbMATHGoogle Scholar
  8. Benedetto, M.F., Berrone, S., Borio, A., Pieraccini, S., Scialò, S.: A hybrid mortar virtual element method for discrete fracture network simulations. J. Comput. Phys. 306, 148–166 (2016)MathSciNetzbMATHGoogle Scholar
  9. Benedetto, M.F., Borio, A., Scialò, S.: Mixed virtual elements for discrete fracture network simulations. Finite Elem. Anal. Des. 134, 55–67 (2017)MathSciNetGoogle Scholar
  10. Berrone, S., Borio, A.: Orthogonal polynomials in badly shaped polygonal elements for the virtual element method. Finite Elem. Anal. Des. 129, 14–31 (2017)MathSciNetGoogle Scholar
  11. Berrone, S., Pieraccini, S., Scialò, S.: On simulations of discrete fracture network flows with an optimization-based extended finite element method. SIAM J. Sci. Comput. 35(2), A908–A935 (2013a)MathSciNetzbMATHGoogle Scholar
  12. Berrone, S., Pieraccini, S., Scialò, S.: A PDE-constrained optimization formulation for discrete fracture network flows. SIAM J. Sci. Comput. 35(2), B487–B510 (2013b)MathSciNetzbMATHGoogle Scholar
  13. Berrone, S., Pieraccini, S., Scialò, S.: An optimization approach for large scale simulations of discrete fracture network flows. J. Comput. Phys. 256, 838–853 (2014)MathSciNetzbMATHGoogle Scholar
  14. Berrone, S., Pieraccini, S., Scialò, S., Vicini, F.: A parallel solver for large scale DFN flow simulations. SIAM J. Sci. Comput. 37(3), C285–C306 (2015)MathSciNetzbMATHGoogle Scholar
  15. Berrone, S., Borio, A., Scialò, S.: A posteriori error estimate for a PDE-constrained optimization formulation for the flow in DFNs. SIAM J. Numer. Anal. 54(1), 242–261 (2016a)MathSciNetzbMATHGoogle Scholar
  16. Berrone, S., Pieraccini, S., Scialò, S.: Towards effective flow simulations in realistic discrete fracture networks. J. Comput. Phys. 310, 181–201 (2016b)MathSciNetzbMATHGoogle Scholar
  17. Berrone, S., Pieraccini, S., Scialò, S.: Flow simulations in porous media with immersed intersecting fractures. J. Comput. Phys. 345, 768–791 (2017a)MathSciNetzbMATHGoogle Scholar
  18. Berrone, S., Pieraccini, S., Scialò, S.: Non-stationary transport phenomena in networks of fractures: effective simulations and stochastic analysis. Comput. Methods Appl. Mech. Eng. 315, 1098–1112 (2017b)MathSciNetGoogle Scholar
  19. Berrone, S., Canuto, C., Pieraccini, S., Scialò, S.: Uncertainty quantification in discrete fracture network models: stochastic geometry. Water Resour. Res. 54, 1338–1352 (2018)Google Scholar
  20. Brenner, K., Hennicker, J., Masson, R., Samier, P.: Gradient discretization of hybrid-dimensional Darcy flow in fractured porous media with discontinuous pressures at matrix–fracture interfaces. IMA J. Numer. Anal. 37(3), 1551–1585 (2017)MathSciNetzbMATHGoogle Scholar
  21. Cacas, M.C., Ledoux, E., de Marsily, G., Tillie, B., Barbreau, A., Durand, E., Feuga, B., Peaudecerf, P.: Modeling fracture flow with a stochastic discrete fracture network: calibration and validation: 1. The flow model. Water Resour. Res. 26, 479–489 (1990)Google Scholar
  22. Chave, F., Di Pietro, D.A., Formaggia, L.: A hybrid high-order method for Darcy flows in fractured porous media. SIAM J. Sci. Comput. 40(2), A1063–A1094 (2018)MathSciNetzbMATHGoogle Scholar
  23. de Dreuzy, J.R., Davy, P., Bour, O.: Hydraulic properties of two-dimensional random fracture networks following a power law length distribution: 2. Permeability of networks based on log-normal distribution of apertures. Water Resour. Res. 37(8), 2079–2095 (2001)Google Scholar
  24. de Dreuzy, J.R., Pichot, G., Poirriez, B., Erhel, J.: Synthetic benchmark for modeling flow in 3D fractured media. Comput. Geosci. 50, 59–71 (2013)Google Scholar
  25. Dershowitz, W.S., Einstein, H.H.: Characterizing rock joint geometry with joint system models. Rock Mech. Rock Eng. 1, 21–51 (1988)Google Scholar
  26. Dershowitz, W.S., Fidelibus, C.: Derivation of equivalent pipe networks analogues for three-dimensional discrete fracture networks by the boundary element method. Water Resour. Res. 35, 2685–2691 (1999)Google Scholar
  27. Fidelibus, C.: The 2D hydro-mechanically coupled response of a rock mass with fractures via a mixed BEM–FEM technique. Int. J. Numer. Anal. Methods Geomech. 31(11), 1329–1348 (2007)zbMATHGoogle Scholar
  28. Fidelibus, C., Cammarata, G., Cravero, M.: Hydraulic characterization of fractured rocks. In: Abbie, M., Bedford, J.S. (eds.) Rock Mechanics: New Research. Nova Science Publishers Inc., New York (2009)Google Scholar
  29. Flemisch, B., Berre, I., Boon, W., Fumagalli, A., Schwenck, N., Scotti, A., Stefansson, I., Tatomir, A.: Benchmarks for single-phase flow in fractured porous media. Adv. Water Resour. 111, 239–258 (2018)Google Scholar
  30. Franc, J., Jeannin, L., Debenest, G., Masson, R.: FV-MHMM method for reservoir modeling. Comput. Geosci. 21(5), 895–908 (2017)MathSciNetzbMATHGoogle Scholar
  31. Fumagalli, A., Keilegavlen, E.: Dual virtual element method for discrete fractures networks. SIAM J. Sci. Comput. 40(1), B228–B258 (2018)MathSciNetzbMATHGoogle Scholar
  32. Fumagalli, A., Keilegavlen, E., Scialò, S.: Conforming, non-conforming and non-matching discretization couplings in discrete fracture network simulations. (2018)MathSciNetzbMATHGoogle Scholar
  33. Fumagalli, A., Scotti, A.: An efficient XFEM approximation of Darcy flows in arbitrarily fractured porous media. Oil Gas Sci. Technol. Rev. dIFP Energ. Nouv. 69(4), 555–564 (2014)Google Scholar
  34. Garipov, T.T., Karimi-Fard, M., Tchelepi, H.A.: Discrete fracture model for coupled flow and geomechanics. Comput. Geosci. 20(1), 149–160 (2016)MathSciNetzbMATHGoogle Scholar
  35. Guennebaud, G., Jacob, B., et al.: Eigen v3 documentation. (2010). Accessed 10 Oct 2018
  36. Hadgu, T., Karra, S., Kalinina, E., Makedonska, N., Hyman, J.D., Klise, K., Viswanathan, H.S., Wang, Y.: A comparative study of discrete fracture network and equivalent continuum models for simulating flow and transport in the far field of a hypothetical nuclear waste repository in crystalline host rock. J. Hydrol. 553, 59–70 (2017)Google Scholar
  37. Hyman, J.D., Gable, C.W., Painter, S.L., Makedonska, N.: Conforming Delaunay triangulation of stochastically generated three dimensional discrete fracture networks: a feature rejection algorithm for meshing strategy. SIAM J. Sci. Comput. 36(4), A1871–A1894 (2014)MathSciNetzbMATHGoogle Scholar
  38. Jaffré, J., Roberts, J.E.: Modeling flow in porous media with fractures; discrete fracture models with matrix–fracture exchange. Numer. Anal. Appl. 5(2), 162–167 (2012)zbMATHGoogle Scholar
  39. Lenti, V., Fidelibus, C.: A BEM solution of steady-state flow problems in discrete fracture networks with minimization of core storage. Comput. Geosci. 29(9), 1183–1190 (2003)Google Scholar
  40. Manzoor, S., Edwards, M.G., Dogru, A.H., Al-Shaalan, T.M.: Interior boundary-aligned unstructured grid generation and cell-centered versus vertex-centered CVD-MPFA performance. Comput. Geosci. 22(1), 195–230 (2018)MathSciNetzbMATHGoogle Scholar
  41. Merrill, D., Garland, M.: Merge-based parallel sparse matrix–vector multiplication. In: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, SC’16, pp. 58:1–58:12. IEEE Press, Piscataway (2016)Google Scholar
  42. Mustapha, H., Mustapha, K.: A new approach to simulating flow in discrete fracture networks with an optimized mesh. SIAM J. Sci. Comput. 29(4), 1439–1459 (2007)MathSciNetzbMATHGoogle Scholar
  43. Ngo, T.D., Fourno, A., Noetinger, B.: Modeling of transport processes through large-scale discrete fracture networks using conforming meshes and open-source software. J. Hydrol. 554, 66–79 (2017)Google Scholar
  44. Noetinger, B.: A quasi steady state method for solving transient Darcy flow in complex 3D fractured networks accounting for matrix to fracture flow. J. Comput. Phys. 283, 205–223 (2015)MathSciNetzbMATHGoogle Scholar
  45. Noetinger, B., Jarrige, N.: A quasi steady state method for solving transient Darcy flow in complex 3D fractured networks. J. Comput. Phys. 231(1), 23–38 (2012)MathSciNetzbMATHGoogle Scholar
  46. Nvidia, C: Cublas documentation. (2008a). Accessed 10 Oct 2018
  47. Nvidia, C.: Cuda toolkit. (2008b). Accessed 10 Oct 2018
  48. Nvidia, C.: Cuda toolkit documentation. (2008c). Accessed 10 Oct 2018
  49. Nvidia, C.: Cusparse documentation. (2008d). Accessed 10 Oct 2018
  50. Parramore, E., Edwards, M.G., Pal, M., Lamine, S.: Multiscale finite-volume CVD-MPFA formulations on structured and unstructured grids. Multiscale Model. Simul. 14(2), 559–594 (2016)MathSciNetzbMATHGoogle Scholar
  51. Pichot, G., Erhel, J., de Dreuzy, J.R.: A mixed hybrid mortar method for solving flow in discrete fracture networks. Appl. Anal. 89(10), 1629–1643 (2010)MathSciNetzbMATHGoogle Scholar
  52. Pichot, G., Erhel, J., de Dreuzy, J.R.: A generalized mixed hybrid mortar method for solving flow in stochastic discrete fracture networks. SIAM J. Sci. Comput. 34(1), B86–B105 (2012)MathSciNetzbMATHGoogle Scholar
  53. Pichot, G., Poirriez, B., Erhel, J., de Dreuzy, J.R.: A mortar BDD method for solving flow in stochastic discrete fracture networks. In: Erhel, J., Gander, M., Halpern, L., Pichot, G., Sassi, T., Widlund, O. (eds.) Domain Decomposition Methods in Science and Engineering XXI, pp. 99–112. Springer, Cham (2014)zbMATHGoogle Scholar
  54. Sentís, M.L., Gable, C.W.: Coupling LaGrit unstructured mesh generation and model setup with TOUGH2 flow and transport: a case study. Comput. Geosci. 108, 42–49 (2017)Google Scholar
  55. Shewchuk, J.R.: Triangle: engineering a 2D quality mesh generator and Delaunay triangulator. In: Lin, M.C., Manocha, D. (eds.) Applied Computational Geometry: Towards Geometric Engineering. Lecture Notes in Computer Science, vol. 1148, pp. 203–222. Springer, Berlin (1996). (from the first ACM workshop on applied computational geometry)Google Scholar
  56. Shewchuk, J.R.: Delaunay refinement algorithms for triangular mesh generation. Comput. Geom. 22(1), 21–74 (2002). (16th ACM symposium on computational geometry)MathSciNetzbMATHGoogle Scholar
  57. Vohralík, M., Maryška, J., Severýn, O.: Mixed and nonconforming finite element methods on a system of polygons. Appl. Numer. Math. 51, 176–193 (2007)MathSciNetzbMATHGoogle Scholar
  58. Xing, F., Masson, R., Lopez, S.: Parallel vertex approximate gradient discretization of hybrid dimensional Darcy flow and transport in discrete fracture networks. Comput. Geosci. 21(4), 595–617 (2017)MathSciNetzbMATHGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Dipartimento di Scienze MatematichePolitecnico di TorinoTurinItaly

Personalised recommendations