Abstract
Developing multiphysics finite element methods (FEM) and scalable HPC implementations can be very challenging in terms of software complexity and performance, even more so with the addition of goal-oriented adaptive mesh refinement. To manage the complexity we in this work present general adaptive stabilized methods with automated implementation in the FEniCS-HPC automated open source software framework. This allows taking the weak form of a partial differential equation (PDE) as input in near-mathematical notation and automatically generating the low-level implementation source code and auxiliary equations and quantities necessary for the adaptivity. We demonstrate new optimal strong scaling results for the whole adaptive framework applied to turbulent flow on massively parallel architectures down to 25000 vertices per core with ca. 5000 cores with the MPI-based PETSc backend and for assembly down to 500 vertices per core with ca. 20000 cores with the PGAS-based JANPACK backend. As a demonstration of the power of the combination of the scalability together with the adaptive methodology allowing prediction of gross quantities in turbulent flow we present an application in aerodynamics of a full DLR-F11 aircraft in connection with the HiLift-PW2 benchmarking workshop with good match to experiments.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bangerth, W., Hartmann, R., Kanschat, G.: deal.II — a general-purpose object-oriented finite element library. ACM Trans. Math. Softw. 33(4), 1–27 (2007)
FEniCS. FEniCS project (2003). http://www.fenicsproject.org
Hecht, F.: New development in freefem++. J. Numer. Math. 20, 251–266 (2012)
Hoffman, J., Jansson, J., Vilela de Abreu, R., Degirmenci, N.C., Jansson, N., Müller, K., Nazarov, M., Spühler, J.H.: Unicorn: parallel adaptive finite element simulation of turbulent flow and fluid-structure interaction for deforming domains and complex geometry. Comput. Fluids 80, 310–319 (2013)
Hoffman, J., Jansson, J., Jansson, N., Vilela De Abreu, R.: Towards a parameter-free method for high reynolds number turbulent flow simulation based on adaptive finite element approximation. Comput. Meth. Appl. Mech. Eng. 288, 60–74 (2015)
Hoffman, J., Jansson, J., Stöckli, M.: Unified continuum modeling of fluid-structure interaction. Math. Mod. Meth. Appl. S. 21, 491 (2011)
Hoffman, J., Johnson, C.: Computational Turbulent Incompressible Flow. Applied Mathematics: Body and Soul, vol. 4. Springer, Heidelberg (2007)
Jansson, N.: High Performance Adaptive Finite Element Methods: With Applications in Aerodynamics. Ph.D. thesis, KTH Royal Institute of Technology (2013)
Jansson, N.: Optimizing sparse matrix assembly in finite element solvers with one-sided communication. In: Daydé, M., Marques, O., Nakajima, K. (eds.) VECPAR 2012. LNCS, vol. 7851, pp. 128–139. Springer, Heidelberg (2013)
Jansson, N., Hoffman, J., Jansson, J.: Framework for massively parallel adaptive finite element computational fluid dynamics on tetrahedral meshes. SIAM J. Sci. Comput. 34(1), C24–C41 (2012)
Kirby, R.C., Logg, A.: A compiler for variational forms. ACM Trans. Math. Softw. 32(3), 417–444 (2006)
Kirby, R.C.: Algorithm 839: fiat, a new paradigm for computing finite element basis functions. ACM Trans. Math. Softw. (TOMS), 502–516 (2004)
Logg, A., Mardal, K.-A., Wells, G.N., et al. (eds.): Automated Solution of Differential Equations by the Finite Element Method. Lecture Notes in Computational Science and Engineering, vol. 84. Springer, Heidelberg (2012)
Oliker, L.: PLUM parallel load balancing for unstructured adaptive meshes. Technical report RIACS-TR-98-01, RIACS, NASA Ames Research Center (1998)
Rivara, M.C.: New longest-edge algorithms for the refinement and/or improvement of unstructured triangulations. Int. J. Numer. Meth. Eng. 40, 3313–3324 (1997)
Acknowledgments
This research has been supported by EU-FET grant EUNISON 308874, the European Research Council, the Swedish Foundation for Strategic Research, the Swedish Research Council, the Basque Excellence Research Center (BERC 2014-2017) program by the Basque Government, the Spanish Ministry of Economy and Competitiveness MINECO: BCAM Severo Ochoa accreditation SEV-2013-0323 and the Project of the Spanish MINECO: MTM2013-40824.
We acknowledge PRACE for awarding us access to the supercomputer resources Hermit, Hornet and SuperMUC based in Germany at The High Performance Computing Center Stuttgart (HLRS) and Leibniz Supercomputing Center (LRZ), from the Swedish National Infrastructure for Computing (SNIC) at PDC – Center for High-Performance Computing and on resources provided by the “Red Española de Supercomputación” and the “Barcelona Supercomputing Center - Centro Nacional de Supercomputación”.
We would also like to acknowledge the FEniCS and FEniCS-HPC developers globally.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Hoffman, J., Jansson, J., Jansson, N. (2016). FEniCS-HPC: Automated Predictive High-Performance Finite Element Computing with Applications in Aerodynamics. In: Wyrzykowski, R., Deelman, E., Dongarra, J., Karczewski, K., Kitowski, J., Wiatr, K. (eds) Parallel Processing and Applied Mathematics. PPAM 2015. Lecture Notes in Computer Science(), vol 9573. Springer, Cham. https://doi.org/10.1007/978-3-319-32149-3_34
Download citation
DOI: https://doi.org/10.1007/978-3-319-32149-3_34
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-32148-6
Online ISBN: 978-3-319-32149-3
eBook Packages: Computer ScienceComputer Science (R0)