Abstract
Current supercomputing platforms and scientific application codes have grown rapidly in complexity over the past years. Multi-scale, multi-domain simulations on one hand and deep hierarchies in large-scale computing platforms on the other make it exceedingly harder to map the former onto the latter and fully exploit the available computational power. The complexity of the software and hardware components involved calls for in-depth expertise that can only be met by diversity in the application development teams. With its model of simulation labs and cross-sectional groups, JARA-HPC enables such diverse teams to form on demand to solve concrete development problems. This work showcases the effectiveness of this model with two application case studies involving the JARA-HPC cross-sectional group “Parallel Efficiency” and simulation labs and domain-specific development teams. For one application, we show the results of a completed optimization and the estimated financial impact of the combined efforts. For the other application, we present results from an ongoing engagement, where we show how an on-demand team investigates the behavior of dynamic load balancing schemes for an MD particle simulation, leading to a better overall understanding of the application and revealing targets for further investigation.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Bischof, C., an Mey, D., Iwainsky, C.: Brainware for green HPC. Comput. Sci. Res. Dev. 27(4), 227–233 (2012). http://dx.doi.org/10.1007/s00450-011-0198-5
Canuto, C., Hussaini, M.Y., Quarteroni, A., Zang, T.A.: Spectral Methods. Springer, Heidelberg (2006)
Cappello, F., Wuebbles, D.: G8 ECS: Enabling climate simulation at extreme scale, 2012. In: G8 Exascale Projects Workshop, 12 November 2012
CoE Performance Optimisation and Productivity (2016). https://pop-coe.eu/
Freche, J., Frings, W., Sutmann, G.: High throughput parallel-I/O using SIONlib for mesoscopic particle dynamics simulations on massively parallel computers. In: Chapman, B., Desprez, F., Joubert, G.R., Lichnewsky, A., Peters, F.J., Priol, T. (eds.) Parallel Computing: From Multicores and GPU’s to Petascale. Advances in Parallel Computing, vol. 19, pp. 371–378. IOS Press, Amsterdam (2010)
German Science Foundation (DFG): Personalmittelsätze der DFG für das Jahr 2013 (2013)
Göbbert, J.H.: psOpen (2015). http://www.fz-juelich.de/ias/jsc/EN/Expertise/High-Q-Club/psOpen/_node.html. Accessed 4 July 2016
Goebbert, J.H., Gauding, M., Ansorge, C., Hentschel, B., Kuhlen, T., Pitsch, H.: Direct numerical simulation of fluid turbulence at extreme scale with psOpen. Adv. Parallel Comput. 27, 777–785 (2016)
Orszag, S.A.: Analytical theories of turbulence. J. Fluid Mech. 41(2), 363–386 (1970)
Pekurovsky, D.: P3DFFT: A framework for parallel computations of Fourier transforms in three dimensions. SIAM J. Sci. Comput. 34(4), C192–C209 (2012)
Sitt, R., Feith, A., Sternel, D.C.: Parallel code analysis in HPC user support. In: Knüpfer, A., Hilbrich, T., Niethammer, C., Gracia, J., Nagel, W.E., Resch, M.M. (eds.) Tools for High Performance Computing 2015, pp. 127–133. Springer, Cham (2016). http://dx.doi.org/10.1007/978-3-319-39589-0_10
Sutmann, G.: MP2C (2015). http://www.fz-juelich.de/ias/jsc/EN/Expertise/High-Q-Club/MP2C/_node.html. Accessed 4 July 2016
Sutmann, G.: Simulation lab Molecular Systems (2015). http://www.fz-juelich.de/ias/jsc/EN/AboutUs/Organisation/ComputationalScience/Simlabs/slms/_node.html. Accessed 4 July 2016
Sutmann, G., Westphal, L., Bolten, M.: Particle based simulations of complex systems with MP2C: Hydrodynamics and electrostatics. AIP Conf. Proc. 1281(1), 1768–1772 (2010). http://scitation.aip.org/content/aip/proceeding/aipcp/10.1063/1.3498216
Washington, W.M., Drake, J., Buja, L., Anderson, D., Bader, D.C., Dickinson, R., Erickson, D., Gent, P., Ghan, S., Jones, P., Jacob, R.L.: The use of the Climate-Science Computational End Station (CCES) development and grand challenge team for the next IPCC assessment: An operational plan, December 2007
Wienke, S., an Mey, D., Müller, M.S.: Accelerators for technical computing: is it worth the pain? A TCO perspective. In: Kunkel, J.M., Ludwig, T., Meuer, H.W. (eds.) ISC 2013. LNCS, vol. 7905, pp. 330–342. Springer, Heidelberg (2013). doi:10.1007/978-3-642-38750-0_25
Acknowledgments
This work has been partly funded by the Excellence Initiative of the German federal and state governments. The authors gratefully acknowledge the computing time granted by the JARA-HPC Vergabegremium and provided on the two JARA-HPC Partition systems—the supercomputer JUQUEEN at Forschungszentrum Jülich and the RWTH Compute Cluster at RWTH Aachen University.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Iliev, H. et al. (2017). Performance Optimization of Parallel Applications in Diverse On-Demand Development Teams. In: Di Napoli, E., Hermanns, MA., Iliev, H., Lintermann, A., Peyser, A. (eds) High-Performance Scientific Computing. JHPCS 2016. Lecture Notes in Computer Science(), vol 10164. Springer, Cham. https://doi.org/10.1007/978-3-319-53862-4_16
Download citation
DOI: https://doi.org/10.1007/978-3-319-53862-4_16
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-53861-7
Online ISBN: 978-3-319-53862-4
eBook Packages: Computer ScienceComputer Science (R0)