Abstract
ppOpen-HPC and pK-Open-HPC are open source infrastructures for development and execution of large-scale scientific applications on post-petascale (pp) supercomputers with automatic tuning (AT). Both of ppOpen-HPC and pK-Open-HPC focus on parallel computers based on many-core architectures and consist of various types of libraries covering general procedures for scientific computations. The source code, developed on a PC with a single processor, is linked with these libraries, and the parallel code generated is optimized for post-petascale systems. In this article, recent achievements and progress of the ppOpen-HPC and pK-Open-HPC project are summarized.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
ppOpen-HPC.: http://ppopenhpc.cc.u-tokyo.ac.jp/. Accessed 23 Mar 2018
Nakajima, K., Satoh, M., Furumura, T., Okuda, H., Iwashita, T., Sakaguchi, H., Katagiri, T., Matsumoto, M., Ohshima, M., Jitsumoto, H., Arakawa, T., Mori, F., Kitayama, T., Ida, A., Matsuo, M.Y.: ppOpen-HPC: open source infrastructure for development and execution of large-scale scientific applications on post-peta-scale supercomputers with automatic tuning (AT). In: Optimization in the Real World -Towards Solving Real-Worlds Optimization Problems, Mathematics for Industry, vol. 13, pp. 15–35. Springer, Beijing (2015)
Joint Center for Advanced High Performance Computing (JCAHPC): http://jcahpc.jp/. Accessed 23 Mar 2018
Post-Peta CREST.: http://postpeta.jst.go.jp/en/. Accessed 23 Mar 2018
ESSEX.: http://blogs.fau.de/essex/. Accessed 23 Mar 23 2018
SPPEXA.: http://www.sppexa.de/. Accessed 23 Mar 23 2018
Dezeeuw, D., Powell, K.G.: An adaptively refined Cartesian mesh solver for the Euler equations. J. Comput. Phys. 104, 56–68 (1993)
Matsumoto, M., Mori, F., Ohshima, S., Jitsumoto, H., Katagiri, T., Nakajima, K.: Implementation and evaluation of an AMR framework for FDM applications. Proc. Comput. Sci. 29, 936–946 (2014)
Usui, H., Nagara, A., Nunami, M., Matsumoto, M.: Development of a computational framework for block-based AMR simulations. Proc. Comput. Sci. 29, 2351–2359 (2014)
Miyashita, M., Matsumoto, M., Kubota, K.: The development of adaptive mesh refinement technique for hybrid kinetic/fluid plasma simulation. In: Proceedings of 2015 International Conference on Numerical Simulation of Plasmas (ICNSP2015) (2015)
Usui, H., Kito, S., Nunami, M., Matsumoto, M.: Application of block-structured adaptive mesh refinement to particle simulation. Proc. Comput. Sci. 108, 2527–2536 (2017)
Sakurai, T., Sugiura, H.: A projection method for generalized eigenvalue problems using numerical integration. J. Comput. Appl. Math. 159(1), 119–128 (2003)
Galgon, M., Lukas, K., Lang, B.: The FEAST algorithm for large eigenvalue problems. Proc. Parallel Appl. Math. Mech. (PAMM). 11(1), 747–748 (2011)
Kawai, M., Ida, A., Nakajima, K.: Modified IC Preconditioner of CG method for ill-conditioned problems. IPSJ SIG, Technical Report 2017-HPC-158-9 (2017.) (in Japanese)
Kawai, M., Ida, A., Nakajima, K.: Hierarchical parallelization of multi-coloring algorithms for block IC, preconditioners. In: IEEE 19th International Conference on High Performance Computing and Communications (HPCC), pp. 138–145 (2017)
Saad, Y.: Iterative Methods for Sparse Linear Systems, 2nd edn. SIAM, Philadelphia (2003)
Iwashita, T., Shimasaki, M.: Algebraic multicolor ordering for parallelized ICCG solver in finite-element analyses. IEEE Trans. Magn. 38(2), 429–432 (2002)
Davis, T.A., Hu, Y.: The University of Florida sparse matrix collection. ACM Trans. Math. Softw. (TOMS). 38(1), 1–25 (2011)
Katagiri, T., Ohshima, S., Matsumoto, M.: Directive-based auto-tuning for the finite difference method on the Xeon Phi. In: IEEE Proceedings of IPDPSW2015, pp. 1221–1230 (2015)
Katagiri, T., Ohshima, S., Matsumoto, M.: Auto-tuning on NUMA and many-core environments with an FDM code. In: IEEE Proceedings of IPDPSW2017, pp. 1399–1407 (2017)
Washington, W.M., Buja, L., Craig, A.: The computational future for climate and earth sys-tem models: on the path to petaflop and beyond. Phil. Trans. R. Soc. A. 367, 833–846 (2009)
Satoh, M., Tomita, H., Yashiro, H., Miura, H., Kodama, C., Seiki, T., Noda, A., Yamada, Y., Goto, D., Sawada, M., Miyoshi, T., Niwa, Y., Hara, M., Ohno, T., Iga, S., Arakawa, T., Inoue, T., Kubokawa, H.: The non-hydrostatic icosahedral atmospheric model: description and development. Prog Earth Planet Sci. 1, (2014). https://doi.org/10.1186/s40645-014-0018-1
Hasumi, H.: CCSR Ocean Component Model (COCO) Version 4.0. http://ccsr.aori.utokyo.ac.jp/hasumi/COCO/coco4.pdf. Accessed 23 Mar 2018
Jones, P.H.: First and second order conservative remapping schemes for grids in spherical coordinates. Mon. Weather Rev. 127, 2204–2210 (1999)
Miyakawa, T., Yashiro, H., Suzuki, T., Tatebe, H., Satoh, M.: A Madden-Julian oscillation-event remotely accelerates ocean upwelling to abruptly terminate the 1997/1998 super El Nino. Geophys. Res. Lett. 44, 9489 (2017). https://doi.org/10.1002/2017GL074683
Iwashita, T., Ida, A., Mifune, T., Takahashi, Y.: Software framework for parallel BEM analyses with H-matrices using MPI and OpenMP. Proc. Comput. Sci. 108C, 2200–2209 (2017)
Ida, A., Iwashita, T., Mifune, T., Takahashi, Y.: Parallel hierarchical matrices with adaptive cross approximation on symmetric multiprocessing clusters. J. Inf. Process. 22(4), 642–650 (2014)
Ida, A., Nakashima, H., Kawai, M.: Parallel hierarchical matrices with block low-rank representation on distributed memory computer systems. In: ACM Proceedings of the International Conference on High Performance Computing in Asia-Pacific Region (HPC Asia 2018), pp. 232–240 (2018)
Ida, A.: Lattice H-matrices on distributed-memory systems. In: Proceedings of IEEE International Parallel and Distributed Processing Symposium (IPDPS) (2018). in press
Acknowledgments
This work is supported by Core Research for Evolutional Science and Technology (CREST), the Japan Science and Technology Agency (JST), Japan, and the German Priority Programme 1648 Software for Exascale Computing (SPPEXA-II). Authors would like to thank Professor Gerhard Wellein (Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany) and members of the ESSEX-II project.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Nakajima, K. et al. (2019). ppOpen-HPC/pK-Open-HPC: Application Development Framework with Automatic Tuning (AT). In: Sato, M. (eds) Advanced Software Technologies for Post-Peta Scale Computing. Springer, Singapore. https://doi.org/10.1007/978-981-13-1924-2_2
Download citation
DOI: https://doi.org/10.1007/978-981-13-1924-2_2
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-1923-5
Online ISBN: 978-981-13-1924-2
eBook Packages: Computer ScienceComputer Science (R0)