Abstract
In preparation for Summit, Oak Ridge National Laboratory’s next generation supercomputer, two IBM Power-based systems were deployed in late 2016 at the Oak Ridge Leadership Computing Facility (OLCF). This paper presents a detailed description of the acceptance of the first IBM Power-based early access systems installed at the OLCF. The two systems, Summitdev and Tundra, contain IBM POWER8+ processors with NVIDIA Pascal GPUs and were acquired to provide researchers with a platform to optimize codes for the Power architecture. In addition, this paper presents early functional and performance results obtained on Summitdev with the latest software stack available.
Notice of Copyright. This manuscript has been authored by UT-Battelle, LLC under Contract No. DE-AC05-00OR22725 with the U.S. Department of Energy. The United States Government retains and the publisher, by accepting the article for publication, acknowledges that the United States Government retains a non-exclusive, paid-up, irrevocable, world-wide license to publish or reproduce the published form of this manuscript, or allow others to do so, for United States Government purposes. The Department of Energy will provide public access to these results of federally sponsored research in accordance with the DOE Public Access Plan (http://energy.gov/downloads/doe-public-access-plan).
References
Aurora. http://aurora.alcf.anl.gov/
Center for Accelerated Application Readiness (CAAR). https://www.olcf.ornl.gov/caar
CORAL Benchmark Codes. https://asc.llnl.gov/CORAL-benchmarks
CUDA Samples. http://docs.nvidia.com/cuda/cuda-samples/index.html#samples-reference
Exascale Computing Project. https://exascaleproject.org/
Intel MPI Benchmarks User Guide. https://software.intel.com/en-us/imb-user-guide
NVIDIA TESLA P100 GPU Accelerator. https://images.nvidia.com/content/tesla/pdf/nvidia-tesla-p100-datasheet.pdf
Qbox: First-Principles Molecular Dynamics. http://qboxcode.org/
Sierra. https://asc.llnl.gov/coral-info
SPEC ACCEL Run and Reporting Rules. https://www.spec.org/accel/docs/runrules.html
Summit: Scale New Heights Discover New Solutions. https://www.olcf.ornl.gov/summit/
Summitdev Quickstart. https://www.olcf.ornl.gov/kb_articles/summitdev-quickstart
Using OpenMP 4.5 in the CLANG/LLVM compiler toolchain. https://www.olcf.ornl.gov/wp-content/uploads/2017/01/SummitDev_Using-OpenMP-4.5-in-the-CLANGLLVM-compiler-toolchain.pdf. Accessed 12 Apr 2017
Fact Sheet: Collaboration of Oak Ridge, Argonne, and Livermore (CORAL). Technical report, Department of Energy (2014). https://energy.gov/sites/prod/files/2014/12/f19/CORAL%20Fact%20Sheet__FINAL%20AS%20ISSUED_UPDATED.pdf
ESSL Guide and Reference (2016). https://publib.boulder.ibm.com/epubs/pdf/a2322688.pdf
Miniapps derived from production HPC applications using multiple programing models. Int. J. High Perform. Comput. Appl. 1094342016668241 (2016). doi:10.1177/1094342016668241
Anderson, E., Bai, Z., Dongarra, J., Greenbaum, A., McKenney, A., Du Croz, J., Hammerling, S., Demmel, J., Bischof, C., Sorensen, D.: LAPACK: a portable linear algebra library for high-performance computers. In: Proceedings of the 1990 ACM/IEEE Conference on Supercomputing, Supercomputing 1990, CA, USA, pp. 2–11 (1990). http://dl.acm.org/citation.cfm?id=110382.110385
Antao, S.F., Bataev, A., Jacob, A.C., Bercea, G.T., Eichenberger, A.E., Rokos, G., Martineau, M., Jin, T., Ozen, G., Sura, Z., Chen, T., Sung, H., Bertolli, C., O’Brien, K.: Offloading Support for OpenMP in Clang and LLVM. In: Proceedings of the Third Workshop on LLVM Compiler Infrastructure in HPC, LLVM-HPC 2016, pp. 1–11. IEEE Press, Piscataway (2016). doi:10.1109/LLVM-HPC.2016.6
Berrill, M.: Modeling of laser-created plasmas and soft x-ray lasers. Ph.D. thesis, Colorado State University (2010)
Caldeira, A., Haug, V., Vetter, S.: IBM Power Systems S822LC for High Performance Computing: Technical Overview and Introduction. Technical report, IBM, September 2016
Choi, J., Dongarra, J.J., Pozo, R., Walker, D.W.: ScaLAPACK: a scalable linear algebra library for distributed memory concurrent computers. In: 1992, Fourth Symposium on the Frontiers of Massively Parallel Computation, pp. 120–127. IEEE (1992). http://ieeexplore.ieee.org/document/234898/. Accessed 11 Oct 2016
Eisenbach, M., Zhou, C., Nicholson, D.M., Brown, G., Larkin, J., Schulthess, T.C.: Thermodynamics of magnetic systems from first principles: WL-LSMS
Hagen, G., Jansen, G.R., Papenbrock, T.: Structure of \(^{78}\)Ni from first-principles computations. Phys. Rev. Lett. 117, 172501 (2016). https://link.aps.org/doi/10.1103/PhysRevLett.117.172501
Oral, S., Dillow, D.A., Fuller, D., Hill, J., Leverman, D., Vazhkudai, S.S., Wang, F., Kim, Y., Rogers, J., Simmons, J., et al.: OLCFs 1 TB/s. Next-Generation Lustre File System
Phillips, J.C., Braun, R., Wang, W., Gumbart, J., Tajkhorshid, E., Villa, E., Chipot, C., Skeel, R.D., Kalé, L., Schulten, K.: Scalable molecular dynamics with NAMD. J. Comput. Chem. 26(16), 1781–1802 (2005). doi:10.1002/jcc.20289
Schlipf, M., Gygi, F.: Optimization algorithm for the generation of ONCV pseudopotentials. Comput. Phys. Commun. 196, 36–44 (2015). http://www.sciencedirect.com/science/article/pii/S0010465515001897
Tang, W., Wang, B., Ethier, S., Lin, Z.: Performance portability of HPC discovery science software: fusion energy turbulence simulations at extreme scale. Supercomputing Front. Innovations 4(1), 83–97 (2017)
Tharrington, A., Hai Ah Nam, W.J., Brown, W.M., Anantharaj, V.G.: Early applications experience on the cray XK6 at the Oak Ridge leadership computing facility. In: Cray User Group Meeting CUG (2012)
Wang, C., Chandrasekaran, S., Chapman, B.: An OpenMP 3.1 validation testsuite. In: Chapman, B.M., Massaioli, F., MĂ¼ller, M.S., Rorro, M. (eds.) IWOMP 2012. LNCS, vol. 7312, pp. 237–249. Springer, Heidelberg (2012). doi:10.1007/978-3-642-30961-8_18
Acknowledgements
The authors would like to thank the entire Summitdev Acceptance Test team for the development of tests for each phase. In addition to the authors, the team also includes: Adam Simpson, Mike Brim, Dustin Leverman, Oscar Hernandez, Chris Zimmer, Sarp Oral, Scott Atchley, and Matt Ezell.
This research used resources of the Oak Ridge Leadership Computing Facility at the Oak Ridge National Laboratory, which is supported by the Office of Science of the U.S. Department of Energy under Contract No. DE-AC05-00OR22725.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Vergara Larrea, V.G. et al. (2017). Experiences Evaluating Functionality and Performance of IBM POWER8+ Systems. In: Kunkel, J., Yokota, R., Taufer, M., Shalf, J. (eds) High Performance Computing. ISC High Performance 2017. Lecture Notes in Computer Science(), vol 10524. Springer, Cham. https://doi.org/10.1007/978-3-319-67630-2_20
Download citation
DOI: https://doi.org/10.1007/978-3-319-67630-2_20
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-67629-6
Online ISBN: 978-3-319-67630-2
eBook Packages: Computer ScienceComputer Science (R0)