Advertisement

SPEC OMP2012 — An Application Benchmark Suite for Parallel Systems Using OpenMP

  • Matthias S. Müller
  • John Baron
  • William C. Brantley
  • Huiyu Feng
  • Daniel Hackenberg
  • Robert Henschel
  • Gabriele Jost
  • Daniel Molka
  • Chris Parrott
  • Joe Robichaux
  • Pavel Shelepugin
  • Matthijs van Waveren
  • Brian Whitney
  • Kalyan Kumaran
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7312)

Abstract

This paper describes SPEC OMP2012, a benchmark developed by the SPEC High Performance Group. It consists of 15 OpenMP parallel applications from a wide range of fields. In addition to a performance metric based on the run time of the applications the benchmark adds an optional energy metric. The accompanying run rules detail how the benchmarks are executed and the results reported. They also cover the energy measurements. The first set of results provide scalability on three different platforms.

Keywords

Benchmark OpenMP SPEC Energy Efficiency 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Image magick homepage (March 2012), http://www.imagemagick.org
  2. 2.
    Axner, L., Bernsdorf, J., Zeiser, T., Lammers, P., Linxweiler, J., Hoekstra, A.G.: Performance evaluation of a parallel sparse lattice Boltzmann solver. Journal of Computational Physics 227(10), 4895–4911 (2008)MathSciNetzbMATHCrossRefGoogle Scholar
  3. 3.
    Mark Bull, J., O’Neill, D.: A microbenchmark suite for OpenMP 2.0. In: Proceedings of the Third Workshop on OpenMP (EWOMP 2001), pp. 41–48 (2001)Google Scholar
  4. 4.
    Caballero, O.L., Horowitz, C.J., Berry, D.K.: Neutrino scattering in heterogeneous supernova plasmas. Phys. Rev. C 74, 065801 (2006)Google Scholar
  5. 5.
    Che, S., Boyer, M., Meng, J., Tarjan, D., Sheaffer, J.W., Lee, S.-H., Skadron, K.: Rodinia: A benchmark suite for heterogeneous computing. In: Proceedings of the 2009 IEEE International Symposium on Workload Characterization, IISWC 2009, pp. 44–54. IEEE Computer Society, Washington, DC (2009)CrossRefGoogle Scholar
  6. 6.
    Duran, A., Teruel, X., Ferrer, R., Martorell, X., Ayguadé, E.: Barcelona OpenMP tasks suite: A set of benchmarks targeting the exploitation of task parallelism in OpenMP. In: ICPP, pp. 124–131. IEEE Computer Society (2009)Google Scholar
  7. 7.
    Feng, W.-C., Cameron, K.W.: The green500 list: Encouraging sustainable supercomputing. Computer 40(12), 50–55 (2007)CrossRefGoogle Scholar
  8. 8.
    Hackenberg, D., Schöne, R., Molka, D., Müller, M.S., Knüpfer, A.: Quantifying power consumption variations of HPC systems using SPEC MPI benchmarks. Computer Science – Research and Development 25, 155–163 (2010), doi:10.1007/s00450-010-0118-0CrossRefGoogle Scholar
  9. 9.
    Jin, H., Frumkin, M., Yan, J.: The OpenMP implementation of NAS parallel benchmarks and its performance. Technical report, NASA (1999)Google Scholar
  10. 10.
    Key, S.W., Hoff, C.C.: An improved constant membrane and bending stress shell element for explicit transient dynamics. Computer Methods in Applied Mechanics and Engineering 124(12), 33–47 (1995)MathSciNetzbMATHCrossRefGoogle Scholar
  11. 11.
    Kremenetsky, M., Raefsky, A., Reinhardt, S.: Poor Scalability of Parallel Shared Memory Model: Myth or Reality? In: Sloot, P.M.A., Abramson, D., Bogdanov, A.V., Gorbachev, Y.E., Dongarra, J., Zomaya, A.Y. (eds.) ICCS 2003. LNCS, vol. 2660, pp. 657–666. Springer, Heidelberg (2003), 10.1007/3-540-44864-0_68CrossRefGoogle Scholar
  12. 12.
    Lange, K.-D.: Identifying shades of green: The SPECpower benchmarks. Computer 42, 95–97 (2009)CrossRefGoogle Scholar
  13. 13.
    Macke, T.J., Case, D.A.: Modeling Unusual Nucleic Acid Structures, ch.25, pp. 379–393. American Chemical Society (1997)Google Scholar
  14. 14.
    Müller, M.S., Kalyanasundaram, K., Gaertner, G., Jones, W., Eigenmann, R., Lieberman, R., van Waveren, M., Whitney, B.: SPEC HPG benchmarks for high performance systems. International Journal of High Performance Computing and Networking 1(4), 162–170 (2004)Google Scholar
  15. 15.
    Nguyen, V., Deeds-Rubin, S., Tan, T., Boehm, B.: A sloc counting standard. Technical report, University of Southern California: Center for Systems and Software Engineering (2007)Google Scholar
  16. 16.
    Sadourny, R.: The Dynamics of Finite-Difference Models of the Shallow-Water Equations. Journal of Atmospheric Sciences 32, 680–689 (1975)CrossRefGoogle Scholar
  17. 17.
    Saito, H., Gaertner, G., Jones, W., Eigenmann, R., Iwashita, H., Lieberman, R., van Waveren, M., Whitney, B.: Large System Performance of SPEC OMP2001 Benchmarks. In: Zima, H.P., Joe, K., Sato, M., Seo, Y., Shimasaki, M. (eds.) ISHPC 2002. LNCS, vol. 2327, pp. 370–379. Springer, Heidelberg (2002)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Matthias S. Müller
    • 1
    • 2
  • John Baron
    • 1
    • 4
  • William C. Brantley
    • 1
    • 3
  • Huiyu Feng
    • 1
    • 4
  • Daniel Hackenberg
    • 1
    • 2
  • Robert Henschel
    • 1
    • 5
  • Gabriele Jost
    • 1
    • 3
  • Daniel Molka
    • 1
    • 2
  • Chris Parrott
    • 1
    • 6
  • Joe Robichaux
    • 1
    • 7
  • Pavel Shelepugin
    • 1
    • 8
  • Matthijs van Waveren
    • 1
    • 9
  • Brian Whitney
    • 1
    • 10
  • Kalyan Kumaran
    • 1
    • 11
  1. 1.SPEC High Performance GroupGermany
  2. 2.Center for Information Services and High Performance Computing (ZIH)Technische Universität DresdenDresdenGermany
  3. 3.Advanced Micro Devices, Inc.USA
  4. 4.Silicon Graphics InternationalUSA
  5. 5.Indiana UniversityUSA
  6. 6.Portland GroupUSA
  7. 7.IBMUSA
  8. 8.Intel CorporationUSA
  9. 9.Fujitsu Systems Europe LtdFrance
  10. 10.OracleUSA
  11. 11.Argonne National LaboratoryUSA

Personalised recommendations